-- Logs begin at Thu 2022-07-14 15:00:17 UTC, end at Thu 2022-07-14 16:22:07 UTC. -- Jul 14 15:34:36.061786 dv-cinder-849869-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 14 15:34:36.072357 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 14 15:34:36.074415 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 15:34:36 2022] *** Jul 14 15:34:36.074415 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 15:34:36.074415 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 15:34:36.074415 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: nodename: dv-cinder-849869-1-iscsi Jul 14 15:34:36.074415 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: machine: x86_64 Jul 14 15:34:36.074415 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: clock source: unix Jul 14 15:34:36.074415 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: pcre jit disabled Jul 14 15:34:36.074415 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: detected number of CPU cores: 4 Jul 14 15:34:36.074415 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: current working directory: / Jul 14 15:34:36.074415 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: detected binary path: /usr/bin/uwsgi-core Jul 14 15:34:36.074415 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: your processes number limit is 47680 Jul 14 15:34:36.075002 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: your memory page size is 4096 bytes Jul 14 15:34:36.075002 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: detected max file descriptor number: 2048 Jul 14 15:34:36.075002 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: lock engine: pthread robust mutexes Jul 14 15:34:36.075002 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: thunder lock: enabled Jul 14 15:34:36.075002 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 14 15:34:36.075002 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 14 15:34:36.119194 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: Python main interpreter initialized at 0x5636da7059c0 Jul 14 15:34:36.119194 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: python threads support enabled Jul 14 15:34:36.119194 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: your server socket listen backlog is limited to 100 connections Jul 14 15:34:36.119194 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: your mercy for graceful operations on workers is 90 seconds Jul 14 15:34:36.119548 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 15:34:36.119623 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: *** Operational MODE: preforking *** Jul 14 15:34:36.119881 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: *** uWSGI is running in multiple interpreter mode *** Jul 14 15:34:36.119881 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: spawned uWSGI master process (pid: 86966) Jul 14 15:34:36.120090 dv-cinder-849869-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 14 15:34:36.123125 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: spawned uWSGI worker 1 (pid: 86978, cores: 1) Jul 14 15:34:36.123125 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: spawned uWSGI worker 2 (pid: 86979, cores: 1) Jul 14 15:34:36.123125 dv-cinder-849869-1-iscsi devstack@keystone.service[86966]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 15:34:41.667500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:34:41.667500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: from cryptography.utils import int_from_bytes Jul 14 15:34:41.668288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:34:41.668288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: from cryptography.utils import int_from_bytes Jul 14 15:34:41.668400 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:34:41.668400 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: from cryptography.utils import int_from_bytes Jul 14 15:34:41.668821 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:34:41.668821 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: from cryptography.utils import int_from_bytes Jul 14 15:34:41.719126 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 15:34:41.719294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 15:34:41.719492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] command line args: [] {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 15:34:41.719765 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 15:34:41.719944 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ================================================================================ {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 15:34:41.720226 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] admin_token = **** {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.720384 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 15:34:41.720465 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] config_dir = [] {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.720599 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 15:34:41.720691 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.720795 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] command line args: [] {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 15:34:41.720879 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] config_source = [] {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.720982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] debug = True {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.721064 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 15:34:41.721180 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.721435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ================================================================================ {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 15:34:41.721518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] admin_token = **** {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.721593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.721700 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.721781 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] config_dir = [] {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.721901 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.721994 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.722090 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] config_source = [] {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.722176 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.722276 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] debug = True {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.723010 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] list_limit = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.723229 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.723342 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] log_config_append = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.723416 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.723492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.723563 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.723641 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] log_dir = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.723762 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] log_file = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.723844 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.724002 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.724092 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.724260 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] list_limit = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.724350 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.724448 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] log_config_append = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.724526 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.724635 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.724752 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.724827 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] log_dir = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.724929 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.725003 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] log_file = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.725110 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.725208 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.725353 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.725458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.725598 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.725729 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.725839 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.725950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.726071 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.726229 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.726346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.726467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.726583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.726701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.726814 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.726935 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.727050 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.727167 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.727293 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.727403 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.727525 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.727651 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.727763 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.119/identity {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.727876 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.727988 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] publish_errors = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.728192 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.728310 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.728424 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.728537 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.728652 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.728763 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.728886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.119/identity {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.729000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.729118 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] publish_errors = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.729236 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] standard_threads = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.729357 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.729490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.729604 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.729708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.729829 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.729943 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.730056 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.730168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] use_journal = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.730168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] use_json = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.730385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.730507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] use_stderr = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.730618 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] standard_threads = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.730727 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] use_syslog = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.730846 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.730966 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.731079 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.731276 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.731393 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.731502 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.731614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] use_journal = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.731614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] use_json = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.731824 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.731945 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] use_stderr = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.732059 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.732183 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] use_syslog = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.732296 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.732418 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:34:41.732538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.732659 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.732780 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.732900 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.733019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.733133 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.733252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.733377 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.733490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.733609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.733728 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.733847 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.733961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.734147 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.734251 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.734364 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.734459 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.734577 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.734696 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.734821 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.734950 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.735065 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.735181 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.735295 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.735406 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.735530 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.735643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.735755 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.735873 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.735994 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.736122 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.736258 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.736374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.736493 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.736607 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.736719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.736909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.737026 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.737145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.737260 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.737379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.737492 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.737613 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.737727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.737839 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.737958 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.738119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.738233 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.738354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.738474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.738588 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.738707 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.738820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.738820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.739038 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.739163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.739277 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.739389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.739501 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.739613 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.739717 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.739813 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.739907 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.740007 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.740119 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.740221 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.740331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.740429 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.740523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.740623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.740756 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.740883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.741007 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.741127 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.741127 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.741342 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.741455 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.741568 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.741689 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.741810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.741915 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.742034 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.742147 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.742252 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.742380 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.742496 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.742612 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.742727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.742840 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.742954 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.743073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.743199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.743315 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.743436 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.743551 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.743664 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.743777 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.743898 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.744013 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.744153 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.744269 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.744384 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.744497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.744622 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.744734 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.744848 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.744961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.745074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.745193 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.745305 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.745419 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.745533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.745628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.745698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.745775 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.745854 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.745972 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.746086 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.746200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.746321 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.746438 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.746560 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.746675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.746788 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.746902 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.747016 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.747136 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.747259 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.747381 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.747505 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.747621 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.747735 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.747854 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.748032 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.748149 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.748252 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.748349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.748445 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.748541 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.759537 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.759649 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.759905 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.759990 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.760063 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.760156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.760251 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.760333 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.760452 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.760537 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.760610 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.760681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.760752 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.760831 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.760903 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.760974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.761045 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.761116 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.761187 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.761265 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.761338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.761409 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.761485 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.761557 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.761634 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.761717 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.761790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.761861 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.761938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.762010 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.762081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.762160 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.762233 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.762309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.762387 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.762459 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.762530 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.762612 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.762685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.762756 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.762756 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.762890 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.762967 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.763046 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.763046 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.763182 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.763254 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.763324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.763394 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.763472 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.763545 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.763616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.763693 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.763764 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.763840 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.763920 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.763992 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.764068 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] auth.external = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.764211 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.764297 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.764371 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.764450 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.764524 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.764595 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.764698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.764774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] auth.password = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.764895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.764981 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] auth.token = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.765055 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.765155 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.765236 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.765311 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.765382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] auth.external = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.765459 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.765531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.765610 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.765684 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.765756 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.765866 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.765948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.766021 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] auth.password = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.766101 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.766174 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] auth.token = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.766246 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] credential.caching = True {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.766317 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.766388 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.766459 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.766537 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.766611 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.766683 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.766760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.766838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.766910 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.766989 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.767063 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.767135 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.767206 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.767276 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.767347 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] credential.caching = True {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.767427 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.767507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.767581 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.767652 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.767730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.767803 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.767803 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.767947 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.768022 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.768093 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.768181 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.768253 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.768400 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.768477 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.768549 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.768620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.768698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.768771 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] federation.caching = True {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.768771 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.768910 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.768982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.769103 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.769180 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.769870 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.769956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.770077 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.770161 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.770236 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.770308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.770388 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.770462 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.770535 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] federation.caching = True {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.770607 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.770678 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.770749 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.770829 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.770902 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.770974 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.771046 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.771117 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.771189 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] identity.caching = True {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.771268 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.771348 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.771421 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.771493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.771565 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.771636 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.771718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.771798 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.771798 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.771928 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.771999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.772070 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.772175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.772251 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.772323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.772394 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] identity.caching = True {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.772465 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.772543 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.772628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.772703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.772775 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.772846 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.772918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.772989 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.773068 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.773141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.773212 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.773291 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.773365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.773436 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.773515 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.773614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.773694 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.773808 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.773983 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.774082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.774171 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.774235 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.774352 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.774430 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.774502 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.774581 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.774581 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.774761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.774842 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.774914 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.774992 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.775064 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.775144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.775217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.775294 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.775367 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.775438 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.775508 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.776051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.776150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.776226 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.776299 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.776371 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.776455 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.776531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.776603 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.776675 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.776747 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.776819 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.776898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.776972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.777044 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.777116 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.777187 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.777259 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.777339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.777413 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.777486 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.777558 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.777629 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.777701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.777782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.777782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.777913 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.777985 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.778106 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.778190 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.778272 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.778345 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.778417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.778496 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.778570 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.778641 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.778720 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.778793 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.778865 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.778937 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.779008 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.779078 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.779157 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.779230 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.779302 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.779372 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.779443 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.779513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.user = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.779592 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.779725 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.779799 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.779866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.779928 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.779986 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.780065 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.780188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.780265 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.780338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.786296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.786382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.786569 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.786652 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.786726 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.786798 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.786870 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.user = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.786943 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.787023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.787098 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.787170 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.787243 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.787316 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.787388 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.787468 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.787543 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.787616 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.787688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.787761 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.787832 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.787916 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.787996 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.788071 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.788209 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.788286 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.788358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.788442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.788518 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.788590 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.788662 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.788734 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.788806 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.788885 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.788960 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.789032 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.789103 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.789175 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.789247 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.789327 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.789402 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.789474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.789546 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.789617 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.789689 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.789769 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.789844 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.789921 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.789995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.790066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.790138 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.790283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.790360 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.790465 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.790538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.790611 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.790672 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.790740 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.790819 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.790893 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.790964 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.791035 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.791106 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.791185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.791258 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] resource.caching = True {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.791330 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.791401 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.791472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.791543 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.791622 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.791695 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.791766 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.791838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.791909 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.791970 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.792036 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.792128 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.792193 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.792252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.792323 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.792407 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.792481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] resource.caching = True {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.792553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.792625 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.792696 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] role.caching = True {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.792768 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.792847 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] role.driver = sql {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.792921 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.792992 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.793063 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.793124 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.793182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.793248 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.793310 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.793369 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.793428 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.793499 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.793570 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.793650 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.793724 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.793796 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.793867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] role.caching = True {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.793938 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.794009 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] role.driver = sql {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.794088 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.794162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.794233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.794304 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.794375 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.794446 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.794530 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.794605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.794677 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.794748 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.794819 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.794891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.794970 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.795044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.795111 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.795182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.795254 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.795325 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.795404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.795478 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.795550 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.795621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.795693 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.795767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.795851 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.795926 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.795998 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.796069 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.796153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.796153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.796299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.796372 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.796443 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.796539 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.796605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.796673 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.796734 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.796793 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.796851 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.796909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.796967 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.797033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.797094 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.797153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.797211 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.797269 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.797334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.797414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.797477 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.797536 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] token.caching = True {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.797593 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.797652 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.797722 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.797796 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.797869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.797931 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.797990 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.798048 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.798119 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.798198 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.798271 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.798343 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.798415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.798540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.798624 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.798785 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.798868 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.799022 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] token.caching = True {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.799104 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.799258 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.799339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.799495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.799576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.799729 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.799811 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.799975 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.800055 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.800247 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.800331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.800517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.800598 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.800774 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.800854 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.801029 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.801143 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.801343 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] database.connection = **** {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.801435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.801584 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.801665 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.801827 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.801915 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.802061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.802140 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.802301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.802381 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.802534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.802622 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.802773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.802852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.803011 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.803091 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.803247 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.803335 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.803490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.803571 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] database.connection = **** {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.803725 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.803879 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.803956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.804028 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.804221 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.804318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.804471 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.804551 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.804726 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.804815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.804955 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.805045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.805181 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.805261 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.805414 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.805492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.805646 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.805734 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.805809 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 15:34:41.805882 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.806110 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.806347 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.806598 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.806836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.807082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.807314 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.807557 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.807793 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:34:41.807965 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 15:34:41.837105 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:41.837332 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:41.837559 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:41.838623 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:41.838856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:41.839081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:41.846121 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:41.847569 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:41.874946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:41.875174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:41.875755 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:41.875992 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.021455 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.021803 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.071040 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.071268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.072125 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.072369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.136283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.136505 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.136730 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.136886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.136977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.137120 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.137205 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.137342 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.137435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.137559 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.137773 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.137987 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.162513 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.165956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.166077 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.166148 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.166271 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.166355 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.166447 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.166526 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.166602 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.166676 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.166750 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.166833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.166910 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.166985 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.175488 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.176916 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.189076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.189394 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.189699 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.189995 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.190284 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.190587 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.190886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86978) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.190970 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.191181 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.191404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.191865 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.192086 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.192326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.192538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86979) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:34:42.210109 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.210321 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 15:34:42.210405 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.210584 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 15:34:42.210872 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.211077 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 15:34:42.211159 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.211339 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 15:34:42.211428 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.211601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.211681 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.211863 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.211945 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.212144 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.212240 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.212405 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.223950 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.224073 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.224247 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.224371 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.224516 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.224638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.224794 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.224918 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.232948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86979) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.233114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86978) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.236213 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86979) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.236400 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86978) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.236482 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.236679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.236773 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.236960 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.237043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.237243 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.237325 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.237514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.237595 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.237772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.237853 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.238081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.238167 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.238354 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.238436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.238677 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.238755 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.238942 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.239030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.239233 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.265450 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.265548 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.267040 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86979) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.267141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86978) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.267319 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.267401 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.273122 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86979) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.273219 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86978) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.273354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.273469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.273630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.273750 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.281048 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86979) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.281170 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86978) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.281325 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.281414 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.286431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86979) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.286534 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86978) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.286713 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.286814 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.286993 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.287078 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.287273 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.287355 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.287549 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.287634 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.287816 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.287899 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.288081 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.288189 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.288370 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.288455 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.306911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.307028 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.307180 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.307356 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.311818 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86979) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.312122 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86978) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.315415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.315711 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.315805 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.316015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.320934 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86979) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.321325 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86978) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.324521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86979) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.324945 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86978) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.328125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.328425 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.328582 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.328714 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.328881 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.329001 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.329180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.329280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.329468 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.329552 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.329756 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.330037 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.352027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86979) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.352453 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.352798 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86978) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.352913 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.353093 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.353347 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.353432 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.353612 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.361526 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.361704 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.363758 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.364030 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.364186 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.364494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.367252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86979) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.367530 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.367672 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86978) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.367806 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.367951 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.368082 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.368256 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.368439 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.368520 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.368861 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.382193 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86979) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.382472 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.382716 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86978) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.382806 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.383004 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.383091 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.383281 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.383365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.383563 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.383646 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.383835 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.383919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.384146 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.384429 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.403265 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86979) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.403563 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86978) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.406522 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86979) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.406867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86978) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.409799 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.410342 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.411503 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.411809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.413280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86979) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.413562 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.413646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86978) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.413848 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.413934 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.414133 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.421073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.421513 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.422751 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86979) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.423130 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86978) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.426464 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.426744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.427026 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.427124 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.427310 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.427394 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.427631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.427912 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.436520 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86979) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.436804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.437079 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.437166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86978) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.437401 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.437689 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.445547 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86979) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.445825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.446103 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.446187 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86978) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:34:42.446374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.446473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.446640 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.446725 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.446912 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.446995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.447183 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.447276 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.447451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.447534 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.447728 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.447810 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.447997 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.448090 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.448378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.448471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.448631 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.448729 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.448903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.448987 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.449167 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86979) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.449250 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.449428 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.449695 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86978) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:34:42.490327 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5636da7059c0 pid: 86978 (default app) Jul 14 15:34:42.493606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5636da7059c0 pid: 86979 (default app) Jul 14 15:34:42.493833 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2ada6-d2c5-4234-b8f0-621b79f4ef61 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:42.494196 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2ada6-d2c5-4234-b8f0-621b79f4ef61 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:42.494495 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2ada6-d2c5-4234-b8f0-621b79f4ef61 None None] PATH_INFO: `/v3` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:42.498749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1/1] 10.222.0.119 () {50 vars in 796 bytes} [Thu Jul 14 15:34:42 2022] GET /identity/v3/ => generated 256 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:34:51.146671 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a752249-4539-4476-b265-5ddb25b4c42c None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:51.147252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a752249-4539-4476-b265-5ddb25b4c42c None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:51.147252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a752249-4539-4476-b265-5ddb25b4c42c None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:51.151550 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1/2] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:34:51 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:34:51.156749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c4ced-5c04-4559-ad19-6064bb36e99e None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:51.157125 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c4ced-5c04-4559-ad19-6064bb36e99e None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:51.157319 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c4ced-5c04-4559-ad19-6064bb36e99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:51.227910 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: INFO dbcounter [None req-e95c4ced-5c04-4559-ad19-6064bb36e99e None None] Registered counter for database keystone Jul 14 15:34:51.253017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG oslo_db.sqlalchemy.engines [None req-e95c4ced-5c04-4559-ad19-6064bb36e99e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86978) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:34:51.259604 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writer thread running {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:34:51.435240 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG passlib.handlers.bcrypt [None req-e95c4ced-5c04-4559-ad19-6064bb36e99e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86978) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 15:34:51.435564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG passlib.handlers.bcrypt [None req-e95c4ced-5c04-4559-ad19-6064bb36e99e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86978) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 15:34:51.490258 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-e95c4ced-5c04-4559-ad19-6064bb36e99e None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:34:51.491850 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-e95c4ced-5c04-4559-ad19-6064bb36e99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:34:51.615656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 2/3] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:34:51 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 14 15:34:51.797668 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a752249-4539-4476-b265-5ddb25b4c42c None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:34:51.867944 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: INFO dbcounter [None req-5a752249-4539-4476-b265-5ddb25b4c42c None None] Registered counter for database keystone Jul 14 15:34:51.887713 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG oslo_db.sqlalchemy.engines [None req-5a752249-4539-4476-b265-5ddb25b4c42c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86979) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:34:51.893950 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writer thread running {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:34:52.013516 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a752249-4539-4476-b265-5ddb25b4c42c None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:34:52.017816 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ab7cf-cd0c-4c8c-8269-05c999fbb64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:34:52.018480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ab7cf-cd0c-4c8c-8269-05c999fbb64e admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:52.018792 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ab7cf-cd0c-4c8c-8269-05c999fbb64e admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:52.019055 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ab7cf-cd0c-4c8c-8269-05c999fbb64e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:52.028061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ab7cf-cd0c-4c8c-8269-05c999fbb64e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:34:52.079595 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b70ab7cf-cd0c-4c8c-8269-05c999fbb64e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 15:34:52.079944 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ab7cf-cd0c-4c8c-8269-05c999fbb64e admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:34:52.090931 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 2/4] 10.222.0.119 () {58 vars in 1329 bytes} [Thu Jul 14 15:34:51 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 15:34:52.097000 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c4ced-5c04-4559-ad19-6064bb36e99e None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:34:52.112139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c4ced-5c04-4559-ad19-6064bb36e99e None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:34:52.116916 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17477a-5ae4-4391-b018-6a4b84a7440f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:34:52.118042 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17477a-5ae4-4391-b018-6a4b84a7440f admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:52.118335 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17477a-5ae4-4391-b018-6a4b84a7440f admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:52.118614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17477a-5ae4-4391-b018-6a4b84a7440f admin admin] PATH_INFO: `/v3/projects/a12def5ec62e451d99b7e6dd6faef1ba` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:52.122875 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17477a-5ae4-4391-b018-6a4b84a7440f admin admin] RBAC: Authorizing `identity:get_project(project_id=a12def5ec62e451d99b7e6dd6faef1ba)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:34:52.173887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0e17477a-5ae4-4391-b018-6a4b84a7440f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 15:34:52.174467 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17477a-5ae4-4391-b018-6a4b84a7440f admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:34:52.179493 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 3/5] 10.222.0.119 () {56 vars in 1212 bytes} [Thu Jul 14 15:34:52 2022] GET /identity/v3/projects/a12def5ec62e451d99b7e6dd6faef1ba => generated 345 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:34:54.311775 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28395914-5a04-4aa3-98f4-759d030ab3f0 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:54.312359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28395914-5a04-4aa3-98f4-759d030ab3f0 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:54.312503 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28395914-5a04-4aa3-98f4-759d030ab3f0 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:54.317227 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 3/6] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:34:54 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:34:54.323962 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436c8ef-26ed-440f-b402-c2b222ee6d62 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:54.324510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436c8ef-26ed-440f-b402-c2b222ee6d62 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:54.324599 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436c8ef-26ed-440f-b402-c2b222ee6d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:54.344687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-6436c8ef-26ed-440f-b402-c2b222ee6d62 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:34:54.346216 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-6436c8ef-26ed-440f-b402-c2b222ee6d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:34:54.354205 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 4/7] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:34:54 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 14 15:34:54.377290 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28395914-5a04-4aa3-98f4-759d030ab3f0 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:34:54.390047 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28395914-5a04-4aa3-98f4-759d030ab3f0 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:34:54.394210 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b87af-4621-47e0-9330-dba6a5117830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:34:54.395069 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b87af-4621-47e0-9330-dba6a5117830 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:54.395354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b87af-4621-47e0-9330-dba6a5117830 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:54.395637 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b87af-4621-47e0-9330-dba6a5117830 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:54.403343 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b87af-4621-47e0-9330-dba6a5117830 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:34:54.405139 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b87af-4621-47e0-9330-dba6a5117830 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:34:54.414010 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 4/8] 10.222.0.119 () {58 vars in 1329 bytes} [Thu Jul 14 15:34:54 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:34:54.419722 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436c8ef-26ed-440f-b402-c2b222ee6d62 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:34:54.429494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436c8ef-26ed-440f-b402-c2b222ee6d62 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:34:54.433847 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f58094-9ef7-406f-85b5-373ea579d0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:34:54.434709 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f58094-9ef7-406f-85b5-373ea579d0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:54.434994 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f58094-9ef7-406f-85b5-373ea579d0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:54.435270 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f58094-9ef7-406f-85b5-373ea579d0b8 admin admin] PATH_INFO: `/v3/users/558923a0ab794e4fab69165d8d72902b` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:54.436690 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f58094-9ef7-406f-85b5-373ea579d0b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=558923a0ab794e4fab69165d8d72902b)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:34:54.438518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f58094-9ef7-406f-85b5-373ea579d0b8 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:34:54.440079 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 5/9] 10.222.0.119 () {56 vars in 1203 bytes} [Thu Jul 14 15:34:54 2022] GET /identity/v3/users/558923a0ab794e4fab69165d8d72902b => generated 248 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:34:56.549519 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4ed30-ca78-462c-bce7-a261fe586d5b None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:56.550053 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4ed30-ca78-462c-bce7-a261fe586d5b None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:56.550053 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4ed30-ca78-462c-bce7-a261fe586d5b None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:56.552452 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 5/10] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:34:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:34:56.558342 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0ca6f-c23d-405a-ab47-1c7613f002a9 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:56.558917 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0ca6f-c23d-405a-ab47-1c7613f002a9 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:56.559206 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0ca6f-c23d-405a-ab47-1c7613f002a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:56.577335 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-ffc0ca6f-c23d-405a-ab47-1c7613f002a9 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:34:56.578506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-ffc0ca6f-c23d-405a-ab47-1c7613f002a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:34:56.587191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83412a81-f50c-4511-a013-241a3b7e6a6a None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:56.587485 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83412a81-f50c-4511-a013-241a3b7e6a6a None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:56.587771 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83412a81-f50c-4511-a013-241a3b7e6a6a None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:56.589495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 6/11] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:34:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:34:56.594694 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7068c-7501-44e5-8892-80c11dbfb8bf None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:56.594986 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7068c-7501-44e5-8892-80c11dbfb8bf None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:56.595274 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7068c-7501-44e5-8892-80c11dbfb8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:56.636575 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG passlib.handlers.bcrypt [None req-70d7068c-7501-44e5-8892-80c11dbfb8bf None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86979) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 15:34:56.637005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG passlib.handlers.bcrypt [None req-70d7068c-7501-44e5-8892-80c11dbfb8bf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86979) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 15:34:56.661072 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 6/12] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:34:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:34:56.682468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-70d7068c-7501-44e5-8892-80c11dbfb8bf None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:34:56.684068 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-70d7068c-7501-44e5-8892-80c11dbfb8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:34:56.685351 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0ca6f-c23d-405a-ab47-1c7613f002a9 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:34:56.709281 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:56.786384 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 7/13] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:34:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:34:56.791184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0ca6f-c23d-405a-ab47-1c7613f002a9 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:34:56.809137 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7068c-7501-44e5-8892-80c11dbfb8bf None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:34:56.825595 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dd7cf-cc38-426f-8d29-48009af1a62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:34:56.826393 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dd7cf-cc38-426f-8d29-48009af1a62a None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:56.826681 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dd7cf-cc38-426f-8d29-48009af1a62a None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:56.826959 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dd7cf-cc38-426f-8d29-48009af1a62a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:56.837872 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dd7cf-cc38-426f-8d29-48009af1a62a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:34:56.849839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-580dd7cf-cc38-426f-8d29-48009af1a62a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:34:56.849839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:34:56.849839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:34:56.849839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:34:56.849839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:34:56.849839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:34:56.849839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:34:56.849839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:34:56.849839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:34:56.849839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:34:56.849839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:34:56.849839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:34:56.849839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:34:56.849839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:34:56.849839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:34:56.849839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:34:56.850828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:34:56.850828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:34:56.850828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:34:56.850828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:34:56.850828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:34:56.850828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:34:56.850828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:34:56.850828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:34:56.850828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:34:56.850828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:34:56.850828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:34:56.850828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:34:56.850828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:34:56.850828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:34:56.850828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:34:56.850828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:34:56.851727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:34:56.851727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:34:56.851727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:34:56.851727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:34:56.851727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:34:56.851727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:34:56.851727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:34:56.851727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:34:56.851727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:34:56.851727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:34:56.851727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:34:56.851727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:34:56.851727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 7/14] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:34:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:34:56.856904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dd7cf-cc38-426f-8d29-48009af1a62a None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:34:56.915183 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7068c-7501-44e5-8892-80c11dbfb8bf None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:34:56.917499 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:56.938695 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:56.953526 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a2d65-cead-4b38-a3e4-432d72a827b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:34:56.954426 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a2d65-cead-4b38-a3e4-432d72a827b7 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:56.954714 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a2d65-cead-4b38-a3e4-432d72a827b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:56.954995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a2d65-cead-4b38-a3e4-432d72a827b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:56.956484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dd7cf-cc38-426f-8d29-48009af1a62a None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:34:56.991386 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44bdf4-a937-4c0b-b6ba-41a349f35da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:34:56.992061 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44bdf4-a937-4c0b-b6ba-41a349f35da5 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:56.992374 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44bdf4-a937-4c0b-b6ba-41a349f35da5 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:56.992649 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44bdf4-a937-4c0b-b6ba-41a349f35da5 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:56.993402 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44bdf4-a937-4c0b-b6ba-41a349f35da5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:34:56.993709 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44bdf4-a937-4c0b-b6ba-41a349f35da5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:34:56.995104 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44bdf4-a937-4c0b-b6ba-41a349f35da5 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:34:57.006749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 8/15] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:34:56 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:34:57.012406 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44bdf4-a937-4c0b-b6ba-41a349f35da5 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:34:57.023893 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a2d65-cead-4b38-a3e4-432d72a827b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:34:57.025449 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a2d65-cead-4b38-a3e4-432d72a827b7 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:34:57.111793 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44bdf4-a937-4c0b-b6ba-41a349f35da5 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:34:57.123690 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 8/16] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:34:56 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 15:34:57.129868 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a2d65-cead-4b38-a3e4-432d72a827b7 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:34:57.132605 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:57.148183 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46ccdc-538a-430c-bba3-af5b0393671e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:34:57.149070 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46ccdc-538a-430c-bba3-af5b0393671e None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:57.149360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46ccdc-538a-430c-bba3-af5b0393671e None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:57.149639 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46ccdc-538a-430c-bba3-af5b0393671e None admin] PATH_INFO: `/v3/users/558923a0ab794e4fab69165d8d72902b` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:57.150862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46ccdc-538a-430c-bba3-af5b0393671e None admin] RBAC: Authorizing `identity:get_user(user_id=558923a0ab794e4fab69165d8d72902b)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:34:57.152366 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46ccdc-538a-430c-bba3-af5b0393671e None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:34:57.154035 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 9/17] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:34:57 2022] GET /identity/v3/users/558923a0ab794e4fab69165d8d72902b => generated 248 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:34:57.159506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46ccdc-538a-430c-bba3-af5b0393671e None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:34:57.174072 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:57.230389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a2d65-cead-4b38-a3e4-432d72a827b7 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:34:57.259918 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46ccdc-538a-430c-bba3-af5b0393671e None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:34:57.265651 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82bf79c-33a6-4b21-a02d-98260c7f375b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:34:57.266465 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bf79c-33a6-4b21-a02d-98260c7f375b None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:57.266759 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bf79c-33a6-4b21-a02d-98260c7f375b None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:57.267042 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bf79c-33a6-4b21-a02d-98260c7f375b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:57.285692 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82bf79c-33a6-4b21-a02d-98260c7f375b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:34:57.287248 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82bf79c-33a6-4b21-a02d-98260c7f375b None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:34:57.294244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882ff62-2cca-4b77-be81-0d576b0d1b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:34:57.295041 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882ff62-2cca-4b77-be81-0d576b0d1b13 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:57.295327 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882ff62-2cca-4b77-be81-0d576b0d1b13 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:57.295606 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882ff62-2cca-4b77-be81-0d576b0d1b13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:57.296806 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882ff62-2cca-4b77-be81-0d576b0d1b13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:34:57.298249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882ff62-2cca-4b77-be81-0d576b0d1b13 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:34:57.299879 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 10/18] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:34:57 2022] GET /identity/v3/domains/default => generated 200 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:34:57.306147 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882ff62-2cca-4b77-be81-0d576b0d1b13 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:34:57.311786 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-b82bf79c-33a6-4b21-a02d-98260c7f375b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:34:57.311786 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:34:57.311786 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:34:57.311786 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:34:57.311786 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:34:57.311786 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:34:57.311786 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:34:57.311786 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:34:57.311786 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:34:57.311786 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:34:57.311786 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:34:57.311786 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:34:57.311786 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:34:57.311786 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:34:57.311786 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:34:57.312770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:34:57.312770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:34:57.312770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:34:57.312770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:34:57.312770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:34:57.312770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:34:57.312770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:34:57.312770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:34:57.312770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:34:57.312770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:34:57.312770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:34:57.312770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:34:57.312770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:34:57.312770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:34:57.312770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:34:57.312770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:34:57.312770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:34:57.313596 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:34:57.313596 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:34:57.313596 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:34:57.313596 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:34:57.313596 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 9/19] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:34:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:34:57.318851 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82bf79c-33a6-4b21-a02d-98260c7f375b None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:34:57.374338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:57.386800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:57.406147 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882ff62-2cca-4b77-be81-0d576b0d1b13 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:34:57.423438 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82bf79c-33a6-4b21-a02d-98260c7f375b None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:34:57.440985 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4165d-264a-423e-b3c1-8ed0dfd94094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:34:57.442371 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4165d-264a-423e-b3c1-8ed0dfd94094 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:57.442658 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4165d-264a-423e-b3c1-8ed0dfd94094 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:57.442937 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4165d-264a-423e-b3c1-8ed0dfd94094 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:57.443773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4165d-264a-423e-b3c1-8ed0dfd94094 None admin] RBAC: Adding query filter params (role.id=07aaf007cde043318319928d151bdc75, scope.domain.id=default, user.id=558923a0ab794e4fab69165d8d72902b) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:34:57.444084 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4165d-264a-423e-b3c1-8ed0dfd94094 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:34:57.445554 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4165d-264a-423e-b3c1-8ed0dfd94094 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:34:57.452475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 11/20] 10.222.0.119 () {56 vars in 1327 bytes} [Thu Jul 14 15:34:57 2022] GET /identity/v3/role_assignments?user.id=558923a0ab794e4fab69165d8d72902b&scope.domain.id=default&role.id=07aaf007cde043318319928d151bdc75 => generated 234 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:34:57.458927 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df3771-1952-4a75-84b7-49ff3cbfb0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:34:57.459623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df3771-1952-4a75-84b7-49ff3cbfb0d0 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:57.459914 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df3771-1952-4a75-84b7-49ff3cbfb0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:57.460227 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df3771-1952-4a75-84b7-49ff3cbfb0d0 None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:57.460980 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df3771-1952-4a75-84b7-49ff3cbfb0d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:34:57.461291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df3771-1952-4a75-84b7-49ff3cbfb0d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:34:57.462743 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df3771-1952-4a75-84b7-49ff3cbfb0d0 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:34:57.483252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 10/21] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:34:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:34:59.846896 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8a4df-a27f-4433-a169-d4d3360253ae None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:59.847427 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8a4df-a27f-4433-a169-d4d3360253ae None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:59.847503 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8a4df-a27f-4433-a169-d4d3360253ae None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:59.849536 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 12/22] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:34:59 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:34:59.854945 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4df429-bb59-46fa-8e21-a9cd1b71c664 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:34:59.855745 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4df429-bb59-46fa-8e21-a9cd1b71c664 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:34:59.856287 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4df429-bb59-46fa-8e21-a9cd1b71c664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:34:59.881196 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-8e4df429-bb59-46fa-8e21-a9cd1b71c664 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:34:59.882758 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-8e4df429-bb59-46fa-8e21-a9cd1b71c664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:34:59.969094 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 11/23] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:34:59 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:00.014266 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8a4df-a27f-4433-a169-d4d3360253ae None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:00.058379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a515d7-4e8d-4d0a-851c-1f8f33c70610 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:00.059031 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a515d7-4e8d-4d0a-851c-1f8f33c70610 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:00.059622 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a515d7-4e8d-4d0a-851c-1f8f33c70610 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:00.061540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 12/24] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:00 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:00.067354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b5278-0f3a-490d-a0fa-da2681d6919b None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:00.067932 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b5278-0f3a-490d-a0fa-da2681d6919b None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:00.068433 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b5278-0f3a-490d-a0fa-da2681d6919b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:00.085971 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-3d5b5278-0f3a-490d-a0fa-da2681d6919b None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:00.087476 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-3d5b5278-0f3a-490d-a0fa-da2681d6919b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:00.140525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:00.175700 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 13/25] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 14 15:35:00.177639 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955260f-141d-4cbe-96b3-1ffbc20cb2fd None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:00.178033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955260f-141d-4cbe-96b3-1ffbc20cb2fd None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:00.178412 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955260f-141d-4cbe-96b3-1ffbc20cb2fd None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:00.187679 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 14/26] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:00 2022] GET /identity => generated 271 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:00.191301 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8a4df-a27f-4433-a169-d4d3360253ae None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:00.201655 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63883d17-3664-4764-a984-7bb7c70e3ebb None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:00.202003 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63883d17-3664-4764-a984-7bb7c70e3ebb None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:00.202299 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63883d17-3664-4764-a984-7bb7c70e3ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:00.229199 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-63883d17-3664-4764-a984-7bb7c70e3ebb None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:00.230416 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-63883d17-3664-4764-a984-7bb7c70e3ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:00.272348 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2d132-abca-4853-8dd0-4e911e43eb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:00.273152 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2d132-abca-4853-8dd0-4e911e43eb89 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:00.273438 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2d132-abca-4853-8dd0-4e911e43eb89 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:00.273721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2d132-abca-4853-8dd0-4e911e43eb89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:00.294545 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2d132-abca-4853-8dd0-4e911e43eb89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:00.305346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-5ac2d132-abca-4853-8dd0-4e911e43eb89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:35:00.305346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:00.305346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:00.305346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:00.305346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:00.305346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:00.305346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:00.305346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:00.305346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:00.305346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:00.305346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:00.305346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:00.305346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:00.305346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:00.305346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:00.305346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:00.306492 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:00.306492 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:00.306492 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:00.306492 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:00.306492 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:00.306492 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:00.306492 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:00.306492 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:00.306492 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:00.306492 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:00.306492 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:00.306492 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:00.306492 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:00.306492 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:00.306492 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:00.306492 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:00.307417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:00.307417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:00.307417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:00.307417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:00.307417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:00.307417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:00.307417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:00.307417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:00.307417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:00.307417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:00.307417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:35:00.307417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:35:00.309572 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 13/27] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:35:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:00.310538 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2d132-abca-4853-8dd0-4e911e43eb89 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:00.318943 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:00.368930 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 15/28] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:35:00.369882 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63883d17-3664-4764-a984-7bb7c70e3ebb None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:00.501106 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2d132-abca-4853-8dd0-4e911e43eb89 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:00.547908 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63883d17-3664-4764-a984-7bb7c70e3ebb None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:00.551160 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df1ad8-48b5-4153-aea4-022684454024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:00.551841 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df1ad8-48b5-4153-aea4-022684454024 None admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:00.552163 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df1ad8-48b5-4153-aea4-022684454024 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:00.552455 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df1ad8-48b5-4153-aea4-022684454024 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:00.553219 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df1ad8-48b5-4153-aea4-022684454024 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:00.554622 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df1ad8-48b5-4153-aea4-022684454024 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:00.557814 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:00.584205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df69cd-092f-4834-993a-5020e41f1994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:00.585475 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df69cd-092f-4834-993a-5020e41f1994 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:00.585956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df69cd-092f-4834-993a-5020e41f1994 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:00.586321 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df69cd-092f-4834-993a-5020e41f1994 None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:00.587172 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df69cd-092f-4834-993a-5020e41f1994 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:00.587697 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df69cd-092f-4834-993a-5020e41f1994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:00.589639 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df69cd-092f-4834-993a-5020e41f1994 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:00.611188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 16/29] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:00 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:00.611188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df69cd-092f-4834-993a-5020e41f1994 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:00.722861 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df69cd-092f-4834-993a-5020e41f1994 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:00.760319 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56ebb4-f6d2-4f90-b137-4b8bf1e2343c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:00.761191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56ebb4-f6d2-4f90-b137-4b8bf1e2343c None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:00.761691 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56ebb4-f6d2-4f90-b137-4b8bf1e2343c None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:00.762100 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56ebb4-f6d2-4f90-b137-4b8bf1e2343c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:00.773468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56ebb4-f6d2-4f90-b137-4b8bf1e2343c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:00.775085 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56ebb4-f6d2-4f90-b137-4b8bf1e2343c None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:00.795860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-bd56ebb4-f6d2-4f90-b137-4b8bf1e2343c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:35:00.795860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:00.795860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:00.795860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:00.795860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:00.795860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:00.795860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:00.795860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:00.795860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:00.795860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:00.795860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:00.795860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:00.795860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:35:00.795860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:35:00.795860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:35:00.796966 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:35:00.796966 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:00.796966 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:00.796966 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:00.796966 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:00.796966 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:00.796966 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:00.796966 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:00.796966 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:00.796966 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:00.796966 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:00.796966 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:00.796966 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:00.796966 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:00.796966 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:00.796966 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:00.796966 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:00.797992 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:35:00.797992 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:35:00.797992 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:35:00.797992 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:00.804201 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 17/30] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:35:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:00.805867 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa18899-7495-4930-9f16-714cc1d61df8 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:00.806337 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa18899-7495-4930-9f16-714cc1d61df8 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:00.806694 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa18899-7495-4930-9f16-714cc1d61df8 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:00.808158 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 18/31] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:00.809026 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa18899-7495-4930-9f16-714cc1d61df8 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:00.809785 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 14/32] 10.222.0.119 () {60 vars in 1136 bytes} [Thu Jul 14 15:35:00 2022] POST /identity/v3/roles => generated 220 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:35:00.811230 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df1ad8-48b5-4153-aea4-022684454024 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:00.844257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:00.918845 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:00.979222 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df1ad8-48b5-4153-aea4-022684454024 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:01.033558 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa18899-7495-4930-9f16-714cc1d61df8 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:01.041518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a67dd6-5020-43ee-8a7b-86d559a96600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:01.042215 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a67dd6-5020-43ee-8a7b-86d559a96600 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:01.042510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a67dd6-5020-43ee-8a7b-86d559a96600 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:01.042786 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a67dd6-5020-43ee-8a7b-86d559a96600 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:01.043542 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a67dd6-5020-43ee-8a7b-86d559a96600 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:01.043853 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a67dd6-5020-43ee-8a7b-86d559a96600 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:01.045460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a67dd6-5020-43ee-8a7b-86d559a96600 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:01.069344 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 15/33] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:35:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:01.070537 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3d45a-63d8-4123-a191-71d8579bd35c None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:01.070837 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3d45a-63d8-4123-a191-71d8579bd35c None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:01.071404 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3d45a-63d8-4123-a191-71d8579bd35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:01.079755 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3787f-ea1c-4747-9949-6b4550529dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:01.081027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3787f-ea1c-4747-9949-6b4550529dff None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:01.081522 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3787f-ea1c-4747-9949-6b4550529dff None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:01.081992 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3787f-ea1c-4747-9949-6b4550529dff None admin] PATH_INFO: `/v3/users/558923a0ab794e4fab69165d8d72902b` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:01.084368 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3787f-ea1c-4747-9949-6b4550529dff None admin] RBAC: Authorizing `identity:get_user(user_id=558923a0ab794e4fab69165d8d72902b)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:01.086049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3787f-ea1c-4747-9949-6b4550529dff None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:01.087912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 19/34] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:00 2022] GET /identity/v3/users/558923a0ab794e4fab69165d8d72902b => generated 248 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:01.089835 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3787f-ea1c-4747-9949-6b4550529dff None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:01.100178 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-b7e3d45a-63d8-4123-a191-71d8579bd35c None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:01.101358 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-b7e3d45a-63d8-4123-a191-71d8579bd35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:01.198628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:01.202516 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 16/35] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:01.203583 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3d45a-63d8-4123-a191-71d8579bd35c None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:01.212113 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3787f-ea1c-4747-9949-6b4550529dff None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:01.254765 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e37bb3-ce2d-4de7-a4eb-9e46d1dbf2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:01.255451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37bb3-ce2d-4de7-a4eb-9e46d1dbf2a9 None admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:01.255741 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37bb3-ce2d-4de7-a4eb-9e46d1dbf2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:01.256021 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37bb3-ce2d-4de7-a4eb-9e46d1dbf2a9 None admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:01.256801 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e37bb3-ce2d-4de7-a4eb-9e46d1dbf2a9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:01.258384 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e37bb3-ce2d-4de7-a4eb-9e46d1dbf2a9 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:01.279712 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:01.330005 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3d45a-63d8-4123-a191-71d8579bd35c None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:01.371074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfe040-a78b-4a52-8b1c-d465a7f283a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:01.371924 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfe040-a78b-4a52-8b1c-d465a7f283a7 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:01.372242 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfe040-a78b-4a52-8b1c-d465a7f283a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:01.372522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfe040-a78b-4a52-8b1c-d465a7f283a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:01.373759 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfe040-a78b-4a52-8b1c-d465a7f283a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:01.375347 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfe040-a78b-4a52-8b1c-d465a7f283a7 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:01.376995 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 17/36] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:35:01 2022] GET /identity/v3/domains/default => generated 200 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:01.377796 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfe040-a78b-4a52-8b1c-d465a7f283a7 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:01.487583 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfe040-a78b-4a52-8b1c-d465a7f283a7 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:01.504604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 20/37] 10.222.0.119 () {60 vars in 1146 bytes} [Thu Jul 14 15:35:01 2022] POST /identity/v3/projects => generated 302 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:35:01.504604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e37bb3-ce2d-4de7-a4eb-9e46d1dbf2a9 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:01.536324 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:01.549994 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b677a-45d8-4ae0-b902-2d3356ac6596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:01.551036 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b677a-45d8-4ae0-b902-2d3356ac6596 None admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:01.551641 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b677a-45d8-4ae0-b902-2d3356ac6596 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:01.552140 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b677a-45d8-4ae0-b902-2d3356ac6596 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:01.553214 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b677a-45d8-4ae0-b902-2d3356ac6596 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:01.554982 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b677a-45d8-4ae0-b902-2d3356ac6596 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:01.633650 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 18/38] 10.222.0.119 () {60 vars in 1136 bytes} [Thu Jul 14 15:35:01 2022] POST /identity/v3/roles => generated 226 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:35:01.634780 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560b35f-0b62-4e34-98b2-fa7f273a7dbe None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:01.635082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560b35f-0b62-4e34-98b2-fa7f273a7dbe None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:01.635377 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560b35f-0b62-4e34-98b2-fa7f273a7dbe None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:01.637010 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 19/39] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:01.638161 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8ba13-f947-4e45-a40f-2a1890d64b60 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:01.638517 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8ba13-f947-4e45-a40f-2a1890d64b60 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:01.646467 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8ba13-f947-4e45-a40f-2a1890d64b60 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:01.646467 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 20/40] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:01 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:01.646682 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e37bb3-ce2d-4de7-a4eb-9e46d1dbf2a9 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:01.647582 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515abfa-69c1-410c-bac2-170b3e4461a4 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:01.647885 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515abfa-69c1-410c-bac2-170b3e4461a4 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:01.648231 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515abfa-69c1-410c-bac2-170b3e4461a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:01.670759 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-4515abfa-69c1-410c-bac2-170b3e4461a4 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:01.672196 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-4515abfa-69c1-410c-bac2-170b3e4461a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:01.696800 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53810aab-f019-431e-86e4-678d3332fb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:01.698120 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53810aab-f019-431e-86e4-678d3332fb83 None admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:01.698423 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53810aab-f019-431e-86e4-678d3332fb83 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:01.698712 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53810aab-f019-431e-86e4-678d3332fb83 None admin] PATH_INFO: `/v3/domains/default/users/558923a0ab794e4fab69165d8d72902b/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:01.702245 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53810aab-f019-431e-86e4-678d3332fb83 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=558923a0ab794e4fab69165d8d72902b, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:01.704555 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53810aab-f019-431e-86e4-678d3332fb83 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:01.763522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 21/41] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:01.766927 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bee47-fc86-4f81-b540-f58ea48c09aa None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:01.766927 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bee47-fc86-4f81-b540-f58ea48c09aa None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:01.766927 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bee47-fc86-4f81-b540-f58ea48c09aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:01.784701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-372bee47-fc86-4f81-b540-f58ea48c09aa None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:01.786751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-372bee47-fc86-4f81-b540-f58ea48c09aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:01.800402 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:01.804797 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 21/42] 10.222.0.119 () {58 vars in 1366 bytes} [Thu Jul 14 15:35:01 2022] PUT /identity/v3/domains/default/users/558923a0ab794e4fab69165d8d72902b/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:35:01.806824 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53810aab-f019-431e-86e4-678d3332fb83 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:01.883901 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 22/43] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:01.908182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bee47-fc86-4f81-b540-f58ea48c09aa None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:01.940399 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53810aab-f019-431e-86e4-678d3332fb83 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:01.985591 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa4c96-ba49-432d-b0d7-4aaa9713dcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:01.985954 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa4c96-ba49-432d-b0d7-4aaa9713dcc9 None admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:01.986830 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa4c96-ba49-432d-b0d7-4aaa9713dcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:01.986830 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa4c96-ba49-432d-b0d7-4aaa9713dcc9 None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:01.987302 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa4c96-ba49-432d-b0d7-4aaa9713dcc9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:01.989884 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa4c96-ba49-432d-b0d7-4aaa9713dcc9 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:02.056639 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 22/44] 10.222.0.119 () {60 vars in 1136 bytes} [Thu Jul 14 15:35:01 2022] POST /identity/v3/roles => generated 224 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:35:02.068082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:02.134002 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bee47-fc86-4f81-b540-f58ea48c09aa None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:02.172667 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf914f-d67e-4687-8cb7-4ea908dc228d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:02.173851 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf914f-d67e-4687-8cb7-4ea908dc228d None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:02.174339 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf914f-d67e-4687-8cb7-4ea908dc228d None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:02.174812 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf914f-d67e-4687-8cb7-4ea908dc228d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:02.176533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf914f-d67e-4687-8cb7-4ea908dc228d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:02.178535 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf914f-d67e-4687-8cb7-4ea908dc228d None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:02.180728 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 23/45] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:35:01 2022] GET /identity/v3/domains/default => generated 200 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:02.187007 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa4c96-ba49-432d-b0d7-4aaa9713dcc9 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:02.255525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:02.299208 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa4c96-ba49-432d-b0d7-4aaa9713dcc9 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:02.333988 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc7dc9-932d-4110-944b-94885ee558a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:02.334650 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc7dc9-932d-4110-944b-94885ee558a4 None admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:02.334944 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc7dc9-932d-4110-944b-94885ee558a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:02.335232 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc7dc9-932d-4110-944b-94885ee558a4 None admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:02.335958 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc7dc9-932d-4110-944b-94885ee558a4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:02.337453 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc7dc9-932d-4110-944b-94885ee558a4 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:02.416542 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 23/46] 10.222.0.119 () {60 vars in 1146 bytes} [Thu Jul 14 15:35:02 2022] POST /identity/v3/projects => generated 313 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:35:03.880501 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9ee38-8c74-46ba-8d35-66df5b1e6cc5 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:03.881021 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9ee38-8c74-46ba-8d35-66df5b1e6cc5 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:03.881137 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9ee38-8c74-46ba-8d35-66df5b1e6cc5 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:03.882446 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 24/47] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:03 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:03.887664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c15f63-6b9d-410c-8bcf-91f532c11a2c None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:03.888084 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c15f63-6b9d-410c-8bcf-91f532c11a2c None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:03.888271 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c15f63-6b9d-410c-8bcf-91f532c11a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:03.906189 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-59c15f63-6b9d-410c-8bcf-91f532c11a2c None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:03.907729 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-59c15f63-6b9d-410c-8bcf-91f532c11a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:03.975701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 24/48] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:35:03.999373 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9ee38-8c74-46ba-8d35-66df5b1e6cc5 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:04.104724 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9ee38-8c74-46ba-8d35-66df5b1e6cc5 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:04.115830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:04.140667 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e5877-bd09-474a-b669-3e0ea158c37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:04.141396 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e5877-bd09-474a-b669-3e0ea158c37f None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:04.141685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e5877-bd09-474a-b669-3e0ea158c37f None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:04.141972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e5877-bd09-474a-b669-3e0ea158c37f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:04.152848 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e5877-bd09-474a-b669-3e0ea158c37f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:04.161649 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-808e5877-bd09-474a-b669-3e0ea158c37f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:35:04.161649 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:04.161649 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:04.161649 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:04.161649 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:04.161649 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:04.161649 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:04.161649 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:04.161649 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:04.161649 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:04.161649 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:04.161649 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:04.161649 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:04.161649 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:04.161649 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:04.161649 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:04.162480 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:04.162480 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:04.162480 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:04.162480 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:04.162480 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:04.162480 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:04.162480 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:04.162480 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:04.162480 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:04.162480 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:04.162480 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:04.162480 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:04.162480 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:04.162480 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:04.162480 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:04.162480 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:04.163425 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:04.163425 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:04.163425 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:04.163425 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:04.163425 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:04.163425 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:04.163425 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:04.163425 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:04.163425 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:04.163425 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:04.163425 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:35:04.163425 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:35:04.163425 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 25/49] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:35:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:04.168889 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c15f63-6b9d-410c-8bcf-91f532c11a2c None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:04.210836 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:04.265695 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c15f63-6b9d-410c-8bcf-91f532c11a2c None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:04.299233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aae6b4-413b-4dc2-bf48-f19216011891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:04.299899 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aae6b4-413b-4dc2-bf48-f19216011891 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:04.300227 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aae6b4-413b-4dc2-bf48-f19216011891 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:04.300512 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aae6b4-413b-4dc2-bf48-f19216011891 None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:04.301805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aae6b4-413b-4dc2-bf48-f19216011891 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:04.302200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aae6b4-413b-4dc2-bf48-f19216011891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:04.303599 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aae6b4-413b-4dc2-bf48-f19216011891 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:04.311984 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 25/50] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:04 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:04.318247 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e5877-bd09-474a-b669-3e0ea158c37f None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:04.423155 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e5877-bd09-474a-b669-3e0ea158c37f None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:04.456492 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6baa0c9-df9f-4567-9ff8-bc3e0c46e61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:04.457698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baa0c9-df9f-4567-9ff8-bc3e0c46e61e None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:04.457878 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baa0c9-df9f-4567-9ff8-bc3e0c46e61e None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:04.458140 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baa0c9-df9f-4567-9ff8-bc3e0c46e61e None admin] PATH_INFO: `/v3/users/558923a0ab794e4fab69165d8d72902b` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:04.459340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6baa0c9-df9f-4567-9ff8-bc3e0c46e61e None admin] RBAC: Authorizing `identity:get_user(user_id=558923a0ab794e4fab69165d8d72902b)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:04.460822 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6baa0c9-df9f-4567-9ff8-bc3e0c46e61e None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:04.462448 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 26/51] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:04 2022] GET /identity/v3/users/558923a0ab794e4fab69165d8d72902b => generated 248 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:04.468073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aae6b4-413b-4dc2-bf48-f19216011891 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:04.491356 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53efb3a-ea4b-4492-b54f-5bf2093944cc None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:04.491660 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53efb3a-ea4b-4492-b54f-5bf2093944cc None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:04.491949 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53efb3a-ea4b-4492-b54f-5bf2093944cc None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:04.493390 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 27/52] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:35:04.498155 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25680cb1-f170-45cc-8b97-e583581f7423 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:04.498450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25680cb1-f170-45cc-8b97-e583581f7423 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:04.498742 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25680cb1-f170-45cc-8b97-e583581f7423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:04.515514 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-25680cb1-f170-45cc-8b97-e583581f7423 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:04.516761 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-25680cb1-f170-45cc-8b97-e583581f7423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:04.547444 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:04.590713 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 28/53] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:04 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:35:04.616036 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25680cb1-f170-45cc-8b97-e583581f7423 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:04.681509 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aae6b4-413b-4dc2-bf48-f19216011891 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:04.683703 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:04.715281 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c9e04-fc1e-4a90-a19d-6c380847a4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:04.716343 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c9e04-fc1e-4a90-a19d-6c380847a4f4 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:04.716943 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c9e04-fc1e-4a90-a19d-6c380847a4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:04.717230 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c9e04-fc1e-4a90-a19d-6c380847a4f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:04.718420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c9e04-fc1e-4a90-a19d-6c380847a4f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:04.719876 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c9e04-fc1e-4a90-a19d-6c380847a4f4 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:04.721406 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25680cb1-f170-45cc-8b97-e583581f7423 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:04.721524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 26/54] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:35:04 2022] GET /identity/v3/domains/default => generated 200 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:04.727751 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c9e04-fc1e-4a90-a19d-6c380847a4f4 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:04.757104 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60628db-9fb2-4f60-9a76-f27b29b43208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:04.757912 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60628db-9fb2-4f60-9a76-f27b29b43208 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:04.758208 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60628db-9fb2-4f60-9a76-f27b29b43208 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:04.758495 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60628db-9fb2-4f60-9a76-f27b29b43208 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:04.759697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60628db-9fb2-4f60-9a76-f27b29b43208 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:04.761220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60628db-9fb2-4f60-9a76-f27b29b43208 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:04.762859 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 29/55] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:35:04 2022] GET /identity/v3/domains/default => generated 200 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:04.768436 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60628db-9fb2-4f60-9a76-f27b29b43208 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:04.804301 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:04.825552 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c9e04-fc1e-4a90-a19d-6c380847a4f4 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:04.860574 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf1696-e869-46d2-b12f-b3344b086ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:04.861238 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf1696-e869-46d2-b12f-b3344b086ff7 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:04.861526 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf1696-e869-46d2-b12f-b3344b086ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:04.861806 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf1696-e869-46d2-b12f-b3344b086ff7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:04.862642 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf1696-e869-46d2-b12f-b3344b086ff7 None admin] RBAC: Adding query filter params (role.id=07aaf007cde043318319928d151bdc75, scope.domain.id=default, user.id=558923a0ab794e4fab69165d8d72902b) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:04.862956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf1696-e869-46d2-b12f-b3344b086ff7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:04.865046 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf1696-e869-46d2-b12f-b3344b086ff7 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:04.870923 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60628db-9fb2-4f60-9a76-f27b29b43208 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:04.873216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 27/56] 10.222.0.119 () {56 vars in 1327 bytes} [Thu Jul 14 15:35:04 2022] GET /identity/v3/role_assignments?user.id=558923a0ab794e4fab69165d8d72902b&scope.domain.id=default&role.id=07aaf007cde043318319928d151bdc75 => generated 532 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:04.909132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a708c23-3107-4600-a010-c229874a2b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:04.909824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a708c23-3107-4600-a010-c229874a2b9d None admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:04.910116 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a708c23-3107-4600-a010-c229874a2b9d None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:04.910402 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a708c23-3107-4600-a010-c229874a2b9d None admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:04.911297 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a708c23-3107-4600-a010-c229874a2b9d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:04.912894 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a708c23-3107-4600-a010-c229874a2b9d None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:05.020232 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 30/57] 10.222.0.119 () {60 vars in 1145 bytes} [Thu Jul 14 15:35:04 2022] POST /identity/v3/projects => generated 299 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:35:07.078700 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488576cb-71a0-4463-9dd8-8850d72aa43b None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:07.079264 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488576cb-71a0-4463-9dd8-8850d72aa43b None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:07.079264 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488576cb-71a0-4463-9dd8-8850d72aa43b None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:07.080693 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 28/58] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:07.085890 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09399cf-6c8a-42d1-ade3-10b2560c153a None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:07.086314 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09399cf-6c8a-42d1-ade3-10b2560c153a None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:07.086465 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09399cf-6c8a-42d1-ade3-10b2560c153a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:07.103363 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-f09399cf-6c8a-42d1-ade3-10b2560c153a None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:07.104608 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f09399cf-6c8a-42d1-ade3-10b2560c153a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:07.169150 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 31/59] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:07.194271 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488576cb-71a0-4463-9dd8-8850d72aa43b None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:07.230457 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:07.299013 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488576cb-71a0-4463-9dd8-8850d72aa43b None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:07.333174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a04abe-4cfd-4ee7-9dad-6834e91fd336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:07.333901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a04abe-4cfd-4ee7-9dad-6834e91fd336 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:07.334189 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a04abe-4cfd-4ee7-9dad-6834e91fd336 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:07.334469 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a04abe-4cfd-4ee7-9dad-6834e91fd336 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:07.335640 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a04abe-4cfd-4ee7-9dad-6834e91fd336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:07.337124 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a04abe-4cfd-4ee7-9dad-6834e91fd336 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:07.338742 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 29/60] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:35:07 2022] GET /identity/v3/domains/default => generated 200 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:07.344517 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09399cf-6c8a-42d1-ade3-10b2560c153a None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:07.362944 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:07.444212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09399cf-6c8a-42d1-ade3-10b2560c153a None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:07.477912 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d8ea6-2af9-4396-88d8-1fb16d21d1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:07.478582 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d8ea6-2af9-4396-88d8-1fb16d21d1a5 None admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:07.478870 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d8ea6-2af9-4396-88d8-1fb16d21d1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:07.479150 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d8ea6-2af9-4396-88d8-1fb16d21d1a5 None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:07.479867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d8ea6-2af9-4396-88d8-1fb16d21d1a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:07.481356 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d8ea6-2af9-4396-88d8-1fb16d21d1a5 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:07.578633 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 32/61] 10.222.0.119 () {60 vars in 1137 bytes} [Thu Jul 14 15:35:07 2022] POST /identity/v3/users => generated 276 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:35:10.848468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce272622-10b5-46de-8a6c-b1d1d403423e None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:10.849478 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce272622-10b5-46de-8a6c-b1d1d403423e None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:10.850000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce272622-10b5-46de-8a6c-b1d1d403423e None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:10.851598 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 30/62] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:10 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:10.857176 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faaa411-de29-40f0-8925-fa5cfe2bce27 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:10.857604 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faaa411-de29-40f0-8925-fa5cfe2bce27 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:10.857750 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faaa411-de29-40f0-8925-fa5cfe2bce27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:10.881152 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-4faaa411-de29-40f0-8925-fa5cfe2bce27 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:10.882598 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-4faaa411-de29-40f0-8925-fa5cfe2bce27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:10.906173 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba4a24-7a82-49b6-8b69-e6d096ef398d None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:10.906938 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba4a24-7a82-49b6-8b69-e6d096ef398d None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:10.907436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba4a24-7a82-49b6-8b69-e6d096ef398d None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:10.909066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 31/63] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:10 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:35:10.914697 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3939eb-e3d7-4c5e-954b-a6da03f8b6ae None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:10.915278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3939eb-e3d7-4c5e-954b-a6da03f8b6ae None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:10.915753 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3939eb-e3d7-4c5e-954b-a6da03f8b6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:10.953585 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-0c3939eb-e3d7-4c5e-954b-a6da03f8b6ae None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:10.955141 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-0c3939eb-e3d7-4c5e-954b-a6da03f8b6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:10.986612 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 33/64] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:10.988461 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9a04c-22bd-44d0-9eda-386ebf5f6e04 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:10.989972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9a04c-22bd-44d0-9eda-386ebf5f6e04 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:10.990419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9a04c-22bd-44d0-9eda-386ebf5f6e04 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:10.992161 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 34/65] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:10 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:10.997904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf7414-697b-4535-bdc2-47613f6f4d05 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:10.998542 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf7414-697b-4535-bdc2-47613f6f4d05 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:10.998978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf7414-697b-4535-bdc2-47613f6f4d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:11.007067 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:11.018510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-8bcf7414-697b-4535-bdc2-47613f6f4d05 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:11.020691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-8bcf7414-697b-4535-bdc2-47613f6f4d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:11.042485 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 32/66] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 14 15:35:11.043492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3939eb-e3d7-4c5e-954b-a6da03f8b6ae None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:11.092174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:11.110572 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 35/67] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:35:11.111614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf7414-697b-4535-bdc2-47613f6f4d05 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:11.161737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3939eb-e3d7-4c5e-954b-a6da03f8b6ae None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:11.197853 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277a350-8662-454f-9505-a71bc7b8064e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:11.198890 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277a350-8662-454f-9505-a71bc7b8064e None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:11.199322 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277a350-8662-454f-9505-a71bc7b8064e None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:11.199740 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277a350-8662-454f-9505-a71bc7b8064e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:11.212573 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1277a350-8662-454f-9505-a71bc7b8064e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:11.221710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf7414-697b-4535-bdc2-47613f6f4d05 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:11.222303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-1277a350-8662-454f-9505-a71bc7b8064e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:35:11.222303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:11.222303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:11.222303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:11.222303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:11.222303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:11.222303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:11.222303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:11.222303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:11.222303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:11.222303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:11.222303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:11.222303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:11.222303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:11.222303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:11.222303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:11.223830 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:11.223830 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:11.223830 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:11.223830 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:11.223830 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:11.223830 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:11.223830 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:11.223830 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:11.223830 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:11.223830 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:11.223830 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:11.223830 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:11.223830 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:11.223830 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:11.223830 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:11.223830 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:11.224795 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:11.224795 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:11.224795 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:11.224795 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:11.224795 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:11.224795 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:11.224795 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:11.224795 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:11.224795 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:11.224795 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:11.224795 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:35:11.224795 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:11.226695 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 33/68] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:35:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:11.232295 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277a350-8662-454f-9505-a71bc7b8064e None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:11.260521 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a6a0b-8b8c-4acb-a8f8-b490e530d6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:11.261344 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a6a0b-8b8c-4acb-a8f8-b490e530d6f5 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:11.261632 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a6a0b-8b8c-4acb-a8f8-b490e530d6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:11.262075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a6a0b-8b8c-4acb-a8f8-b490e530d6f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:11.264299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:11.274738 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a6a0b-8b8c-4acb-a8f8-b490e530d6f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:11.284999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-8f0a6a0b-8b8c-4acb-a8f8-b490e530d6f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:35:11.284999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:11.284999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:11.284999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:11.284999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:11.284999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:11.284999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:11.284999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:11.284999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:11.284999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:11.284999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:11.284999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:11.284999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:11.284999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:11.284999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:11.284999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:11.286605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:11.286605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:11.286605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:11.286605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:11.286605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:11.286605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:11.286605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:11.286605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:11.286605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:11.286605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:11.286605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:11.286605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:11.286605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:11.286605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:11.286605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:11.286605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:11.287359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:11.287359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:11.287359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:11.287359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:11.287359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:11.287359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:11.287359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:11.287359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:11.287359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:11.287359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:11.287359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:35:11.287359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:35:11.289722 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 36/69] 10.222.0.119 () {56 vars in 1119 bytes} [Thu Jul 14 15:35:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:11.290718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a6a0b-8b8c-4acb-a8f8-b490e530d6f5 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:11.341869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:11.348856 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277a350-8662-454f-9505-a71bc7b8064e None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:11.384837 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a41d4e-6b4d-497f-90ad-c088d73ca7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:11.385882 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a41d4e-6b4d-497f-90ad-c088d73ca7c1 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:11.386319 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a41d4e-6b4d-497f-90ad-c088d73ca7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:11.386752 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a41d4e-6b4d-497f-90ad-c088d73ca7c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:11.398167 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a41d4e-6b4d-497f-90ad-c088d73ca7c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:11.404279 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a6a0b-8b8c-4acb-a8f8-b490e530d6f5 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:11.406664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-47a41d4e-6b4d-497f-90ad-c088d73ca7c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:11.406664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:11.406664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:11.406664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:11.406664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:11.406664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:11.406664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:11.406664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:11.406664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:11.406664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:11.406664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:11.406664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:11.406664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:11.406664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:11.406664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:11.406664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:11.407494 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:11.407494 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:11.407494 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:11.407494 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:11.407494 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:11.407494 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:11.407494 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:11.407494 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:11.407494 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:11.407494 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:11.407494 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:11.407494 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:11.407494 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:11.407494 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:11.407494 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:11.407494 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:11.408365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:11.408365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:11.408365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:11.408365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:11.408365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:11.408365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:11.408365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:11.408365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:11.408365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:11.408365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:11.408365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:11.408365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:11.408365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 34/70] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:11.409078 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a41d4e-6b4d-497f-90ad-c088d73ca7c1 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:11.443744 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121617f0-9a36-442b-9d98-dfb4be3ec8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:11.444455 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121617f0-9a36-442b-9d98-dfb4be3ec8d7 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:11.444751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121617f0-9a36-442b-9d98-dfb4be3ec8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:11.445044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121617f0-9a36-442b-9d98-dfb4be3ec8d7 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:11.445806 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121617f0-9a36-442b-9d98-dfb4be3ec8d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:11.446120 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121617f0-9a36-442b-9d98-dfb4be3ec8d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:11.447536 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121617f0-9a36-442b-9d98-dfb4be3ec8d7 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:11.455750 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 37/71] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:11 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:11.457082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe25de-c0c4-4fcb-a5a0-21d4fd5cdf86 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:11.457387 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe25de-c0c4-4fcb-a5a0-21d4fd5cdf86 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:11.457713 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe25de-c0c4-4fcb-a5a0-21d4fd5cdf86 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:11.459285 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 38/72] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:11.463945 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe25de-c0c4-4fcb-a5a0-21d4fd5cdf86 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:11.511568 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a41d4e-6b4d-497f-90ad-c088d73ca7c1 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:11.524531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:11.545566 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88472c-5993-417f-85e7-56a346502f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:11.546250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88472c-5993-417f-85e7-56a346502f19 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:11.546539 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88472c-5993-417f-85e7-56a346502f19 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:11.546824 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88472c-5993-417f-85e7-56a346502f19 None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:11.547580 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88472c-5993-417f-85e7-56a346502f19 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:11.547898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88472c-5993-417f-85e7-56a346502f19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:11.549332 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88472c-5993-417f-85e7-56a346502f19 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:11.557843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 35/73] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:35:11 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:11.559146 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7461e24-353a-4520-9f4a-d29f85bcb602 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:11.559504 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7461e24-353a-4520-9f4a-d29f85bcb602 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:11.559796 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7461e24-353a-4520-9f4a-d29f85bcb602 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:11.561075 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 36/74] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:11.561779 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7461e24-353a-4520-9f4a-d29f85bcb602 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:11.575156 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe25de-c0c4-4fcb-a5a0-21d4fd5cdf86 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:11.581299 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:11.608748 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba57f14-3615-4549-be3d-a7e711b4a27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:11.609420 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba57f14-3615-4549-be3d-a7e711b4a27b None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:11.609709 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba57f14-3615-4549-be3d-a7e711b4a27b None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:11.609993 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba57f14-3615-4549-be3d-a7e711b4a27b None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:11.610745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba57f14-3615-4549-be3d-a7e711b4a27b None admin] RBAC: Adding query filter params (name=member) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:11.611059 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba57f14-3615-4549-be3d-a7e711b4a27b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:11.612481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba57f14-3615-4549-be3d-a7e711b4a27b None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:11.625459 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 39/75] 10.222.0.119 () {56 vars in 1106 bytes} [Thu Jul 14 15:35:11 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:11.625459 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec3efa-7c7f-4169-8ea7-c4da9da1571e None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:11.625459 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec3efa-7c7f-4169-8ea7-c4da9da1571e None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:11.625459 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec3efa-7c7f-4169-8ea7-c4da9da1571e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:11.639040 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-34ec3efa-7c7f-4169-8ea7-c4da9da1571e None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:11.640201 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-34ec3efa-7c7f-4169-8ea7-c4da9da1571e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:11.666184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7461e24-353a-4520-9f4a-d29f85bcb602 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:11.700828 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff147b-8154-43e4-a5cb-ffaf6c6a440b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:11.701711 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff147b-8154-43e4-a5cb-ffaf6c6a440b None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:11.702005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff147b-8154-43e4-a5cb-ffaf6c6a440b None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:11.702288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff147b-8154-43e4-a5cb-ffaf6c6a440b None admin] PATH_INFO: `/v3/users/558923a0ab794e4fab69165d8d72902b` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:11.703488 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff147b-8154-43e4-a5cb-ffaf6c6a440b None admin] RBAC: Authorizing `identity:get_user(user_id=558923a0ab794e4fab69165d8d72902b)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:11.704961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff147b-8154-43e4-a5cb-ffaf6c6a440b None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:11.706108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 40/76] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:11 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:11.711420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 37/77] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:11 2022] GET /identity/v3/users/558923a0ab794e4fab69165d8d72902b => generated 248 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:11.711554 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec3efa-7c7f-4169-8ea7-c4da9da1571e None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:11.711642 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9db6f-bdb6-432d-a903-b3ea831f4c5d None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:11.711642 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9db6f-bdb6-432d-a903-b3ea831f4c5d None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:11.711642 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9db6f-bdb6-432d-a903-b3ea831f4c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:11.725103 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-a3c9db6f-bdb6-432d-a903-b3ea831f4c5d None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:11.726304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-a3c9db6f-bdb6-432d-a903-b3ea831f4c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:11.766624 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:11.799647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 38/78] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:11 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:11.800520 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9db6f-bdb6-432d-a903-b3ea831f4c5d None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:11.815338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:11.841423 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec3efa-7c7f-4169-8ea7-c4da9da1571e None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:11.876749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0bdf4-7723-4536-a703-9f79b8faa428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:11.877626 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0bdf4-7723-4536-a703-9f79b8faa428 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:11.877922 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0bdf4-7723-4536-a703-9f79b8faa428 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:11.878262 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0bdf4-7723-4536-a703-9f79b8faa428 None admin] PATH_INFO: `/v3/users/cdfa06df351a47d0a2012673e01f5556` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:11.891528 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0bdf4-7723-4536-a703-9f79b8faa428 None admin] RBAC: Authorizing `identity:get_user(user_id=cdfa06df351a47d0a2012673e01f5556)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:11.892962 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0bdf4-7723-4536-a703-9f79b8faa428 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:11.894645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 41/79] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:11 2022] GET /identity/v3/users/cdfa06df351a47d0a2012673e01f5556 => generated 276 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:11.895886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0bdf4-7723-4536-a703-9f79b8faa428 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:11.901107 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9db6f-bdb6-432d-a903-b3ea831f4c5d None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:11.936075 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9f6ae-bd52-484b-be13-c52c74e9b467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:11.936995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9f6ae-bd52-484b-be13-c52c74e9b467 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:11.937288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9f6ae-bd52-484b-be13-c52c74e9b467 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:11.937571 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9f6ae-bd52-484b-be13-c52c74e9b467 None admin] PATH_INFO: `/v3/users/cdfa06df351a47d0a2012673e01f5556` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:11.938788 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9f6ae-bd52-484b-be13-c52c74e9b467 None admin] RBAC: Authorizing `identity:get_user(user_id=cdfa06df351a47d0a2012673e01f5556)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:11.940289 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9f6ae-bd52-484b-be13-c52c74e9b467 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:11.942161 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 39/80] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:11 2022] GET /identity/v3/users/cdfa06df351a47d0a2012673e01f5556 => generated 276 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:11.942868 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9f6ae-bd52-484b-be13-c52c74e9b467 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:11.998359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0bdf4-7723-4536-a703-9f79b8faa428 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:12.006221 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:12.023958 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:12.033002 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f5e1e-c725-45ef-8766-e74eb8331cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:12.033669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f5e1e-c725-45ef-8766-e74eb8331cb0 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:12.033993 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f5e1e-c725-45ef-8766-e74eb8331cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:12.034283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f5e1e-c725-45ef-8766-e74eb8331cb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:12.042309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9f6ae-bd52-484b-be13-c52c74e9b467 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:12.075975 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3722c3-5f89-4b63-a2d4-edcb4463c594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:12.076887 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3722c3-5f89-4b63-a2d4-edcb4463c594 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:12.077178 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3722c3-5f89-4b63-a2d4-edcb4463c594 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:12.077472 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3722c3-5f89-4b63-a2d4-edcb4463c594 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:12.078667 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3722c3-5f89-4b63-a2d4-edcb4463c594 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:12.080204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3722c3-5f89-4b63-a2d4-edcb4463c594 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:12.086290 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 40/81] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:35:11 2022] GET /identity/v3/domains/default => generated 200 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:12.086979 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3722c3-5f89-4b63-a2d4-edcb4463c594 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:12.102485 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f5e1e-c725-45ef-8766-e74eb8331cb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:12.104001 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f5e1e-c725-45ef-8766-e74eb8331cb0 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:12.186260 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3722c3-5f89-4b63-a2d4-edcb4463c594 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:12.203251 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 42/82] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:35:11 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:12.204157 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f5e1e-c725-45ef-8766-e74eb8331cb0 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:12.215253 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:12.221012 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aaebe0-1253-4e0b-86eb-7a59e493ec23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:12.221887 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaebe0-1253-4e0b-86eb-7a59e493ec23 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:12.222187 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaebe0-1253-4e0b-86eb-7a59e493ec23 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:12.222471 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaebe0-1253-4e0b-86eb-7a59e493ec23 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:12.233287 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aaebe0-1253-4e0b-86eb-7a59e493ec23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:12.242017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-44aaebe0-1253-4e0b-86eb-7a59e493ec23 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:12.242017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:12.242017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:12.242017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:12.242017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:12.242017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:12.242017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:12.242017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:12.242017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:12.242017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:12.242017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:12.242017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:12.242017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:12.242017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:12.242017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:12.242017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:12.243027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:12.243027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:12.243027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:12.243027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:12.243027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:12.243027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:12.243027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:12.243027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:12.243027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:12.243027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:12.243027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:12.243027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:12.243027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:12.243027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:12.243027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:12.243027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:12.244037 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:12.244037 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:12.244037 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:12.244037 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:12.244037 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:12.244037 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:12.244037 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:12.244037 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:12.244037 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:12.244037 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:12.244037 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:12.244037 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:12.244037 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 41/83] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:12.244037 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aaebe0-1253-4e0b-86eb-7a59e493ec23 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:12.260150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:12.307032 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f5e1e-c725-45ef-8766-e74eb8331cb0 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:12.342369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c65b79-5560-4a9e-8751-1f7f4afb0b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:12.343111 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c65b79-5560-4a9e-8751-1f7f4afb0b9b None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:12.343411 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c65b79-5560-4a9e-8751-1f7f4afb0b9b None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:12.343699 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c65b79-5560-4a9e-8751-1f7f4afb0b9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:12.351289 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aaebe0-1253-4e0b-86eb-7a59e493ec23 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:12.385053 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b3e78-863d-4956-a122-333c12a877df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:12.385709 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b3e78-863d-4956-a122-333c12a877df None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:12.386002 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b3e78-863d-4956-a122-333c12a877df None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:12.386287 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b3e78-863d-4956-a122-333c12a877df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:12.416154 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c65b79-5560-4a9e-8751-1f7f4afb0b9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:12.417970 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c65b79-5560-4a9e-8751-1f7f4afb0b9b None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:12.426149 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:12.455057 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b3e78-863d-4956-a122-333c12a877df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:12.456552 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b3e78-863d-4956-a122-333c12a877df None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:12.468282 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:12.518908 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 43/84] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:35:12 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:12.519745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c65b79-5560-4a9e-8751-1f7f4afb0b9b None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:12.561277 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 42/85] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:35:12 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:12.561977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b3e78-863d-4956-a122-333c12a877df None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:12.622975 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c65b79-5560-4a9e-8751-1f7f4afb0b9b None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:12.630774 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:12.658340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aaa5a3-324a-475d-8628-0933b706c795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:12.659020 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aaa5a3-324a-475d-8628-0933b706c795 None admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:12.659316 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aaa5a3-324a-475d-8628-0933b706c795 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:12.659606 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aaa5a3-324a-475d-8628-0933b706c795 None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:12.659984 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b3e78-863d-4956-a122-333c12a877df None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:12.660376 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aaa5a3-324a-475d-8628-0933b706c795 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:12.662516 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aaa5a3-324a-475d-8628-0933b706c795 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:12.671464 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:12.699811 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b16ca-9452-48fc-a4fd-7c161479bbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:12.700720 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b16ca-9452-48fc-a4fd-7c161479bbce None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:12.701010 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b16ca-9452-48fc-a4fd-7c161479bbce None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:12.701292 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b16ca-9452-48fc-a4fd-7c161479bbce None admin] PATH_INFO: `/v3/projects/327221ec271a4464b199d5dd0216670d` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:12.702518 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b16ca-9452-48fc-a4fd-7c161479bbce None admin] RBAC: Authorizing `identity:get_project(project_id=327221ec271a4464b199d5dd0216670d)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:12.703997 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b16ca-9452-48fc-a4fd-7c161479bbce None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:12.705820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 43/86] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:12 2022] GET /identity/v3/projects/327221ec271a4464b199d5dd0216670d => generated 299 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:12.706606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b16ca-9452-48fc-a4fd-7c161479bbce None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:12.769869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 44/87] 10.222.0.119 () {60 vars in 1137 bytes} [Thu Jul 14 15:35:12 2022] POST /identity/v3/users => generated 290 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:35:12.771275 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aaa5a3-324a-475d-8628-0933b706c795 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:12.816071 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b16ca-9452-48fc-a4fd-7c161479bbce None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:12.861123 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2628e33-73ca-4dae-bbcb-9564b67010e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:12.862765 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2628e33-73ca-4dae-bbcb-9564b67010e3 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:12.863069 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2628e33-73ca-4dae-bbcb-9564b67010e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:12.863359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2628e33-73ca-4dae-bbcb-9564b67010e3 None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:12.864317 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2628e33-73ca-4dae-bbcb-9564b67010e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:12.864698 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2628e33-73ca-4dae-bbcb-9564b67010e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:12.866173 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2628e33-73ca-4dae-bbcb-9564b67010e3 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:12.883920 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 44/88] 10.222.0.119 () {56 vars in 1106 bytes} [Thu Jul 14 15:35:12 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:12.883920 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2628e33-73ca-4dae-bbcb-9564b67010e3 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:12.897752 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aaa5a3-324a-475d-8628-0933b706c795 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:12.932983 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:12.939776 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96744464-670f-45ed-b2d4-15ce35845be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:12.940703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96744464-670f-45ed-b2d4-15ce35845be8 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:12.941000 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96744464-670f-45ed-b2d4-15ce35845be8 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:12.941290 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96744464-670f-45ed-b2d4-15ce35845be8 None admin] PATH_INFO: `/v3/projects/327221ec271a4464b199d5dd0216670d` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:12.942555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96744464-670f-45ed-b2d4-15ce35845be8 None admin] RBAC: Authorizing `identity:get_project(project_id=327221ec271a4464b199d5dd0216670d)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:12.944042 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96744464-670f-45ed-b2d4-15ce35845be8 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:12.946711 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 45/89] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:12 2022] GET /identity/v3/projects/327221ec271a4464b199d5dd0216670d => generated 299 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:12.953840 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96744464-670f-45ed-b2d4-15ce35845be8 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:12.982258 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:13.010852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2628e33-73ca-4dae-bbcb-9564b67010e3 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:13.057821 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4934b6-69ec-4df2-a26e-cee472c8f1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:13.059140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4934b6-69ec-4df2-a26e-cee472c8f1fc None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:13.059786 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4934b6-69ec-4df2-a26e-cee472c8f1fc None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:13.060539 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4934b6-69ec-4df2-a26e-cee472c8f1fc None admin] PATH_INFO: `/v3/projects/327221ec271a4464b199d5dd0216670d` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:13.064833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4934b6-69ec-4df2-a26e-cee472c8f1fc None admin] RBAC: Authorizing `identity:get_project(project_id=327221ec271a4464b199d5dd0216670d)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:13.067642 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4934b6-69ec-4df2-a26e-cee472c8f1fc None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:13.071246 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 45/90] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:12 2022] GET /identity/v3/projects/327221ec271a4464b199d5dd0216670d => generated 299 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:13.073023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96744464-670f-45ed-b2d4-15ce35845be8 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:13.073159 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4934b6-69ec-4df2-a26e-cee472c8f1fc None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:13.119454 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badccf4b-2da9-47e6-b987-4e42de23f2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:13.120530 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badccf4b-2da9-47e6-b987-4e42de23f2c3 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:13.120841 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badccf4b-2da9-47e6-b987-4e42de23f2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:13.121135 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badccf4b-2da9-47e6-b987-4e42de23f2c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:13.122326 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badccf4b-2da9-47e6-b987-4e42de23f2c3 None admin] RBAC: Adding query filter params (role.id=07aaf007cde043318319928d151bdc75, scope.project.id=327221ec271a4464b199d5dd0216670d, user.id=558923a0ab794e4fab69165d8d72902b) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:13.122814 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badccf4b-2da9-47e6-b987-4e42de23f2c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:13.124329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badccf4b-2da9-47e6-b987-4e42de23f2c3 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:13.134428 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 46/91] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:35:12 2022] GET /identity/v3/role_assignments?user.id=558923a0ab794e4fab69165d8d72902b&scope.project.id=327221ec271a4464b199d5dd0216670d&role.id=07aaf007cde043318319928d151bdc75 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:13.135832 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badccf4b-2da9-47e6-b987-4e42de23f2c3 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:13.251123 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4934b6-69ec-4df2-a26e-cee472c8f1fc None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:13.274985 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:13.318913 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:13.320505 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c87772-785f-4126-a330-e9ac6b3d1032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:13.322567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c87772-785f-4126-a330-e9ac6b3d1032 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:13.323015 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c87772-785f-4126-a330-e9ac6b3d1032 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:13.323307 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c87772-785f-4126-a330-e9ac6b3d1032 None admin] PATH_INFO: `/v3/users/cdfa06df351a47d0a2012673e01f5556` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:13.325574 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c87772-785f-4126-a330-e9ac6b3d1032 None admin] RBAC: Authorizing `identity:get_user(user_id=cdfa06df351a47d0a2012673e01f5556)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:13.326194 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badccf4b-2da9-47e6-b987-4e42de23f2c3 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:13.327048 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c87772-785f-4126-a330-e9ac6b3d1032 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:13.328729 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 46/92] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:13 2022] GET /identity/v3/users/cdfa06df351a47d0a2012673e01f5556 => generated 276 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:13.334641 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c87772-785f-4126-a330-e9ac6b3d1032 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:13.374355 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292784f-d308-4bbb-8020-d365e58a1e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:13.375042 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292784f-d308-4bbb-8020-d365e58a1e31 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:13.375337 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292784f-d308-4bbb-8020-d365e58a1e31 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:13.375627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292784f-d308-4bbb-8020-d365e58a1e31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:13.376513 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292784f-d308-4bbb-8020-d365e58a1e31 None admin] RBAC: Adding query filter params (role.id=71b77f014251450eac200e62300144ab, scope.project.id=327221ec271a4464b199d5dd0216670d, user.id=cdfa06df351a47d0a2012673e01f5556) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:13.376839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292784f-d308-4bbb-8020-d365e58a1e31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:13.378314 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292784f-d308-4bbb-8020-d365e58a1e31 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:13.391174 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 47/93] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:35:13 2022] GET /identity/v3/role_assignments?user.id=cdfa06df351a47d0a2012673e01f5556&scope.project.id=327221ec271a4464b199d5dd0216670d&role.id=71b77f014251450eac200e62300144ab => generated 260 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:13.391866 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292784f-d308-4bbb-8020-d365e58a1e31 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:13.475036 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c87772-785f-4126-a330-e9ac6b3d1032 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:13.523398 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c0e80-9979-499c-bd05-4adb43b91ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:13.524088 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c0e80-9979-499c-bd05-4adb43b91ae8 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:13.524402 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c0e80-9979-499c-bd05-4adb43b91ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:13.524683 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c0e80-9979-499c-bd05-4adb43b91ae8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:13.525550 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c0e80-9979-499c-bd05-4adb43b91ae8 None admin] RBAC: Adding query filter params (role.id=14c8b3b550ba4f75a147b8851fd17c7c, scope.project.id=327221ec271a4464b199d5dd0216670d, user.id=cdfa06df351a47d0a2012673e01f5556) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:13.525867 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c0e80-9979-499c-bd05-4adb43b91ae8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:13.527370 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c0e80-9979-499c-bd05-4adb43b91ae8 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:13.553380 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 47/94] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:35:13 2022] GET /identity/v3/role_assignments?user.id=cdfa06df351a47d0a2012673e01f5556&scope.project.id=327221ec271a4464b199d5dd0216670d&role.id=14c8b3b550ba4f75a147b8851fd17c7c => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:13.607105 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292784f-d308-4bbb-8020-d365e58a1e31 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:13.653666 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae884d-698c-4200-8a93-952e4a35639a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:13.654349 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae884d-698c-4200-8a93-952e4a35639a None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:13.654640 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae884d-698c-4200-8a93-952e4a35639a None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:13.655008 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae884d-698c-4200-8a93-952e4a35639a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:13.691494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:13.752163 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae884d-698c-4200-8a93-952e4a35639a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:13.753760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae884d-698c-4200-8a93-952e4a35639a None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:13.897905 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 48/95] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:35:13 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:13.903261 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c0e80-9979-499c-bd05-4adb43b91ae8 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:13.980677 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:14.057767 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c0e80-9979-499c-bd05-4adb43b91ae8 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:14.112293 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38361b8-865f-4b5a-bede-c917d891714a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:14.112293 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38361b8-865f-4b5a-bede-c917d891714a None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:14.112293 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38361b8-865f-4b5a-bede-c917d891714a None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:14.112293 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38361b8-865f-4b5a-bede-c917d891714a None admin] PATH_INFO: `/v3/projects/38131d7edd584745836526884a3487e6` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:14.112843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38361b8-865f-4b5a-bede-c917d891714a None admin] RBAC: Authorizing `identity:get_project(project_id=38131d7edd584745836526884a3487e6)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:14.114537 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38361b8-865f-4b5a-bede-c917d891714a None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:14.116490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 48/96] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:13 2022] GET /identity/v3/projects/38131d7edd584745836526884a3487e6 => generated 313 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:14.122616 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae884d-698c-4200-8a93-952e4a35639a None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:14.211475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:14.264751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae884d-698c-4200-8a93-952e4a35639a None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:14.306678 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413dae74-fed5-489f-8e0c-db2e09e1a122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:14.307297 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dae74-fed5-489f-8e0c-db2e09e1a122 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:14.307586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dae74-fed5-489f-8e0c-db2e09e1a122 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:14.307868 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dae74-fed5-489f-8e0c-db2e09e1a122 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:14.308807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413dae74-fed5-489f-8e0c-db2e09e1a122 None admin] RBAC: Adding query filter params (role.id=14c8b3b550ba4f75a147b8851fd17c7c, scope.project.id=38131d7edd584745836526884a3487e6, user.id=cdfa06df351a47d0a2012673e01f5556) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:14.309126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413dae74-fed5-489f-8e0c-db2e09e1a122 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:14.310798 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413dae74-fed5-489f-8e0c-db2e09e1a122 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:14.316466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 49/97] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:35:14 2022] GET /identity/v3/role_assignments?user.id=cdfa06df351a47d0a2012673e01f5556&scope.project.id=38131d7edd584745836526884a3487e6&role.id=14c8b3b550ba4f75a147b8851fd17c7c => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:15.492499 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969aac25-e8e0-4999-905c-a2a33b70e244 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:15.493008 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969aac25-e8e0-4999-905c-a2a33b70e244 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:15.493190 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969aac25-e8e0-4999-905c-a2a33b70e244 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:15.494465 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 49/98] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:15.499908 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707860da-8aa4-452d-a0df-70d6b26da976 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:15.500759 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707860da-8aa4-452d-a0df-70d6b26da976 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:15.501276 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707860da-8aa4-452d-a0df-70d6b26da976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:15.524365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-707860da-8aa4-452d-a0df-70d6b26da976 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:15.525574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-707860da-8aa4-452d-a0df-70d6b26da976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:15.602747 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 50/99] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:15 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:15.650567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969aac25-e8e0-4999-905c-a2a33b70e244 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:15.781323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969aac25-e8e0-4999-905c-a2a33b70e244 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:15.796586 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:15.827971 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b2cf8-8421-456a-ade7-3a9bd36f2b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:15.828805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b2cf8-8421-456a-ade7-3a9bd36f2b7e None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:15.829099 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b2cf8-8421-456a-ade7-3a9bd36f2b7e None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:15.829384 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b2cf8-8421-456a-ade7-3a9bd36f2b7e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:15.846918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b2cf8-8421-456a-ade7-3a9bd36f2b7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:15.854849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-586b2cf8-8421-456a-ade7-3a9bd36f2b7e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:35:15.854849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:15.854849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:15.854849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:15.854849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:15.854849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:15.854849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:15.854849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:15.854849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:15.854849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:15.854849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:15.854849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:15.854849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:15.854849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:15.854849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:15.854849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:15.855681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:15.855681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:15.855681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:15.855681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:15.855681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:15.855681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:15.855681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:15.855681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:15.855681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:15.855681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:15.855681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:15.855681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:15.855681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:15.855681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:15.855681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:15.855681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:15.856498 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:15.856498 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:15.856498 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:15.856498 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:15.856498 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:15.856498 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:15.856498 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:15.856498 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:15.856498 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:15.856498 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:15.856498 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:35:15.856498 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:15.859312 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 50/100] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:15.865990 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707860da-8aa4-452d-a0df-70d6b26da976 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:15.913781 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebb748-ce0a-4fbf-94f2-1794ca8e81af None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:15.914091 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebb748-ce0a-4fbf-94f2-1794ca8e81af None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:15.914355 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebb748-ce0a-4fbf-94f2-1794ca8e81af None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:15.915730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 51/101] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:15.920751 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d04ec3-c5ea-43ee-8ee6-a0421ba72f8b None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:15.921044 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d04ec3-c5ea-43ee-8ee6-a0421ba72f8b None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:15.921328 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d04ec3-c5ea-43ee-8ee6-a0421ba72f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:15.950237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-05d04ec3-c5ea-43ee-8ee6-a0421ba72f8b None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:15.951470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-05d04ec3-c5ea-43ee-8ee6-a0421ba72f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:15.969726 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:16.075124 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707860da-8aa4-452d-a0df-70d6b26da976 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:16.076842 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 52/102] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:15 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:35:16.114190 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d04ec3-c5ea-43ee-8ee6-a0421ba72f8b None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:16.128857 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150be3fe-8994-40e0-a1c5-62971db9ad38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:16.131331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150be3fe-8994-40e0-a1c5-62971db9ad38 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:16.133282 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150be3fe-8994-40e0-a1c5-62971db9ad38 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:16.134574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150be3fe-8994-40e0-a1c5-62971db9ad38 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:16.135545 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150be3fe-8994-40e0-a1c5-62971db9ad38 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:16.136782 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150be3fe-8994-40e0-a1c5-62971db9ad38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:16.138514 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150be3fe-8994-40e0-a1c5-62971db9ad38 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:16.159386 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 51/103] 10.222.0.119 () {56 vars in 1106 bytes} [Thu Jul 14 15:35:15 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:16.164082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150be3fe-8994-40e0-a1c5-62971db9ad38 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:16.273873 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150be3fe-8994-40e0-a1c5-62971db9ad38 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:16.288500 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:16.310091 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba8a81-209c-4ee1-8449-a9788a8aaf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:16.311349 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba8a81-209c-4ee1-8449-a9788a8aaf75 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:16.311907 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba8a81-209c-4ee1-8449-a9788a8aaf75 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:16.312409 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba8a81-209c-4ee1-8449-a9788a8aaf75 None admin] PATH_INFO: `/v3/users/3ff1942cd99e4aa0bce9ca2acc6614de` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:16.326701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d04ec3-c5ea-43ee-8ee6-a0421ba72f8b None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:16.328159 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba8a81-209c-4ee1-8449-a9788a8aaf75 None admin] RBAC: Authorizing `identity:get_user(user_id=3ff1942cd99e4aa0bce9ca2acc6614de)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:16.328395 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:16.330074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba8a81-209c-4ee1-8449-a9788a8aaf75 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:16.332427 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 52/104] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:16 2022] GET /identity/v3/users/3ff1942cd99e4aa0bce9ca2acc6614de => generated 290 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:16.344128 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba8a81-209c-4ee1-8449-a9788a8aaf75 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:16.409888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69db4f2-ff98-4047-9aba-644daa103bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:16.411176 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69db4f2-ff98-4047-9aba-644daa103bd7 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:16.411748 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69db4f2-ff98-4047-9aba-644daa103bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:16.412253 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69db4f2-ff98-4047-9aba-644daa103bd7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:16.416916 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69db4f2-ff98-4047-9aba-644daa103bd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:16.418617 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69db4f2-ff98-4047-9aba-644daa103bd7 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:16.420714 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 53/105] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:35:16 2022] GET /identity/v3/domains/default => generated 200 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:16.422124 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b0b5b-e9b0-4b73-b97c-38e846240357 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:16.422686 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b0b5b-e9b0-4b73-b97c-38e846240357 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:16.423260 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b0b5b-e9b0-4b73-b97c-38e846240357 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:16.424722 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 54/106] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:16.430688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b0b5b-e9b0-4b73-b97c-38e846240357 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:16.473989 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba8a81-209c-4ee1-8449-a9788a8aaf75 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:16.516000 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d60371-9ba7-4448-9bf7-0c660eb3c1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:16.520180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d60371-9ba7-4448-9bf7-0c660eb3c1f0 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:16.520180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d60371-9ba7-4448-9bf7-0c660eb3c1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:16.520180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d60371-9ba7-4448-9bf7-0c660eb3c1f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:16.562473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:16.596357 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d60371-9ba7-4448-9bf7-0c660eb3c1f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:16.599238 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d60371-9ba7-4448-9bf7-0c660eb3c1f0 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:16.617818 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b0b5b-e9b0-4b73-b97c-38e846240357 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:16.654263 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40546a0-d76b-49ee-af98-b8faaaca0fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:16.655179 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40546a0-d76b-49ee-af98-b8faaaca0fea None admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:16.655571 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40546a0-d76b-49ee-af98-b8faaaca0fea None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:16.656128 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40546a0-d76b-49ee-af98-b8faaaca0fea None admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:16.656956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40546a0-d76b-49ee-af98-b8faaaca0fea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:16.658693 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40546a0-d76b-49ee-af98-b8faaaca0fea None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:16.716094 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 53/107] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:35:16 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:16.717586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261f539-8da5-4f4e-99a0-fb06ea6d35ae None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:16.717889 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261f539-8da5-4f4e-99a0-fb06ea6d35ae None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:16.718178 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261f539-8da5-4f4e-99a0-fb06ea6d35ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:16.736261 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-e261f539-8da5-4f4e-99a0-fb06ea6d35ae None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:16.737471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-e261f539-8da5-4f4e-99a0-fb06ea6d35ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:16.741758 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 55/108] 10.222.0.119 () {60 vars in 1146 bytes} [Thu Jul 14 15:35:16 2022] POST /identity/v3/projects => generated 303 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:35:16.742673 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40546a0-d76b-49ee-af98-b8faaaca0fea None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:16.795296 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:16.827499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 54/109] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:16.851825 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261f539-8da5-4f4e-99a0-fb06ea6d35ae None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:16.854152 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:16.965176 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261f539-8da5-4f4e-99a0-fb06ea6d35ae None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:16.983000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40546a0-d76b-49ee-af98-b8faaaca0fea None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:17.006285 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad940f1-e43f-4160-8378-baa535df4770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:17.007223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad940f1-e43f-4160-8378-baa535df4770 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:17.007587 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad940f1-e43f-4160-8378-baa535df4770 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:17.007939 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad940f1-e43f-4160-8378-baa535df4770 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:17.029322 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad940f1-e43f-4160-8378-baa535df4770 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:17.038050 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-8ad940f1-e43f-4160-8378-baa535df4770 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:35:17.038050 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:17.038050 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:17.038050 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:17.038050 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:17.038050 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:17.038050 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:17.038050 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:17.038050 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:17.038050 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:17.038050 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:17.038050 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:17.038050 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:17.038050 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:17.038050 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:17.038050 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:17.038956 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:17.038956 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:17.038956 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:17.038956 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:17.038956 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:17.038956 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:17.038956 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:17.038956 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:17.038956 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:17.038956 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:17.038956 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:17.038956 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:17.038956 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:17.038956 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:17.038956 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:17.038956 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:17.039709 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:17.039709 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:17.039709 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:17.039709 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:17.039709 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:17.039709 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:17.039709 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:17.039709 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:17.039709 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:17.039709 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:17.039709 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:35:17.039709 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:35:17.056595 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 55/110] 10.222.0.119 () {56 vars in 1119 bytes} [Thu Jul 14 15:35:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:17.057576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad940f1-e43f-4160-8378-baa535df4770 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:17.068871 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6281829-ce3f-48e4-aaad-f1cac685f361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:17.069846 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6281829-ce3f-48e4-aaad-f1cac685f361 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:17.070136 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6281829-ce3f-48e4-aaad-f1cac685f361 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:17.070473 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6281829-ce3f-48e4-aaad-f1cac685f361 None admin] PATH_INFO: `/v3/projects/327221ec271a4464b199d5dd0216670d` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:17.071812 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6281829-ce3f-48e4-aaad-f1cac685f361 None admin] RBAC: Authorizing `identity:get_project(project_id=327221ec271a4464b199d5dd0216670d)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:17.073422 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6281829-ce3f-48e4-aaad-f1cac685f361 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:17.075193 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 56/111] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:16 2022] GET /identity/v3/projects/327221ec271a4464b199d5dd0216670d => generated 299 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:17.083821 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deaa6af-fac4-4783-be2e-e6829bb0fd71 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:17.084280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deaa6af-fac4-4783-be2e-e6829bb0fd71 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:17.084736 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deaa6af-fac4-4783-be2e-e6829bb0fd71 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:17.086260 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 57/112] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:35:17.090520 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deaa6af-fac4-4783-be2e-e6829bb0fd71 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:17.138902 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:17.185056 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad940f1-e43f-4160-8378-baa535df4770 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:17.213542 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:17.223642 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370c0b7-65cb-4df8-86d8-aec9dfabb3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:17.224472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370c0b7-65cb-4df8-86d8-aec9dfabb3ca None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:17.224838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370c0b7-65cb-4df8-86d8-aec9dfabb3ca None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:17.225121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370c0b7-65cb-4df8-86d8-aec9dfabb3ca None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:17.230184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370c0b7-65cb-4df8-86d8-aec9dfabb3ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:17.230184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370c0b7-65cb-4df8-86d8-aec9dfabb3ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:17.230184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370c0b7-65cb-4df8-86d8-aec9dfabb3ca None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:17.230876 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deaa6af-fac4-4783-be2e-e6829bb0fd71 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:17.239845 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 56/113] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:35:17 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:17.241268 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c393a-06d1-462a-8676-702af18f25f6 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:17.241570 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c393a-06d1-462a-8676-702af18f25f6 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:17.241860 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c393a-06d1-462a-8676-702af18f25f6 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:17.243293 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 57/114] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:17.247472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b73c6a-0b4b-4b13-a155-c9ea72eef3ab None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:17.247472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b73c6a-0b4b-4b13-a155-c9ea72eef3ab None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:17.247472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b73c6a-0b4b-4b13-a155-c9ea72eef3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:17.263736 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-73b73c6a-0b4b-4b13-a155-c9ea72eef3ab None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:17.265097 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-73b73c6a-0b4b-4b13-a155-c9ea72eef3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:17.276070 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575f135-b599-49f0-bd1d-44a30a85506d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:17.277062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575f135-b599-49f0-bd1d-44a30a85506d None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:17.277867 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575f135-b599-49f0-bd1d-44a30a85506d None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:17.278326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575f135-b599-49f0-bd1d-44a30a85506d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:17.279423 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575f135-b599-49f0-bd1d-44a30a85506d None admin] RBAC: Adding query filter params (role.id=37be94aa89aa45db936809e7f660c225, scope.project.id=327221ec271a4464b199d5dd0216670d, user.id=3ff1942cd99e4aa0bce9ca2acc6614de) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:17.279926 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575f135-b599-49f0-bd1d-44a30a85506d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:17.281428 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575f135-b599-49f0-bd1d-44a30a85506d None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:17.292147 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 58/115] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:35:17 2022] GET /identity/v3/role_assignments?user.id=3ff1942cd99e4aa0bce9ca2acc6614de&scope.project.id=327221ec271a4464b199d5dd0216670d&role.id=37be94aa89aa45db936809e7f660c225 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:17.292147 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00eff6-2044-4d6f-a2fd-78a0e603377a None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:17.292147 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00eff6-2044-4d6f-a2fd-78a0e603377a None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:17.292147 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00eff6-2044-4d6f-a2fd-78a0e603377a None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:17.292147 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 59/116] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:17.295823 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00eff6-2044-4d6f-a2fd-78a0e603377a None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:17.361891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 58/117] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:17.364390 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed145d45-2e27-4347-b5b2-bff18afe9ea0 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:17.364706 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed145d45-2e27-4347-b5b2-bff18afe9ea0 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:17.364998 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed145d45-2e27-4347-b5b2-bff18afe9ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:17.387514 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-ed145d45-2e27-4347-b5b2-bff18afe9ea0 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:17.388748 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-ed145d45-2e27-4347-b5b2-bff18afe9ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:17.444851 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00eff6-2044-4d6f-a2fd-78a0e603377a None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:17.459226 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:17.483015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 59/118] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:17.487424 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066f945-0336-4340-bd0c-911fe0cb3094 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:17.487424 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066f945-0336-4340-bd0c-911fe0cb3094 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:17.487424 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066f945-0336-4340-bd0c-911fe0cb3094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:17.490493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9428b2-7cda-4593-b144-889c743ab3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:17.491385 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9428b2-7cda-4593-b144-889c743ab3cd None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:17.491677 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9428b2-7cda-4593-b144-889c743ab3cd None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:17.491959 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9428b2-7cda-4593-b144-889c743ab3cd None admin] PATH_INFO: `/v3/users/cdfa06df351a47d0a2012673e01f5556` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:17.493336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9428b2-7cda-4593-b144-889c743ab3cd None admin] RBAC: Authorizing `identity:get_user(user_id=cdfa06df351a47d0a2012673e01f5556)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:17.496603 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9428b2-7cda-4593-b144-889c743ab3cd None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:17.498308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 60/119] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:17 2022] GET /identity/v3/users/cdfa06df351a47d0a2012673e01f5556 => generated 276 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:17.499131 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9428b2-7cda-4593-b144-889c743ab3cd None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:17.507722 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-1066f945-0336-4340-bd0c-911fe0cb3094 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:17.509258 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-1066f945-0336-4340-bd0c-911fe0cb3094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:17.528146 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:17.608851 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 60/120] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:17.610446 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066f945-0336-4340-bd0c-911fe0cb3094 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:17.642371 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9428b2-7cda-4593-b144-889c743ab3cd None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:17.694063 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b0584-359b-43ce-a977-7714225fbd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:17.695618 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b0584-359b-43ce-a977-7714225fbd16 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:17.696182 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b0584-359b-43ce-a977-7714225fbd16 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:17.696631 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b0584-359b-43ce-a977-7714225fbd16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:17.708204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b0584-359b-43ce-a977-7714225fbd16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:17.716866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-bb6b0584-359b-43ce-a977-7714225fbd16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:17.716866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:17.716866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:17.716866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:17.716866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:17.716866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:17.716866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:17.716866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:17.716866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:17.716866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:17.716866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:17.716866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:17.716866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:17.716866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:17.716866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:17.716866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:17.725783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:17.725783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:17.725783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:17.725783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:17.725783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:17.725783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:17.725783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:17.725783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:17.725783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:17.725783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:17.725783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:17.725783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:17.725783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:17.725783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:17.725783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:17.725783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:17.726744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:17.726744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:17.726744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:17.726744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:17.726744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:17.726744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:17.726744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:17.726744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:17.726744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:17.726744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:17.726744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:17.726744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:17.726744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 61/121] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:17.726744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b0584-359b-43ce-a977-7714225fbd16 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:17.753106 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066f945-0336-4340-bd0c-911fe0cb3094 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:17.774244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:17.806218 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73121f4a-fea0-4615-9ae4-69c6b346203b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:17.807095 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73121f4a-fea0-4615-9ae4-69c6b346203b None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:17.807381 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73121f4a-fea0-4615-9ae4-69c6b346203b None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:17.807659 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73121f4a-fea0-4615-9ae4-69c6b346203b None admin] PATH_INFO: `/v3/projects/327221ec271a4464b199d5dd0216670d` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:17.811502 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73121f4a-fea0-4615-9ae4-69c6b346203b None admin] RBAC: Authorizing `identity:get_project(project_id=327221ec271a4464b199d5dd0216670d)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:17.812644 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73121f4a-fea0-4615-9ae4-69c6b346203b None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:17.814633 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 61/122] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:17 2022] GET /identity/v3/projects/327221ec271a4464b199d5dd0216670d => generated 299 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:17.815207 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73121f4a-fea0-4615-9ae4-69c6b346203b None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:17.827642 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:17.859046 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b0584-359b-43ce-a977-7714225fbd16 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:17.907358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027418d-4214-46b0-976f-daae7b125486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:17.908793 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027418d-4214-46b0-976f-daae7b125486 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:17.909696 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027418d-4214-46b0-976f-daae7b125486 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:17.910193 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027418d-4214-46b0-976f-daae7b125486 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:17.925090 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73121f4a-fea0-4615-9ae4-69c6b346203b None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:17.925551 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027418d-4214-46b0-976f-daae7b125486 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:17.937366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-0027418d-4214-46b0-976f-daae7b125486 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:35:17.937366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:17.937366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:17.937366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:17.937366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:17.937366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:17.937366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:17.937366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:17.937366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:17.937366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:17.937366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:17.937366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:17.937366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:17.937366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:17.937366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:17.937366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:17.938237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:17.938237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:17.938237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:17.938237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:17.938237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:17.938237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:17.938237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:17.938237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:17.938237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:17.938237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:17.938237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:17.938237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:17.938237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:17.938237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:17.938237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:17.938237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:17.938982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:17.938982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:17.938982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:17.938982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:17.938982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:17.938982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:17.938982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:17.938982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:17.938982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:17.938982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:17.938982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:35:17.938982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:17.938982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 62/123] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:35:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:17.939594 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027418d-4214-46b0-976f-daae7b125486 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:17.973765 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcca0d3-ea54-459d-86b0-28598d73f835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:17.975556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcca0d3-ea54-459d-86b0-28598d73f835 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:17.976328 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcca0d3-ea54-459d-86b0-28598d73f835 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:17.976817 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcca0d3-ea54-459d-86b0-28598d73f835 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:17.991913 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcca0d3-ea54-459d-86b0-28598d73f835 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:18.002760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-abcca0d3-ea54-459d-86b0-28598d73f835 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:18.002760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:18.002760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:18.002760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:18.002760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:18.002760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:18.002760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:18.002760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:18.002760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:18.002760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:18.002760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:18.002760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:18.002760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:18.002760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:18.002760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:18.002760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:18.003621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:18.003621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:18.003621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:18.003621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:18.003621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:18.003621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:18.003621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:18.003621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:18.003621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:18.003621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:18.003621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:18.003621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:18.003621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:18.003621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:18.003621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:18.003621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:18.004420 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:18.004420 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:18.004420 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:18.004420 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:18.004420 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:18.004420 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:18.004420 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:18.004420 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:18.004420 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:18.004420 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:18.004420 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:18.004420 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:35:18.011412 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 62/124] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:18.011412 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcca0d3-ea54-459d-86b0-28598d73f835 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:18.055975 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:18.073952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027418d-4214-46b0-976f-daae7b125486 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:18.113587 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e99dc-2328-4134-aec2-75f495f642f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:18.114986 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e99dc-2328-4134-aec2-75f495f642f1 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:18.114986 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e99dc-2328-4134-aec2-75f495f642f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:18.117388 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e99dc-2328-4134-aec2-75f495f642f1 None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:18.117388 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e99dc-2328-4134-aec2-75f495f642f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:18.117388 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e99dc-2328-4134-aec2-75f495f642f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:18.118269 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e99dc-2328-4134-aec2-75f495f642f1 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:18.124524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:18.128909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 63/125] 10.222.0.119 () {56 vars in 1106 bytes} [Thu Jul 14 15:35:17 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:18.130298 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e99dc-2328-4134-aec2-75f495f642f1 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:18.140857 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcca0d3-ea54-459d-86b0-28598d73f835 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:18.190961 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ac06c-91c4-4908-975a-5d346ad9db5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:18.192273 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ac06c-91c4-4908-975a-5d346ad9db5f None admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:18.193389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ac06c-91c4-4908-975a-5d346ad9db5f None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:18.193901 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ac06c-91c4-4908-975a-5d346ad9db5f None admin] PATH_INFO: `/v3/projects/327221ec271a4464b199d5dd0216670d/users/cdfa06df351a47d0a2012673e01f5556/roles/71b77f014251450eac200e62300144ab` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:18.197637 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ac06c-91c4-4908-975a-5d346ad9db5f None admin] RBAC: Authorizing `identity:create_grant(project_id=327221ec271a4464b199d5dd0216670d, user_id=cdfa06df351a47d0a2012673e01f5556, role_id=71b77f014251450eac200e62300144ab)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:18.199983 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ac06c-91c4-4908-975a-5d346ad9db5f None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:18.243356 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e99dc-2328-4134-aec2-75f495f642f1 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:18.273255 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 63/126] 10.222.0.119 () {58 vars in 1444 bytes} [Thu Jul 14 15:35:18 2022] PUT /identity/v3/projects/327221ec271a4464b199d5dd0216670d/users/cdfa06df351a47d0a2012673e01f5556/roles/71b77f014251450eac200e62300144ab => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:35:18.276996 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ac06c-91c4-4908-975a-5d346ad9db5f None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:18.281165 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17628ebe-d66a-4681-bc85-33a2a2632e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:18.281969 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17628ebe-d66a-4681-bc85-33a2a2632e19 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:18.282263 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17628ebe-d66a-4681-bc85-33a2a2632e19 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:18.282593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17628ebe-d66a-4681-bc85-33a2a2632e19 None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:18.283482 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17628ebe-d66a-4681-bc85-33a2a2632e19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:18.283801 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17628ebe-d66a-4681-bc85-33a2a2632e19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:18.285503 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17628ebe-d66a-4681-bc85-33a2a2632e19 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:18.297464 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 64/127] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:18 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:18.298575 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17628ebe-d66a-4681-bc85-33a2a2632e19 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:18.428576 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:18.432813 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ac06c-91c4-4908-975a-5d346ad9db5f None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:18.434479 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:18.482317 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b0e16-9507-4020-af6b-759cff187d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:18.483010 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b0e16-9507-4020-af6b-759cff187d58 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:18.483308 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b0e16-9507-4020-af6b-759cff187d58 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:18.483598 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b0e16-9507-4020-af6b-759cff187d58 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:18.484401 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b0e16-9507-4020-af6b-759cff187d58 None admin] RBAC: Adding query filter params (name=member) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:18.484720 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b0e16-9507-4020-af6b-759cff187d58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:18.486181 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b0e16-9507-4020-af6b-759cff187d58 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:18.495790 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17628ebe-d66a-4681-bc85-33a2a2632e19 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:18.506049 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 64/128] 10.222.0.119 () {56 vars in 1106 bytes} [Thu Jul 14 15:35:18 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:18.527580 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b0e16-9507-4020-af6b-759cff187d58 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:18.617414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d219043-045b-46af-ac40-3ac9a6a6b9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:18.618329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d219043-045b-46af-ac40-3ac9a6a6b9a3 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:18.618614 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d219043-045b-46af-ac40-3ac9a6a6b9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:18.618884 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d219043-045b-46af-ac40-3ac9a6a6b9a3 None admin] PATH_INFO: `/v3/users/cdfa06df351a47d0a2012673e01f5556` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:18.623674 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b0e16-9507-4020-af6b-759cff187d58 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:18.624846 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d219043-045b-46af-ac40-3ac9a6a6b9a3 None admin] RBAC: Authorizing `identity:get_user(user_id=cdfa06df351a47d0a2012673e01f5556)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:18.626336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d219043-045b-46af-ac40-3ac9a6a6b9a3 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:18.628018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 65/129] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:18 2022] GET /identity/v3/users/cdfa06df351a47d0a2012673e01f5556 => generated 276 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:18.628812 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d219043-045b-46af-ac40-3ac9a6a6b9a3 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:18.662322 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83dcaac-2a15-40d7-a066-c644da7b6355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:18.663522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dcaac-2a15-40d7-a066-c644da7b6355 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:18.663991 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dcaac-2a15-40d7-a066-c644da7b6355 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:18.664457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dcaac-2a15-40d7-a066-c644da7b6355 None admin] PATH_INFO: `/v3/users/558923a0ab794e4fab69165d8d72902b` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:18.666020 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83dcaac-2a15-40d7-a066-c644da7b6355 None admin] RBAC: Authorizing `identity:get_user(user_id=558923a0ab794e4fab69165d8d72902b)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:18.667836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83dcaac-2a15-40d7-a066-c644da7b6355 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:18.669821 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 65/130] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:18 2022] GET /identity/v3/users/558923a0ab794e4fab69165d8d72902b => generated 248 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:18.670812 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83dcaac-2a15-40d7-a066-c644da7b6355 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:18.706228 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:18.788209 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83dcaac-2a15-40d7-a066-c644da7b6355 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:18.811137 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d219043-045b-46af-ac40-3ac9a6a6b9a3 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:18.844448 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:18.852212 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab2cdf-bdce-4d57-aca9-4ad31d8270a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:18.858474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab2cdf-bdce-4d57-aca9-4ad31d8270a7 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:18.858474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab2cdf-bdce-4d57-aca9-4ad31d8270a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:18.858474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab2cdf-bdce-4d57-aca9-4ad31d8270a7 None admin] PATH_INFO: `/v3/users/cdfa06df351a47d0a2012673e01f5556` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:18.858474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab2cdf-bdce-4d57-aca9-4ad31d8270a7 None admin] RBAC: Authorizing `identity:get_user(user_id=cdfa06df351a47d0a2012673e01f5556)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:18.858474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab2cdf-bdce-4d57-aca9-4ad31d8270a7 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:18.858474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 66/131] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:18 2022] GET /identity/v3/users/cdfa06df351a47d0a2012673e01f5556 => generated 276 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:18.858871 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab2cdf-bdce-4d57-aca9-4ad31d8270a7 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:18.865184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31b73c-31b5-41a8-bd29-a82257435daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:18.866057 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31b73c-31b5-41a8-bd29-a82257435daf None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:18.866345 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31b73c-31b5-41a8-bd29-a82257435daf None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:18.866627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31b73c-31b5-41a8-bd29-a82257435daf None admin] PATH_INFO: `/v3/projects/38131d7edd584745836526884a3487e6` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:18.869383 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31b73c-31b5-41a8-bd29-a82257435daf None admin] RBAC: Authorizing `identity:get_project(project_id=38131d7edd584745836526884a3487e6)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:18.870862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31b73c-31b5-41a8-bd29-a82257435daf None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:18.872593 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 66/132] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:18 2022] GET /identity/v3/projects/38131d7edd584745836526884a3487e6 => generated 313 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:18.873354 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31b73c-31b5-41a8-bd29-a82257435daf None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:19.000985 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:19.003471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31b73c-31b5-41a8-bd29-a82257435daf None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:19.066736 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab2cdf-bdce-4d57-aca9-4ad31d8270a7 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:19.073364 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58608ffd-441c-437c-891b-b66196cc5a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:19.074496 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58608ffd-441c-437c-891b-b66196cc5a0b None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:19.074976 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58608ffd-441c-437c-891b-b66196cc5a0b None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:19.075450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58608ffd-441c-437c-891b-b66196cc5a0b None admin] PATH_INFO: `/v3/projects/327221ec271a4464b199d5dd0216670d` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:19.080827 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58608ffd-441c-437c-891b-b66196cc5a0b None admin] RBAC: Authorizing `identity:get_project(project_id=327221ec271a4464b199d5dd0216670d)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:19.082518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58608ffd-441c-437c-891b-b66196cc5a0b None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:19.085018 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 67/133] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:18 2022] GET /identity/v3/projects/327221ec271a4464b199d5dd0216670d => generated 299 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:19.085965 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58608ffd-441c-437c-891b-b66196cc5a0b None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:19.103352 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a03cfe-98f8-48e7-8cc4-8339d71777b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:19.112488 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a03cfe-98f8-48e7-8cc4-8339d71777b9 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:19.112488 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a03cfe-98f8-48e7-8cc4-8339d71777b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:19.112488 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a03cfe-98f8-48e7-8cc4-8339d71777b9 None admin] PATH_INFO: `/v3/projects/327221ec271a4464b199d5dd0216670d` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:19.112488 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a03cfe-98f8-48e7-8cc4-8339d71777b9 None admin] RBAC: Authorizing `identity:get_project(project_id=327221ec271a4464b199d5dd0216670d)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:19.112488 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a03cfe-98f8-48e7-8cc4-8339d71777b9 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:19.112488 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 67/134] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:18 2022] GET /identity/v3/projects/327221ec271a4464b199d5dd0216670d => generated 299 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:19.112937 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a03cfe-98f8-48e7-8cc4-8339d71777b9 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:19.181359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:19.218983 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a03cfe-98f8-48e7-8cc4-8339d71777b9 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:19.227935 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58608ffd-441c-437c-891b-b66196cc5a0b None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:19.254692 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336441e-6806-4332-9117-5e0de3ade878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:19.255691 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336441e-6806-4332-9117-5e0de3ade878 None admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:19.255922 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336441e-6806-4332-9117-5e0de3ade878 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:19.256247 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336441e-6806-4332-9117-5e0de3ade878 None admin] PATH_INFO: `/v3/projects/327221ec271a4464b199d5dd0216670d/users/cdfa06df351a47d0a2012673e01f5556/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:19.258473 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336441e-6806-4332-9117-5e0de3ade878 None admin] RBAC: Authorizing `identity:create_grant(project_id=327221ec271a4464b199d5dd0216670d, user_id=cdfa06df351a47d0a2012673e01f5556, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:19.259999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336441e-6806-4332-9117-5e0de3ade878 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:19.266182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5de034-1664-4c9d-a754-f9de1011c6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:19.267189 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5de034-1664-4c9d-a754-f9de1011c6dd None admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:19.267556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5de034-1664-4c9d-a754-f9de1011c6dd None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:19.267913 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5de034-1664-4c9d-a754-f9de1011c6dd None admin] PATH_INFO: `/v3/projects/38131d7edd584745836526884a3487e6/users/cdfa06df351a47d0a2012673e01f5556/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:19.270016 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5de034-1664-4c9d-a754-f9de1011c6dd None admin] RBAC: Authorizing `identity:create_grant(project_id=38131d7edd584745836526884a3487e6, user_id=cdfa06df351a47d0a2012673e01f5556, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:19.272569 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5de034-1664-4c9d-a754-f9de1011c6dd None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:19.353304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 68/135] 10.222.0.119 () {58 vars in 1444 bytes} [Thu Jul 14 15:35:19 2022] PUT /identity/v3/projects/327221ec271a4464b199d5dd0216670d/users/cdfa06df351a47d0a2012673e01f5556/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:35:19.354728 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336441e-6806-4332-9117-5e0de3ade878 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:19.391699 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 68/136] 10.222.0.119 () {58 vars in 1444 bytes} [Thu Jul 14 15:35:19 2022] PUT /identity/v3/projects/38131d7edd584745836526884a3487e6/users/cdfa06df351a47d0a2012673e01f5556/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:35:19.391699 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bebf0-64a6-4252-ba06-aba207029150 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:19.391699 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bebf0-64a6-4252-ba06-aba207029150 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:19.391699 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bebf0-64a6-4252-ba06-aba207029150 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:19.391699 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 69/137] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:19.397888 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a76755-40da-4383-a95f-456a0643dcc1 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:19.398523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a76755-40da-4383-a95f-456a0643dcc1 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:19.399551 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a76755-40da-4383-a95f-456a0643dcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:19.422683 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-63a76755-40da-4383-a95f-456a0643dcc1 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:19.424905 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-63a76755-40da-4383-a95f-456a0643dcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:19.456686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:19.518416 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 70/138] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:19.544836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a76755-40da-4383-a95f-456a0643dcc1 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:19.554757 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336441e-6806-4332-9117-5e0de3ade878 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:19.618191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46602b-6de8-4a9b-80a7-3ef64e31216b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:19.619129 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46602b-6de8-4a9b-80a7-3ef64e31216b None admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:19.619426 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46602b-6de8-4a9b-80a7-3ef64e31216b None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:19.619811 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46602b-6de8-4a9b-80a7-3ef64e31216b None admin] PATH_INFO: `/v3/projects/327221ec271a4464b199d5dd0216670d/users/558923a0ab794e4fab69165d8d72902b/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:19.624461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:19.628785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46602b-6de8-4a9b-80a7-3ef64e31216b None admin] RBAC: Authorizing `identity:create_grant(project_id=327221ec271a4464b199d5dd0216670d, user_id=558923a0ab794e4fab69165d8d72902b, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:19.631172 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46602b-6de8-4a9b-80a7-3ef64e31216b None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:19.673127 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a76755-40da-4383-a95f-456a0643dcc1 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:19.712502 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdea25-2702-4ed3-9365-a8535baa9293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:19.713334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdea25-2702-4ed3-9365-a8535baa9293 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:19.713626 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdea25-2702-4ed3-9365-a8535baa9293 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:19.713949 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdea25-2702-4ed3-9365-a8535baa9293 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:19.715464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdea25-2702-4ed3-9365-a8535baa9293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:19.716994 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdea25-2702-4ed3-9365-a8535baa9293 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:19.718737 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 71/139] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:35:19 2022] GET /identity/v3/domains/default => generated 200 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:19.724823 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdea25-2702-4ed3-9365-a8535baa9293 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:19.737311 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 69/140] 10.222.0.119 () {58 vars in 1444 bytes} [Thu Jul 14 15:35:19 2022] PUT /identity/v3/projects/327221ec271a4464b199d5dd0216670d/users/558923a0ab794e4fab69165d8d72902b/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:35:19.756579 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:19.840918 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdea25-2702-4ed3-9365-a8535baa9293 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:19.852352 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccef26-a183-40e3-a880-029f4012163e None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:19.853309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccef26-a183-40e3-a880-029f4012163e None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:19.853834 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccef26-a183-40e3-a880-029f4012163e None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:19.855721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 70/141] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:19 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:35:19.861444 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53efe1-a444-45c2-ab73-c90bd4feb442 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:19.862033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53efe1-a444-45c2-ab73-c90bd4feb442 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:19.862558 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53efe1-a444-45c2-ab73-c90bd4feb442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:19.880617 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c46bbc-a22a-4b24-80ae-07a40ca8b167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:19.880617 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c46bbc-a22a-4b24-80ae-07a40ca8b167 None admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:19.880617 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c46bbc-a22a-4b24-80ae-07a40ca8b167 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:19.880617 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c46bbc-a22a-4b24-80ae-07a40ca8b167 None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:19.880984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c46bbc-a22a-4b24-80ae-07a40ca8b167 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:19.885656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c46bbc-a22a-4b24-80ae-07a40ca8b167 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:19.896147 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-fd53efe1-a444-45c2-ab73-c90bd4feb442 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:19.896425 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-fd53efe1-a444-45c2-ab73-c90bd4feb442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:19.991077 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 71/142] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:35:20.013413 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 72/143] 10.222.0.119 () {60 vars in 1137 bytes} [Thu Jul 14 15:35:19 2022] POST /identity/v3/users => generated 284 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:35:20.026012 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53efe1-a444-45c2-ab73-c90bd4feb442 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:20.147227 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53efe1-a444-45c2-ab73-c90bd4feb442 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:20.165778 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:20.187179 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5715f3-cad3-4776-880c-aef6b2cd6fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:20.188011 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5715f3-cad3-4776-880c-aef6b2cd6fff None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:20.188365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5715f3-cad3-4776-880c-aef6b2cd6fff None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:20.188846 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5715f3-cad3-4776-880c-aef6b2cd6fff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:20.202220 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5715f3-cad3-4776-880c-aef6b2cd6fff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:20.211203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-fa5715f3-cad3-4776-880c-aef6b2cd6fff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:35:20.211203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:20.211203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:20.211203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:20.211203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:20.211203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:20.211203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:20.211203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:20.211203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:20.211203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:20.211203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:20.211203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:20.211203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:20.211203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:20.211203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:20.211203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:20.212150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:20.212150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:20.212150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:20.212150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:20.212150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:20.212150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:20.212150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:20.212150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:20.212150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:20.212150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:20.212150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:20.212150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:20.212150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:20.212150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:20.212150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:20.212150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:20.212965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:20.212965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:20.212965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:20.212965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:20.212965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:20.212965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:20.212965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:20.212965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:20.212965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:20.212965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:20.212965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:35:20.212965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:20.216639 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 72/144] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:20.223963 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c46bbc-a22a-4b24-80ae-07a40ca8b167 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:20.344498 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:20.357019 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c46bbc-a22a-4b24-80ae-07a40ca8b167 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:20.394839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc445a7-0c66-4d3b-9ad7-39f9539dd7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:20.395623 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc445a7-0c66-4d3b-9ad7-39f9539dd7db None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:20.395917 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc445a7-0c66-4d3b-9ad7-39f9539dd7db None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:20.396293 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc445a7-0c66-4d3b-9ad7-39f9539dd7db None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:20.397174 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc445a7-0c66-4d3b-9ad7-39f9539dd7db None admin] RBAC: Adding query filter params (name=reader) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:20.397597 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc445a7-0c66-4d3b-9ad7-39f9539dd7db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:20.399019 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc445a7-0c66-4d3b-9ad7-39f9539dd7db None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:20.409553 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 73/145] 10.222.0.119 () {56 vars in 1106 bytes} [Thu Jul 14 15:35:20 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:20.417610 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5715f3-cad3-4776-880c-aef6b2cd6fff None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:20.566293 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5715f3-cad3-4776-880c-aef6b2cd6fff None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:20.603336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7befe9c-90ee-41ab-b4e7-1e114f42a08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:20.604253 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7befe9c-90ee-41ab-b4e7-1e114f42a08a None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:20.604553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7befe9c-90ee-41ab-b4e7-1e114f42a08a None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:20.604843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7befe9c-90ee-41ab-b4e7-1e114f42a08a None admin] PATH_INFO: `/v3/users/3ff1942cd99e4aa0bce9ca2acc6614de` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:20.606144 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7befe9c-90ee-41ab-b4e7-1e114f42a08a None admin] RBAC: Authorizing `identity:get_user(user_id=3ff1942cd99e4aa0bce9ca2acc6614de)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:20.607628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7befe9c-90ee-41ab-b4e7-1e114f42a08a None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:20.609318 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 73/146] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:20 2022] GET /identity/v3/users/3ff1942cd99e4aa0bce9ca2acc6614de => generated 290 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:20.615518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc445a7-0c66-4d3b-9ad7-39f9539dd7db None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:20.749180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc445a7-0c66-4d3b-9ad7-39f9539dd7db None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:20.785023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2f1ba-7220-4965-b992-3b21ae1b62c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:20.786574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2f1ba-7220-4965-b992-3b21ae1b62c9 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:20.787166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2f1ba-7220-4965-b992-3b21ae1b62c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:20.787615 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2f1ba-7220-4965-b992-3b21ae1b62c9 None admin] PATH_INFO: `/v3/projects/327221ec271a4464b199d5dd0216670d` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:20.789071 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2f1ba-7220-4965-b992-3b21ae1b62c9 None admin] RBAC: Authorizing `identity:get_project(project_id=327221ec271a4464b199d5dd0216670d)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:20.791289 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2f1ba-7220-4965-b992-3b21ae1b62c9 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:20.793676 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 74/147] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:20 2022] GET /identity/v3/projects/327221ec271a4464b199d5dd0216670d => generated 299 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:20.799343 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7befe9c-90ee-41ab-b4e7-1e114f42a08a None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:20.826398 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af65fcb-c52e-423b-a3d1-a4741a58ddca None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:20.827065 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af65fcb-c52e-423b-a3d1-a4741a58ddca None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:20.827553 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af65fcb-c52e-423b-a3d1-a4741a58ddca None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:20.829272 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 75/148] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:20.835776 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05234995-5e05-4e30-b28d-fb1cb89c81a3 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:20.836704 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05234995-5e05-4e30-b28d-fb1cb89c81a3 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:20.837373 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05234995-5e05-4e30-b28d-fb1cb89c81a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:20.860547 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-05234995-5e05-4e30-b28d-fb1cb89c81a3 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:20.862078 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-05234995-5e05-4e30-b28d-fb1cb89c81a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:20.874428 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:20.876508 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:20.946906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7befe9c-90ee-41ab-b4e7-1e114f42a08a None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:20.952129 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 76/149] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:20.991982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ebb94-ab5a-46e7-86a9-fc21c99a9672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:20.992342 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05234995-5e05-4e30-b28d-fb1cb89c81a3 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:20.992928 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ebb94-ab5a-46e7-86a9-fc21c99a9672 None admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:20.993221 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ebb94-ab5a-46e7-86a9-fc21c99a9672 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:20.993510 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ebb94-ab5a-46e7-86a9-fc21c99a9672 None admin] PATH_INFO: `/v3/projects/327221ec271a4464b199d5dd0216670d/users/3ff1942cd99e4aa0bce9ca2acc6614de/roles/37be94aa89aa45db936809e7f660c225` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:20.996442 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ebb94-ab5a-46e7-86a9-fc21c99a9672 None admin] RBAC: Authorizing `identity:create_grant(project_id=327221ec271a4464b199d5dd0216670d, user_id=3ff1942cd99e4aa0bce9ca2acc6614de, role_id=37be94aa89aa45db936809e7f660c225)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:20.998016 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ebb94-ab5a-46e7-86a9-fc21c99a9672 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:21.094976 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 74/150] 10.222.0.119 () {58 vars in 1444 bytes} [Thu Jul 14 15:35:20 2022] PUT /identity/v3/projects/327221ec271a4464b199d5dd0216670d/users/3ff1942cd99e4aa0bce9ca2acc6614de/roles/37be94aa89aa45db936809e7f660c225 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:35:21.112637 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05234995-5e05-4e30-b28d-fb1cb89c81a3 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:21.154380 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2161b-13c6-4533-bc42-4e42eec52166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:21.155238 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2161b-13c6-4533-bc42-4e42eec52166 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:21.155531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2161b-13c6-4533-bc42-4e42eec52166 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:21.155818 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2161b-13c6-4533-bc42-4e42eec52166 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:21.169136 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2161b-13c6-4533-bc42-4e42eec52166 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:21.179114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-82f2161b-13c6-4533-bc42-4e42eec52166 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:35:21.179114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:21.179114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:21.179114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:21.179114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:21.179114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:21.179114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:21.179114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:21.179114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:21.179114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:21.179114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:21.179114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:21.179114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:21.179114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:21.179114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:21.179114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:21.180014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:21.180014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:21.180014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:21.180014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:21.180014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:21.180014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:21.180014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:21.180014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:21.180014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:21.180014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:21.180014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:21.180014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:21.180014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:21.180014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:21.180014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:21.180014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:21.180807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:21.180807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:21.180807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:21.180807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:21.180807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:21.180807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:21.180807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:21.180807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:21.180807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:21.180807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:21.180807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:35:21.180807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:35:21.180807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 77/151] 10.222.0.119 () {56 vars in 1119 bytes} [Thu Jul 14 15:35:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:35:21.187545 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ebb94-ab5a-46e7-86a9-fc21c99a9672 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:21.337271 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ebb94-ab5a-46e7-86a9-fc21c99a9672 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:21.340151 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:21.380276 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44abf19-388e-4780-9a38-ff84a0e4b6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:21.381035 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44abf19-388e-4780-9a38-ff84a0e4b6cd None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:21.381339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44abf19-388e-4780-9a38-ff84a0e4b6cd None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:21.381627 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44abf19-388e-4780-9a38-ff84a0e4b6cd None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:21.382399 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44abf19-388e-4780-9a38-ff84a0e4b6cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:21.382721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44abf19-388e-4780-9a38-ff84a0e4b6cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:21.384323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44abf19-388e-4780-9a38-ff84a0e4b6cd None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:21.396515 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 75/152] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:35:21 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:21.400038 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2161b-13c6-4533-bc42-4e42eec52166 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:21.403540 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:21.578307 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2161b-13c6-4533-bc42-4e42eec52166 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:21.621030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48120b3-651f-4d76-a73a-a50b50e2d97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:21.621918 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48120b3-651f-4d76-a73a-a50b50e2d97b None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:21.622205 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48120b3-651f-4d76-a73a-a50b50e2d97b None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:21.622477 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48120b3-651f-4d76-a73a-a50b50e2d97b None admin] PATH_INFO: `/v3/users/cdfa06df351a47d0a2012673e01f5556` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:21.624834 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48120b3-651f-4d76-a73a-a50b50e2d97b None admin] RBAC: Authorizing `identity:get_user(user_id=cdfa06df351a47d0a2012673e01f5556)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:21.626302 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48120b3-651f-4d76-a73a-a50b50e2d97b None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:21.627948 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 78/153] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:21 2022] GET /identity/v3/users/cdfa06df351a47d0a2012673e01f5556 => generated 276 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:21.634620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44abf19-388e-4780-9a38-ff84a0e4b6cd None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:21.775622 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44abf19-388e-4780-9a38-ff84a0e4b6cd None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:21.817537 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b63fa-4930-436a-b0e6-1e817cccf5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:21.818704 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b63fa-4930-436a-b0e6-1e817cccf5d3 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:21.819197 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b63fa-4930-436a-b0e6-1e817cccf5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:21.819693 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b63fa-4930-436a-b0e6-1e817cccf5d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:21.864135 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:21.912558 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b63fa-4930-436a-b0e6-1e817cccf5d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:21.914807 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b63fa-4930-436a-b0e6-1e817cccf5d3 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:22.019691 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 76/154] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:35:21 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:22.026552 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48120b3-651f-4d76-a73a-a50b50e2d97b None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:22.138887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:22.178442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48120b3-651f-4d76-a73a-a50b50e2d97b None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:22.225517 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee79122-d1eb-4df0-9eb6-10f6d9ca05a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:22.226394 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee79122-d1eb-4df0-9eb6-10f6d9ca05a3 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:22.226682 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee79122-d1eb-4df0-9eb6-10f6d9ca05a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:22.226963 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee79122-d1eb-4df0-9eb6-10f6d9ca05a3 None admin] PATH_INFO: `/v3/projects/327221ec271a4464b199d5dd0216670d` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:22.228202 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee79122-d1eb-4df0-9eb6-10f6d9ca05a3 None admin] RBAC: Authorizing `identity:get_project(project_id=327221ec271a4464b199d5dd0216670d)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:22.229683 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee79122-d1eb-4df0-9eb6-10f6d9ca05a3 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:22.231737 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 79/155] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:22 2022] GET /identity/v3/projects/327221ec271a4464b199d5dd0216670d => generated 299 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:22.237642 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b63fa-4930-436a-b0e6-1e817cccf5d3 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:22.306291 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0130e9-c8a7-49e3-bd7c-fb37c497c6ac None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:22.306623 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0130e9-c8a7-49e3-bd7c-fb37c497c6ac None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:22.306848 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0130e9-c8a7-49e3-bd7c-fb37c497c6ac None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:22.308570 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 80/156] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:22.313541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eff0fc-6c14-4114-81ae-3d36a217f15f None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:22.313833 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eff0fc-6c14-4114-81ae-3d36a217f15f None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:22.314116 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eff0fc-6c14-4114-81ae-3d36a217f15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:22.329647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:22.345118 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-f0eff0fc-6c14-4114-81ae-3d36a217f15f None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:22.346352 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f0eff0fc-6c14-4114-81ae-3d36a217f15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:22.391661 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b63fa-4930-436a-b0e6-1e817cccf5d3 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:22.450150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a167f8-e6f0-4710-ab6b-1b7594b3d99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:22.450793 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a167f8-e6f0-4710-ab6b-1b7594b3d99a None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:22.451088 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a167f8-e6f0-4710-ab6b-1b7594b3d99a None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:22.451370 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a167f8-e6f0-4710-ab6b-1b7594b3d99a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:22.452241 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a167f8-e6f0-4710-ab6b-1b7594b3d99a None admin] RBAC: Adding query filter params (role.id=71b77f014251450eac200e62300144ab, scope.project.id=327221ec271a4464b199d5dd0216670d, user.id=cdfa06df351a47d0a2012673e01f5556) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:22.452567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a167f8-e6f0-4710-ab6b-1b7594b3d99a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:22.454646 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a167f8-e6f0-4710-ab6b-1b7594b3d99a None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:22.467671 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 81/157] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:35:22.468253 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 77/158] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:35:22 2022] GET /identity/v3/role_assignments?user.id=cdfa06df351a47d0a2012673e01f5556&scope.project.id=327221ec271a4464b199d5dd0216670d&role.id=71b77f014251450eac200e62300144ab => generated 610 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:22.510957 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eff0fc-6c14-4114-81ae-3d36a217f15f None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:22.630428 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:22.669823 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eff0fc-6c14-4114-81ae-3d36a217f15f None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:22.708847 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39b687-5cfd-480c-aa91-268466a2d97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:22.709576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39b687-5cfd-480c-aa91-268466a2d97a None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:22.709858 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39b687-5cfd-480c-aa91-268466a2d97a None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:22.710133 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39b687-5cfd-480c-aa91-268466a2d97a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:22.728270 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39b687-5cfd-480c-aa91-268466a2d97a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:22.736499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-df39b687-5cfd-480c-aa91-268466a2d97a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:22.736499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:22.736499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:22.736499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:22.736499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:22.736499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:22.736499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:22.736499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:22.736499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:22.736499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:22.736499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:22.736499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:22.736499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:22.736499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:22.736499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:22.736499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:22.737357 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:22.737357 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:22.737357 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:22.737357 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:22.737357 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:22.737357 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:22.737357 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:22.737357 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:22.737357 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:22.737357 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:22.737357 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:22.737357 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:22.737357 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:22.737357 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:22.737357 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:22.737357 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:22.738197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:22.738197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:22.738197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:22.738197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:22.738197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:22.738197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:22.738197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:22.738197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:22.738197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:22.738197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:22.738197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:22.738197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:35:22.741509 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 82/159] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:22.747019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a167f8-e6f0-4710-ab6b-1b7594b3d99a None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:22.913726 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a167f8-e6f0-4710-ab6b-1b7594b3d99a None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:22.961043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:22.967313 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd9e3a-a118-4808-b88e-5a83882fd2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:22.968006 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd9e3a-a118-4808-b88e-5a83882fd2fc None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:22.968361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd9e3a-a118-4808-b88e-5a83882fd2fc None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:22.968647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd9e3a-a118-4808-b88e-5a83882fd2fc None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:22.969421 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd9e3a-a118-4808-b88e-5a83882fd2fc None admin] RBAC: Adding query filter params (name=member) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:22.969733 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd9e3a-a118-4808-b88e-5a83882fd2fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:22.971144 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd9e3a-a118-4808-b88e-5a83882fd2fc None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:22.983228 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 78/160] 10.222.0.119 () {56 vars in 1106 bytes} [Thu Jul 14 15:35:22 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:22.989866 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39b687-5cfd-480c-aa91-268466a2d97a None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:23.130635 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39b687-5cfd-480c-aa91-268466a2d97a None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:23.163201 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:23.172706 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ffb0f-7ba4-4bf7-9f14-30fa122d5240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:23.173645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ffb0f-7ba4-4bf7-9f14-30fa122d5240 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:23.173935 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ffb0f-7ba4-4bf7-9f14-30fa122d5240 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:23.174214 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ffb0f-7ba4-4bf7-9f14-30fa122d5240 None admin] PATH_INFO: `/v3/users/cdfa06df351a47d0a2012673e01f5556` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:23.175466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ffb0f-7ba4-4bf7-9f14-30fa122d5240 None admin] RBAC: Authorizing `identity:get_user(user_id=cdfa06df351a47d0a2012673e01f5556)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:23.177063 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ffb0f-7ba4-4bf7-9f14-30fa122d5240 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:23.178885 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 83/161] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:22 2022] GET /identity/v3/users/cdfa06df351a47d0a2012673e01f5556 => generated 276 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:23.184631 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd9e3a-a118-4808-b88e-5a83882fd2fc None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:23.327489 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd9e3a-a118-4808-b88e-5a83882fd2fc None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:23.374303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4d5b5-83be-42b4-a1df-8133c1252259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:23.375320 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4d5b5-83be-42b4-a1df-8133c1252259 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:23.375819 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4d5b5-83be-42b4-a1df-8133c1252259 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:23.376335 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4d5b5-83be-42b4-a1df-8133c1252259 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:23.445168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:23.454749 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d4d5b5-83be-42b4-a1df-8133c1252259 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:23.456238 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d4d5b5-83be-42b4-a1df-8133c1252259 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:23.607532 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 79/162] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:35:23 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:23.613601 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ffb0f-7ba4-4bf7-9f14-30fa122d5240 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:23.678050 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c128d5-d0d1-4466-b856-3067755b129f None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:23.678825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c128d5-d0d1-4466-b856-3067755b129f None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:23.679114 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c128d5-d0d1-4466-b856-3067755b129f None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:23.681240 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 80/163] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:23 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:23.687900 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63cbe9-e17a-471c-9eda-0091f872b0fa None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:23.688219 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63cbe9-e17a-471c-9eda-0091f872b0fa None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:23.688501 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63cbe9-e17a-471c-9eda-0091f872b0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:23.712932 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-5b63cbe9-e17a-471c-9eda-0091f872b0fa None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:23.714136 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-5b63cbe9-e17a-471c-9eda-0091f872b0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:23.761346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ffb0f-7ba4-4bf7-9f14-30fa122d5240 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:23.798320 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ca725-a3e4-4a1c-8cb4-8ea7576dc09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:23.799265 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ca725-a3e4-4a1c-8cb4-8ea7576dc09f None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:23.799553 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ca725-a3e4-4a1c-8cb4-8ea7576dc09f None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:23.799837 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ca725-a3e4-4a1c-8cb4-8ea7576dc09f None admin] PATH_INFO: `/v3/projects/327221ec271a4464b199d5dd0216670d` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:23.801102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ca725-a3e4-4a1c-8cb4-8ea7576dc09f None admin] RBAC: Authorizing `identity:get_project(project_id=327221ec271a4464b199d5dd0216670d)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:23.803250 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ca725-a3e4-4a1c-8cb4-8ea7576dc09f None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:23.809511 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 84/164] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:23 2022] GET /identity/v3/projects/327221ec271a4464b199d5dd0216670d => generated 299 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:23.811236 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ca725-a3e4-4a1c-8cb4-8ea7576dc09f None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:23.842200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 81/165] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:23.905138 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:23.941666 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63cbe9-e17a-471c-9eda-0091f872b0fa None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:23.952516 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ca725-a3e4-4a1c-8cb4-8ea7576dc09f None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:23.988713 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d523e2-ff3c-45a6-b70d-64f7601df914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:23.989501 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d523e2-ff3c-45a6-b70d-64f7601df914 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:23.989791 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d523e2-ff3c-45a6-b70d-64f7601df914 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:23.990121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d523e2-ff3c-45a6-b70d-64f7601df914 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:23.990242 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:23.990975 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d523e2-ff3c-45a6-b70d-64f7601df914 None admin] RBAC: Adding query filter params (role.id=14c8b3b550ba4f75a147b8851fd17c7c, scope.project.id=327221ec271a4464b199d5dd0216670d, user.id=cdfa06df351a47d0a2012673e01f5556) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:23.991294 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d523e2-ff3c-45a6-b70d-64f7601df914 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:23.992789 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d523e2-ff3c-45a6-b70d-64f7601df914 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:23.999586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 85/166] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:35:23 2022] GET /identity/v3/role_assignments?user.id=cdfa06df351a47d0a2012673e01f5556&scope.project.id=327221ec271a4464b199d5dd0216670d&role.id=14c8b3b550ba4f75a147b8851fd17c7c => generated 610 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:24.001633 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c8da5-d234-4183-a419-c697672f7933 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:24.002040 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c8da5-d234-4183-a419-c697672f7933 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:24.002329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c8da5-d234-4183-a419-c697672f7933 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:24.003753 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 86/167] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:35:24.010332 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4178011-9530-4f8f-b8bb-bc57490b241d None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:24.010689 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4178011-9530-4f8f-b8bb-bc57490b241d None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:24.010978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4178011-9530-4f8f-b8bb-bc57490b241d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:24.030969 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-b4178011-9530-4f8f-b8bb-bc57490b241d None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:24.032292 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-b4178011-9530-4f8f-b8bb-bc57490b241d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:24.112706 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 87/168] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:24 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:35:24.139495 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4178011-9530-4f8f-b8bb-bc57490b241d None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:24.207373 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:24.211174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63cbe9-e17a-471c-9eda-0091f872b0fa None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:24.253981 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4178011-9530-4f8f-b8bb-bc57490b241d None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:24.274672 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a746498-ab0a-45b5-884b-74206a7c048b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:24.275709 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a746498-ab0a-45b5-884b-74206a7c048b None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:24.276280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a746498-ab0a-45b5-884b-74206a7c048b None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:24.276756 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a746498-ab0a-45b5-884b-74206a7c048b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:24.293285 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a746498-ab0a-45b5-884b-74206a7c048b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:24.306870 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b7f63-a797-4175-9919-d13e47f55b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:24.308056 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b7f63-a797-4175-9919-d13e47f55b6c None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:24.308596 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b7f63-a797-4175-9919-d13e47f55b6c None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:24.308927 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-6a746498-ab0a-45b5-884b-74206a7c048b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:24.308927 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:24.308927 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:24.308927 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:24.308927 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:24.308927 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:24.308927 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:24.308927 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:24.308927 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:24.308927 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:24.308927 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:24.308927 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:24.308927 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:24.308927 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:24.308927 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:24.308927 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:24.310061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:24.310061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:24.310061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:24.310061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:24.310061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:24.310061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:24.310061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:24.310061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:24.310061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:24.310061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:24.310061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:24.310061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:24.310061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:24.310061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:24.310061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:24.310061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:24.310821 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:24.310821 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:24.310821 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:24.310821 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:24.310821 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:24.310821 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:24.310821 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:24.310821 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:24.310821 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:24.310821 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:24.310821 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:24.310821 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:24.311446 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 82/169] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:35:24.312083 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b7f63-a797-4175-9919-d13e47f55b6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:24.320127 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a746498-ab0a-45b5-884b-74206a7c048b None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:24.329003 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b7f63-a797-4175-9919-d13e47f55b6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:24.346469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-605b7f63-a797-4175-9919-d13e47f55b6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:35:24.346469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:24.346469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:24.346469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:24.346469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:24.346469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:24.346469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:24.346469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:24.346469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:24.346469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:24.346469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:24.346469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:24.346469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:24.346469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:24.346469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:24.346469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:24.347399 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:24.347399 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:24.347399 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:24.347399 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:24.347399 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:24.347399 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:24.347399 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:24.347399 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:24.347399 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:24.347399 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:24.347399 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:24.347399 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:24.347399 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:24.347399 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:24.347399 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:24.347399 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:24.348244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:24.348244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:24.348244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:24.348244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:24.348244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:24.348244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:24.348244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:24.348244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:24.348244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:24.348244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:24.348244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:35:24.348244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:35:24.354352 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 88/170] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:35:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:24.360343 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b7f63-a797-4175-9919-d13e47f55b6c None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:24.471495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:24.513972 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a746498-ab0a-45b5-884b-74206a7c048b None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:24.571994 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80489d-58ac-41c8-92d2-4f5356ccdbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:24.572717 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80489d-58ac-41c8-92d2-4f5356ccdbc0 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:24.573004 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80489d-58ac-41c8-92d2-4f5356ccdbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:24.573280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80489d-58ac-41c8-92d2-4f5356ccdbc0 None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:24.574044 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80489d-58ac-41c8-92d2-4f5356ccdbc0 None admin] RBAC: Adding query filter params (name=member) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:24.574390 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80489d-58ac-41c8-92d2-4f5356ccdbc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:24.575850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80489d-58ac-41c8-92d2-4f5356ccdbc0 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:24.590781 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 83/171] 10.222.0.119 () {56 vars in 1106 bytes} [Thu Jul 14 15:35:24 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:24.596033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80489d-58ac-41c8-92d2-4f5356ccdbc0 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:24.599801 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b7f63-a797-4175-9919-d13e47f55b6c None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:24.641477 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:24.716855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca9dc7-3c5f-475c-9c31-397d93baf366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:24.717555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca9dc7-3c5f-475c-9c31-397d93baf366 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:24.717848 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca9dc7-3c5f-475c-9c31-397d93baf366 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:24.718132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca9dc7-3c5f-475c-9c31-397d93baf366 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:24.718905 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca9dc7-3c5f-475c-9c31-397d93baf366 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:24.719219 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca9dc7-3c5f-475c-9c31-397d93baf366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:24.720675 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca9dc7-3c5f-475c-9c31-397d93baf366 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:24.735794 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 89/172] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:24 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:24.741293 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca9dc7-3c5f-475c-9c31-397d93baf366 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:24.765883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80489d-58ac-41c8-92d2-4f5356ccdbc0 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:24.821750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03c5aa-18d4-4b23-af63-6e501c1f6d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:24.822912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03c5aa-18d4-4b23-af63-6e501c1f6d79 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:24.823340 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03c5aa-18d4-4b23-af63-6e501c1f6d79 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:24.823779 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03c5aa-18d4-4b23-af63-6e501c1f6d79 None admin] PATH_INFO: `/v3/users/cdfa06df351a47d0a2012673e01f5556` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:24.828851 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03c5aa-18d4-4b23-af63-6e501c1f6d79 None admin] RBAC: Authorizing `identity:get_user(user_id=cdfa06df351a47d0a2012673e01f5556)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:24.830482 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03c5aa-18d4-4b23-af63-6e501c1f6d79 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:24.832661 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 84/173] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:24 2022] GET /identity/v3/users/cdfa06df351a47d0a2012673e01f5556 => generated 276 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:24.838355 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03c5aa-18d4-4b23-af63-6e501c1f6d79 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:24.873858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:24.971247 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca9dc7-3c5f-475c-9c31-397d93baf366 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:25.006631 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03c5aa-18d4-4b23-af63-6e501c1f6d79 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:25.043870 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03eb80e-9e0d-4cf7-b977-432f149cf74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:25.044794 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03eb80e-9e0d-4cf7-b977-432f149cf74e None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:25.045083 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03eb80e-9e0d-4cf7-b977-432f149cf74e None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:25.045365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03eb80e-9e0d-4cf7-b977-432f149cf74e None admin] PATH_INFO: `/v3/users/558923a0ab794e4fab69165d8d72902b` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:25.046578 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03eb80e-9e0d-4cf7-b977-432f149cf74e None admin] RBAC: Authorizing `identity:get_user(user_id=558923a0ab794e4fab69165d8d72902b)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:25.048254 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03eb80e-9e0d-4cf7-b977-432f149cf74e None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:25.050050 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 90/174] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:24 2022] GET /identity/v3/users/558923a0ab794e4fab69165d8d72902b => generated 248 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:25.051434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fb164-aa34-4bff-b1c2-fc12c6d7d44a None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:25.057088 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fb164-aa34-4bff-b1c2-fc12c6d7d44a None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:25.057602 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fb164-aa34-4bff-b1c2-fc12c6d7d44a None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:25.059198 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 91/175] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:25 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:25.060077 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fb164-aa34-4bff-b1c2-fc12c6d7d44a None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:25.084941 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deeeeb8-6a88-4fcf-84ce-e06766a181c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:25.085624 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deeeeb8-6a88-4fcf-84ce-e06766a181c3 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:25.085917 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deeeeb8-6a88-4fcf-84ce-e06766a181c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:25.086203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deeeeb8-6a88-4fcf-84ce-e06766a181c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:25.117889 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:25.173642 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fb164-aa34-4bff-b1c2-fc12c6d7d44a None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:25.183970 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deeeeb8-6a88-4fcf-84ce-e06766a181c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:25.186674 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deeeeb8-6a88-4fcf-84ce-e06766a181c3 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:25.205699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:25.211573 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649168a5-5e97-4904-8ba7-083a2da362f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:25.212475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649168a5-5e97-4904-8ba7-083a2da362f3 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:25.212760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649168a5-5e97-4904-8ba7-083a2da362f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:25.213188 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649168a5-5e97-4904-8ba7-083a2da362f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:25.290448 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649168a5-5e97-4904-8ba7-083a2da362f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:25.292321 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649168a5-5e97-4904-8ba7-083a2da362f3 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:25.313874 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 85/176] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:35:24 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 15:35:25.315432 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da390b54-6d0c-40fe-90cf-65737a13a133 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:25.315914 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da390b54-6d0c-40fe-90cf-65737a13a133 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:25.316391 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da390b54-6d0c-40fe-90cf-65737a13a133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:25.334442 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-da390b54-6d0c-40fe-90cf-65737a13a133 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:25.336032 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-da390b54-6d0c-40fe-90cf-65737a13a133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:25.351287 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:25.411675 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 92/177] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:35:25 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:25.418582 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbe6c4-ae9d-462c-a578-8e36b573d8de None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:25.418873 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbe6c4-ae9d-462c-a578-8e36b573d8de None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:25.419151 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbe6c4-ae9d-462c-a578-8e36b573d8de None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:25.420946 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 93/178] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:25 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:25.421817 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbbe6c4-ae9d-462c-a578-8e36b573d8de None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:25.423638 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 86/179] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:25 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:25.425272 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69328b80-41ea-47a6-b215-53ca56af4b82 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:25.425564 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69328b80-41ea-47a6-b215-53ca56af4b82 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:25.425851 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69328b80-41ea-47a6-b215-53ca56af4b82 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:25.427583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 87/180] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:25.427938 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69328b80-41ea-47a6-b215-53ca56af4b82 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:25.484081 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:25.549893 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69328b80-41ea-47a6-b215-53ca56af4b82 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:25.559874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbbe6c4-ae9d-462c-a578-8e36b573d8de None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:25.588037 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6eb35-a71b-4e68-a379-9b24d7241e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:25.588933 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6eb35-a71b-4e68-a379-9b24d7241e6d None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:25.589223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6eb35-a71b-4e68-a379-9b24d7241e6d None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:25.589754 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6eb35-a71b-4e68-a379-9b24d7241e6d None admin] PATH_INFO: `/v3/projects/327221ec271a4464b199d5dd0216670d` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:25.591126 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6eb35-a71b-4e68-a379-9b24d7241e6d None admin] RBAC: Authorizing `identity:get_project(project_id=327221ec271a4464b199d5dd0216670d)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:25.592626 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6eb35-a71b-4e68-a379-9b24d7241e6d None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:25.594471 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 88/181] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:25 2022] GET /identity/v3/projects/327221ec271a4464b199d5dd0216670d => generated 299 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:25.595685 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06b5d0-8a45-44a5-aa28-769add656b98 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:25.595974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06b5d0-8a45-44a5-aa28-769add656b98 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:25.596282 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06b5d0-8a45-44a5-aa28-769add656b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:25.605849 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ecd62-2b87-4dc2-808f-7b865835f26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:25.607066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ecd62-2b87-4dc2-808f-7b865835f26a None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:25.607586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ecd62-2b87-4dc2-808f-7b865835f26a None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:25.608073 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ecd62-2b87-4dc2-808f-7b865835f26a None admin] PATH_INFO: `/v3/projects/38131d7edd584745836526884a3487e6` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:25.609490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ecd62-2b87-4dc2-808f-7b865835f26a None admin] RBAC: Authorizing `identity:get_project(project_id=38131d7edd584745836526884a3487e6)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:25.611266 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ecd62-2b87-4dc2-808f-7b865835f26a None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:25.612954 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-4f06b5d0-8a45-44a5-aa28-769add656b98 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:25.613753 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 94/182] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:25 2022] GET /identity/v3/projects/38131d7edd584745836526884a3487e6 => generated 313 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:25.614358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-4f06b5d0-8a45-44a5-aa28-769add656b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:25.615588 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe8303-dcb6-40cb-bc21-f64b1d0f06d3 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:25.616066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe8303-dcb6-40cb-bc21-f64b1d0f06d3 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:25.616595 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe8303-dcb6-40cb-bc21-f64b1d0f06d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:25.637764 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-76fe8303-dcb6-40cb-bc21-f64b1d0f06d3 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:25.638976 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-76fe8303-dcb6-40cb-bc21-f64b1d0f06d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:25.651442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:25.692964 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 89/183] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:25 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:25.693808 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06b5d0-8a45-44a5-aa28-769add656b98 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:25.717005 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 95/184] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:25 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:25.717005 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe8303-dcb6-40cb-bc21-f64b1d0f06d3 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:25.751718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:25.823702 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06b5d0-8a45-44a5-aa28-769add656b98 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:25.836675 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe8303-dcb6-40cb-bc21-f64b1d0f06d3 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:25.859013 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99b3ce-7afb-4841-85d6-c51856da2f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:25.859806 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99b3ce-7afb-4841-85d6-c51856da2f0a None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:25.860090 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99b3ce-7afb-4841-85d6-c51856da2f0a None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:25.860389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99b3ce-7afb-4841-85d6-c51856da2f0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:25.870538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99b3ce-7afb-4841-85d6-c51856da2f0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:25.872602 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e36156-f90f-4024-8228-df5222a38f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:25.873264 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e36156-f90f-4024-8228-df5222a38f49 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:25.873556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e36156-f90f-4024-8228-df5222a38f49 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:25.873840 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e36156-f90f-4024-8228-df5222a38f49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:25.874702 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e36156-f90f-4024-8228-df5222a38f49 None admin] RBAC: Adding query filter params (role.id=07aaf007cde043318319928d151bdc75, scope.project.id=327221ec271a4464b199d5dd0216670d, user.id=558923a0ab794e4fab69165d8d72902b) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:25.875021 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e36156-f90f-4024-8228-df5222a38f49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:25.876505 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e36156-f90f-4024-8228-df5222a38f49 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:25.878252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-1f99b3ce-7afb-4841-85d6-c51856da2f0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:35:25.878252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:25.878252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:25.878252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:25.878252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:25.878252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:25.878252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:25.878252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:25.878252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:25.878252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:25.878252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:25.878252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:25.878252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:25.878252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:25.878252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:25.878252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:25.879253 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:25.879253 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:25.879253 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:25.879253 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:25.879253 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:25.879253 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:25.879253 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:25.879253 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:25.879253 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:25.879253 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:25.879253 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:25.879253 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:25.879253 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:25.879253 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:25.879253 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:25.879253 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:25.881175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:25.881175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:25.881175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:25.881175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:25.881175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:25.881175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:25.881175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:25.881175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:25.881175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:25.881175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:25.881175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:35:25.881175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:25.881175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 90/185] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:35:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:25.881175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99b3ce-7afb-4841-85d6-c51856da2f0a None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:25.889330 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 96/186] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:35:25 2022] GET /identity/v3/role_assignments?user.id=558923a0ab794e4fab69165d8d72902b&scope.project.id=327221ec271a4464b199d5dd0216670d&role.id=07aaf007cde043318319928d151bdc75 => generated 610 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:25.890584 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c191a76-565f-40d9-9fc8-470fbe2b0829 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:25.890870 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c191a76-565f-40d9-9fc8-470fbe2b0829 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:25.891145 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c191a76-565f-40d9-9fc8-470fbe2b0829 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:25.892393 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 97/187] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:25.893090 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c191a76-565f-40d9-9fc8-470fbe2b0829 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:25.919188 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:25.997139 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:26.000937 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99b3ce-7afb-4841-85d6-c51856da2f0a None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:26.023650 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c191a76-565f-40d9-9fc8-470fbe2b0829 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:26.043594 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82dd416-4c9d-4fe4-8199-20d2a70f891a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:26.044365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dd416-4c9d-4fe4-8199-20d2a70f891a None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:26.044596 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dd416-4c9d-4fe4-8199-20d2a70f891a None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:26.045894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dd416-4c9d-4fe4-8199-20d2a70f891a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:26.045894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82dd416-4c9d-4fe4-8199-20d2a70f891a None admin] RBAC: Adding query filter params (role.id=14c8b3b550ba4f75a147b8851fd17c7c, scope.project.id=38131d7edd584745836526884a3487e6, user.id=cdfa06df351a47d0a2012673e01f5556) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:26.046057 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82dd416-4c9d-4fe4-8199-20d2a70f891a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:26.047985 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82dd416-4c9d-4fe4-8199-20d2a70f891a None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:26.055746 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 91/188] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:35:25 2022] GET /identity/v3/role_assignments?user.id=cdfa06df351a47d0a2012673e01f5556&scope.project.id=38131d7edd584745836526884a3487e6&role.id=14c8b3b550ba4f75a147b8851fd17c7c => generated 610 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:26.056607 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82dd416-4c9d-4fe4-8199-20d2a70f891a None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:26.068936 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb625b6-56e7-4144-8958-e944dfaa60f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:26.069772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb625b6-56e7-4144-8958-e944dfaa60f0 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:26.070067 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb625b6-56e7-4144-8958-e944dfaa60f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:26.070353 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb625b6-56e7-4144-8958-e944dfaa60f0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:26.086943 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb625b6-56e7-4144-8958-e944dfaa60f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:26.095684 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-1cb625b6-56e7-4144-8958-e944dfaa60f0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:35:26.095684 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:26.095684 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:26.095684 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:26.095684 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:26.095684 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:26.095684 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:26.095684 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:26.095684 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:26.095684 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:26.095684 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:26.095684 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:26.095684 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:26.095684 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:26.095684 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:26.095684 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:26.096692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:26.096692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:26.096692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:26.096692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:26.096692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:26.096692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:26.096692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:26.096692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:26.096692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:26.096692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:26.096692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:26.096692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:26.096692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:26.096692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:26.096692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:26.096692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:26.097490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:26.097490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:26.097490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:26.097490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:26.097490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:26.097490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:26.097490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:26.097490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:26.097490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:26.097490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:26.097490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:35:26.097490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:35:26.098318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 98/189] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:26.098973 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb625b6-56e7-4144-8958-e944dfaa60f0 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:26.193792 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82dd416-4c9d-4fe4-8199-20d2a70f891a None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:26.197383 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:26.232342 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb625b6-56e7-4144-8958-e944dfaa60f0 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:26.235297 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ede5b4-d4b2-4d87-841e-16674b687973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:26.235297 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ede5b4-d4b2-4d87-841e-16674b687973 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:26.235297 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ede5b4-d4b2-4d87-841e-16674b687973 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:26.235664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ede5b4-d4b2-4d87-841e-16674b687973 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:26.248484 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ede5b4-d4b2-4d87-841e-16674b687973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:26.257383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-60ede5b4-d4b2-4d87-841e-16674b687973 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:35:26.257383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:26.257383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:26.257383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:26.257383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:26.257383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:26.257383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:26.257383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:26.257383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:26.257383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:26.257383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:26.257383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:26.257383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:26.257383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:26.257383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:26.257383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:26.258365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:26.258365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:26.258365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:26.258365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:26.258365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:26.258365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:26.258365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:26.258365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:26.258365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:26.258365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:26.258365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:26.258365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:26.258365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:26.258365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:26.258365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:26.258365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:26.259140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:26.259140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:26.259140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:26.259140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:26.259140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:26.259140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:26.259140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:26.259140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:26.259140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:26.259140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:26.259140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:35:26.259140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:26.259140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 92/190] 10.222.0.119 () {56 vars in 1119 bytes} [Thu Jul 14 15:35:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:26.259932 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9141823-7b7a-4936-b944-080750adf964 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:26.260321 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9141823-7b7a-4936-b944-080750adf964 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:26.260604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9141823-7b7a-4936-b944-080750adf964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:26.280635 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20930a-d0a6-4240-81f2-228725d6d8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:26.281575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20930a-d0a6-4240-81f2-228725d6d8b0 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:26.282011 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20930a-d0a6-4240-81f2-228725d6d8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:26.282440 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20930a-d0a6-4240-81f2-228725d6d8b0 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:26.282593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-d9141823-7b7a-4936-b944-080750adf964 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:26.283346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20930a-d0a6-4240-81f2-228725d6d8b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:26.283664 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20930a-d0a6-4240-81f2-228725d6d8b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:26.283806 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-d9141823-7b7a-4936-b944-080750adf964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:26.285097 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20930a-d0a6-4240-81f2-228725d6d8b0 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:26.295384 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 99/191] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:26 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:26.296326 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20930a-d0a6-4240-81f2-228725d6d8b0 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:26.307179 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:26.360187 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 93/192] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:26.360187 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9141823-7b7a-4936-b944-080750adf964 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:26.405103 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20930a-d0a6-4240-81f2-228725d6d8b0 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:26.435109 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:26.440823 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c19739-4ab4-41be-b9bd-49eb9a6da0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:26.441799 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c19739-4ab4-41be-b9bd-49eb9a6da0f5 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:26.442216 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c19739-4ab4-41be-b9bd-49eb9a6da0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:26.442547 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c19739-4ab4-41be-b9bd-49eb9a6da0f5 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:26.443344 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c19739-4ab4-41be-b9bd-49eb9a6da0f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:26.443702 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c19739-4ab4-41be-b9bd-49eb9a6da0f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:26.445587 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c19739-4ab4-41be-b9bd-49eb9a6da0f5 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:26.455137 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 100/193] 10.222.0.119 () {56 vars in 1106 bytes} [Thu Jul 14 15:35:26 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:26.455967 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c19739-4ab4-41be-b9bd-49eb9a6da0f5 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:26.456239 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9141823-7b7a-4936-b944-080750adf964 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:26.492453 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a256c9-2d9e-4e6e-9b61-f15e01ee114c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:26.493163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a256c9-2d9e-4e6e-9b61-f15e01ee114c None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:26.493456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a256c9-2d9e-4e6e-9b61-f15e01ee114c None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:26.493739 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a256c9-2d9e-4e6e-9b61-f15e01ee114c None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:26.494494 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a256c9-2d9e-4e6e-9b61-f15e01ee114c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:26.494806 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a256c9-2d9e-4e6e-9b61-f15e01ee114c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:26.496207 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a256c9-2d9e-4e6e-9b61-f15e01ee114c None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:26.504338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 94/194] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:35:26 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:26.504338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a256c9-2d9e-4e6e-9b61-f15e01ee114c None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:26.525164 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:26.563227 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c19739-4ab4-41be-b9bd-49eb9a6da0f5 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:26.597626 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b20175-f7fb-429e-9a30-0c5e24239895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:26.598630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b20175-f7fb-429e-9a30-0c5e24239895 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:26.598917 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b20175-f7fb-429e-9a30-0c5e24239895 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:26.599370 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b20175-f7fb-429e-9a30-0c5e24239895 None admin] PATH_INFO: `/v3/users/6c6d4eb601b9493089bb4eff75051c56` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:26.605192 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a256c9-2d9e-4e6e-9b61-f15e01ee114c None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:26.613194 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b20175-f7fb-429e-9a30-0c5e24239895 None admin] RBAC: Authorizing `identity:get_user(user_id=6c6d4eb601b9493089bb4eff75051c56)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:26.615225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b20175-f7fb-429e-9a30-0c5e24239895 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:26.617126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 101/195] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:26 2022] GET /identity/v3/users/6c6d4eb601b9493089bb4eff75051c56 => generated 284 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:26.617690 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b20175-f7fb-429e-9a30-0c5e24239895 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:26.641860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a584d-ad3a-41fb-bc20-edf7141db019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:26.642750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a584d-ad3a-41fb-bc20-edf7141db019 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:26.643109 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a584d-ad3a-41fb-bc20-edf7141db019 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:26.643393 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a584d-ad3a-41fb-bc20-edf7141db019 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:26.644593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a584d-ad3a-41fb-bc20-edf7141db019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:26.646124 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a584d-ad3a-41fb-bc20-edf7141db019 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:26.647751 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 95/196] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:35:26 2022] GET /identity/v3/domains/default => generated 200 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:26.652276 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a584d-ad3a-41fb-bc20-edf7141db019 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:26.670215 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:26.718986 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b20175-f7fb-429e-9a30-0c5e24239895 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:26.734494 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:26.750050 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a584d-ad3a-41fb-bc20-edf7141db019 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:26.752262 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72f5ef-d1a8-4efe-b6bf-d487efdfaa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:26.753143 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72f5ef-d1a8-4efe-b6bf-d487efdfaa07 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:26.753428 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72f5ef-d1a8-4efe-b6bf-d487efdfaa07 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:26.753703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72f5ef-d1a8-4efe-b6bf-d487efdfaa07 None admin] PATH_INFO: `/v3/users/3ff1942cd99e4aa0bce9ca2acc6614de` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:26.755036 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72f5ef-d1a8-4efe-b6bf-d487efdfaa07 None admin] RBAC: Authorizing `identity:get_user(user_id=3ff1942cd99e4aa0bce9ca2acc6614de)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:26.756532 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72f5ef-d1a8-4efe-b6bf-d487efdfaa07 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:26.758301 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 102/197] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:26 2022] GET /identity/v3/users/3ff1942cd99e4aa0bce9ca2acc6614de => generated 290 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:26.763035 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72f5ef-d1a8-4efe-b6bf-d487efdfaa07 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:26.784017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28021f-4a57-4226-87ef-9b83588cc890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:26.784933 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28021f-4a57-4226-87ef-9b83588cc890 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:26.785219 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28021f-4a57-4226-87ef-9b83588cc890 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:26.785499 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28021f-4a57-4226-87ef-9b83588cc890 None admin] PATH_INFO: `/v3/users/6c6d4eb601b9493089bb4eff75051c56` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:26.786853 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28021f-4a57-4226-87ef-9b83588cc890 None admin] RBAC: Authorizing `identity:get_user(user_id=6c6d4eb601b9493089bb4eff75051c56)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:26.788322 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28021f-4a57-4226-87ef-9b83588cc890 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:26.789957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 96/198] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:26 2022] GET /identity/v3/users/6c6d4eb601b9493089bb4eff75051c56 => generated 284 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:26.789957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28021f-4a57-4226-87ef-9b83588cc890 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:26.863283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72f5ef-d1a8-4efe-b6bf-d487efdfaa07 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:26.884175 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:26.891040 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28021f-4a57-4226-87ef-9b83588cc890 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:26.899679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f09081-1f99-4503-a672-093c342a0201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:26.899679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f09081-1f99-4503-a672-093c342a0201 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:26.900510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f09081-1f99-4503-a672-093c342a0201 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:26.900510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f09081-1f99-4503-a672-093c342a0201 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:26.925808 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cd051-3969-447d-8b01-b9f93a408c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:26.926493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cd051-3969-447d-8b01-b9f93a408c14 None admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:26.927490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cd051-3969-447d-8b01-b9f93a408c14 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:26.927781 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cd051-3969-447d-8b01-b9f93a408c14 None admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:26.928536 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9cd051-3969-447d-8b01-b9f93a408c14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:26.929993 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9cd051-3969-447d-8b01-b9f93a408c14 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:26.969842 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f09081-1f99-4503-a672-093c342a0201 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:26.971313 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f09081-1f99-4503-a672-093c342a0201 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:27.018830 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 97/199] 10.222.0.119 () {60 vars in 1137 bytes} [Thu Jul 14 15:35:26 2022] POST /identity/v3/users => generated 298 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:35:27.019663 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cd051-3969-447d-8b01-b9f93a408c14 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:27.031127 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:27.092576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 103/200] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:35:26 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:27.092576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f09081-1f99-4503-a672-093c342a0201 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:27.116431 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:27.135823 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cd051-3969-447d-8b01-b9f93a408c14 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:27.179292 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fce18-64ea-44f7-a94c-5fa53fc36395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:27.179992 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fce18-64ea-44f7-a94c-5fa53fc36395 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:27.180353 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fce18-64ea-44f7-a94c-5fa53fc36395 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:27.180581 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fce18-64ea-44f7-a94c-5fa53fc36395 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:27.211513 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f09081-1f99-4503-a672-093c342a0201 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:27.249695 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebfc525-c163-4a24-8121-b3beb8a56d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:27.250356 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfc525-c163-4a24-8121-b3beb8a56d41 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:27.250644 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfc525-c163-4a24-8121-b3beb8a56d41 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:27.250920 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfc525-c163-4a24-8121-b3beb8a56d41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:27.271766 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fce18-64ea-44f7-a94c-5fa53fc36395 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:27.273411 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fce18-64ea-44f7-a94c-5fa53fc36395 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:27.285602 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:27.341228 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebfc525-c163-4a24-8121-b3beb8a56d41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:27.342724 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebfc525-c163-4a24-8121-b3beb8a56d41 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:27.370187 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:27.409791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 98/201] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:35:27 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:27.410775 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fce18-64ea-44f7-a94c-5fa53fc36395 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:27.469858 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 104/202] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:35:27 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:27.470877 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebfc525-c163-4a24-8121-b3beb8a56d41 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:27.543921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fce18-64ea-44f7-a94c-5fa53fc36395 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:27.555918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:27.587793 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86144e-3a61-464e-b25f-6f2b22f8d813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:27.588803 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86144e-3a61-464e-b25f-6f2b22f8d813 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:27.589100 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86144e-3a61-464e-b25f-6f2b22f8d813 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:27.589381 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86144e-3a61-464e-b25f-6f2b22f8d813 None admin] PATH_INFO: `/v3/projects/af3a7f407f014d858258455b61892383` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:27.590962 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86144e-3a61-464e-b25f-6f2b22f8d813 None admin] RBAC: Authorizing `identity:get_project(project_id=af3a7f407f014d858258455b61892383)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:27.592471 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86144e-3a61-464e-b25f-6f2b22f8d813 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:27.594597 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 99/203] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:27 2022] GET /identity/v3/projects/af3a7f407f014d858258455b61892383 => generated 303 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:27.600552 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebfc525-c163-4a24-8121-b3beb8a56d41 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:27.600827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86144e-3a61-464e-b25f-6f2b22f8d813 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:27.626404 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:27.648699 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5e32f-496d-4dfe-bd7d-d4a4620cfadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:27.649645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5e32f-496d-4dfe-bd7d-d4a4620cfadf None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:27.649921 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5e32f-496d-4dfe-bd7d-d4a4620cfadf None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:27.650204 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5e32f-496d-4dfe-bd7d-d4a4620cfadf None admin] PATH_INFO: `/v3/projects/327221ec271a4464b199d5dd0216670d` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:27.651975 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5e32f-496d-4dfe-bd7d-d4a4620cfadf None admin] RBAC: Authorizing `identity:get_project(project_id=327221ec271a4464b199d5dd0216670d)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:27.653843 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5e32f-496d-4dfe-bd7d-d4a4620cfadf None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:27.656248 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 105/204] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:27 2022] GET /identity/v3/projects/327221ec271a4464b199d5dd0216670d => generated 299 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:27.657354 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5e32f-496d-4dfe-bd7d-d4a4620cfadf None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:27.732844 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86144e-3a61-464e-b25f-6f2b22f8d813 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:27.769063 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5e32f-496d-4dfe-bd7d-d4a4620cfadf None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:27.769553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6b276-a095-4a78-9b52-9d45250cce16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:27.770601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6b276-a095-4a78-9b52-9d45250cce16 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:27.771100 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6b276-a095-4a78-9b52-9d45250cce16 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:27.771584 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6b276-a095-4a78-9b52-9d45250cce16 None admin] PATH_INFO: `/v3/projects/af3a7f407f014d858258455b61892383` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:27.773543 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6b276-a095-4a78-9b52-9d45250cce16 None admin] RBAC: Authorizing `identity:get_project(project_id=af3a7f407f014d858258455b61892383)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:27.774378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6b276-a095-4a78-9b52-9d45250cce16 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:27.776434 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 100/205] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:27 2022] GET /identity/v3/projects/af3a7f407f014d858258455b61892383 => generated 303 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:27.777200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6b276-a095-4a78-9b52-9d45250cce16 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:27.808780 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b2493-2ced-40c8-b663-c0f8f6481b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:27.809941 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b2493-2ced-40c8-b663-c0f8f6481b3b None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:27.810453 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b2493-2ced-40c8-b663-c0f8f6481b3b None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:27.810925 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b2493-2ced-40c8-b663-c0f8f6481b3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:27.812001 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b2493-2ced-40c8-b663-c0f8f6481b3b None admin] RBAC: Adding query filter params (role.id=07aaf007cde043318319928d151bdc75, scope.project.id=af3a7f407f014d858258455b61892383, user.id=6c6d4eb601b9493089bb4eff75051c56) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:27.812656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b2493-2ced-40c8-b663-c0f8f6481b3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:27.814412 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b2493-2ced-40c8-b663-c0f8f6481b3b None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:27.821470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 106/206] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:35:27 2022] GET /identity/v3/role_assignments?user.id=6c6d4eb601b9493089bb4eff75051c56&scope.project.id=af3a7f407f014d858258455b61892383&role.id=07aaf007cde043318319928d151bdc75 => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:27.822766 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b2493-2ced-40c8-b663-c0f8f6481b3b None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:27.843862 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:27.961474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:27.974677 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6b276-a095-4a78-9b52-9d45250cce16 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:28.023776 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83cac1-c678-40a1-8852-7e530562a911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:28.024564 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83cac1-c678-40a1-8852-7e530562a911 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:28.024939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83cac1-c678-40a1-8852-7e530562a911 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:28.025256 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83cac1-c678-40a1-8852-7e530562a911 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:28.026164 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83cac1-c678-40a1-8852-7e530562a911 None admin] RBAC: Adding query filter params (role.id=37be94aa89aa45db936809e7f660c225, scope.project.id=327221ec271a4464b199d5dd0216670d, user.id=3ff1942cd99e4aa0bce9ca2acc6614de) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:28.026682 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83cac1-c678-40a1-8852-7e530562a911 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:28.028423 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83cac1-c678-40a1-8852-7e530562a911 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:28.034581 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b2493-2ced-40c8-b663-c0f8f6481b3b None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:28.035059 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 101/207] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:35:27 2022] GET /identity/v3/role_assignments?user.id=3ff1942cd99e4aa0bce9ca2acc6614de&scope.project.id=327221ec271a4464b199d5dd0216670d&role.id=37be94aa89aa45db936809e7f660c225 => generated 610 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:28.079868 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ab188-a3e0-4776-a531-c8b045dfdd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:28.080837 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ab188-a3e0-4776-a531-c8b045dfdd12 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:28.081278 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ab188-a3e0-4776-a531-c8b045dfdd12 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:28.081726 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ab188-a3e0-4776-a531-c8b045dfdd12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:28.082747 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ab188-a3e0-4776-a531-c8b045dfdd12 None admin] RBAC: Adding query filter params (role.id=71b77f014251450eac200e62300144ab, scope.project.id=af3a7f407f014d858258455b61892383, user.id=6c6d4eb601b9493089bb4eff75051c56) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:28.083792 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ab188-a3e0-4776-a531-c8b045dfdd12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:28.085482 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ab188-a3e0-4776-a531-c8b045dfdd12 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:28.092435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 107/208] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:35:27 2022] GET /identity/v3/role_assignments?user.id=6c6d4eb601b9493089bb4eff75051c56&scope.project.id=af3a7f407f014d858258455b61892383&role.id=71b77f014251450eac200e62300144ab => generated 260 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:29.291958 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae1e5f-f6f1-49cc-a457-596af0cda93e None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:29.292492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae1e5f-f6f1-49cc-a457-596af0cda93e None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:29.292568 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae1e5f-f6f1-49cc-a457-596af0cda93e None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:29.294275 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 102/209] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:29.299650 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cd168-19f6-44a6-bef7-164c7ecf62fb None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:29.300045 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cd168-19f6-44a6-bef7-164c7ecf62fb None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:29.300258 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cd168-19f6-44a6-bef7-164c7ecf62fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:29.305417 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7e026-6eb6-4aa0-995f-9cefe14018f2 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:29.305706 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7e026-6eb6-4aa0-995f-9cefe14018f2 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:29.305987 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7e026-6eb6-4aa0-995f-9cefe14018f2 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:29.307521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 103/210] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:35:29.313144 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4740de5-586f-4c71-89b7-913709961dc8 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:29.313550 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4740de5-586f-4c71-89b7-913709961dc8 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:29.314251 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4740de5-586f-4c71-89b7-913709961dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:29.320291 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-352cd168-19f6-44a6-bef7-164c7ecf62fb None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:29.321497 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-352cd168-19f6-44a6-bef7-164c7ecf62fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:29.332178 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-f4740de5-586f-4c71-89b7-913709961dc8 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:29.334105 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-f4740de5-586f-4c71-89b7-913709961dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:29.409158 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 108/211] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:29.422672 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 104/212] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:35:29.434719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cd168-19f6-44a6-bef7-164c7ecf62fb None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:29.446919 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4740de5-586f-4c71-89b7-913709961dc8 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:29.488335 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:29.496452 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:29.567593 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cd168-19f6-44a6-bef7-164c7ecf62fb None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:29.572740 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4740de5-586f-4c71-89b7-913709961dc8 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:29.609647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865ffb0-1319-4ed6-879c-9c266478a506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:29.610456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865ffb0-1319-4ed6-879c-9c266478a506 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:29.610742 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865ffb0-1319-4ed6-879c-9c266478a506 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:29.611017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865ffb0-1319-4ed6-879c-9c266478a506 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:29.612222 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865ffb0-1319-4ed6-879c-9c266478a506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:29.613769 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865ffb0-1319-4ed6-879c-9c266478a506 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:29.615994 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a740908-942d-4c3a-823a-58143eb234ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:29.616261 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 105/213] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:35:29 2022] GET /identity/v3/domains/default => generated 200 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:29.617454 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a740908-942d-4c3a-823a-58143eb234ae None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:29.617945 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a740908-942d-4c3a-823a-58143eb234ae None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:29.618435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a740908-942d-4c3a-823a-58143eb234ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:29.621638 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865ffb0-1319-4ed6-879c-9c266478a506 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:29.632027 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a740908-942d-4c3a-823a-58143eb234ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:29.642637 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-9a740908-942d-4c3a-823a-58143eb234ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:29.642637 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:29.642637 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:29.642637 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:29.642637 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:29.642637 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:29.642637 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:29.642637 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:29.642637 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:29.642637 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:29.642637 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:29.642637 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:29.642637 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:29.642637 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:29.642637 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:29.642637 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:29.643510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:29.643510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:29.643510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:29.643510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:29.643510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:29.643510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:29.643510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:29.643510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:29.643510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:29.643510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:29.643510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:29.643510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:29.643510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:29.643510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:29.643510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:29.643510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:29.644350 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:29.644350 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:29.644350 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:29.644350 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:29.644350 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:29.644350 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:29.644350 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:29.644350 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:29.644350 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:29.644350 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:29.644350 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:29.644350 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:35:29.647727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 109/214] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:29.657575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a740908-942d-4c3a-823a-58143eb234ae None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:29.743460 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865ffb0-1319-4ed6-879c-9c266478a506 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:29.752465 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:29.782253 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a740908-942d-4c3a-823a-58143eb234ae None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:29.788044 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf2ad4-5d0f-4879-9b6c-107edb91bd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:29.788918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf2ad4-5d0f-4879-9b6c-107edb91bd95 None admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:29.789308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf2ad4-5d0f-4879-9b6c-107edb91bd95 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:29.789686 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf2ad4-5d0f-4879-9b6c-107edb91bd95 None admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:29.790521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf2ad4-5d0f-4879-9b6c-107edb91bd95 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:29.792280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf2ad4-5d0f-4879-9b6c-107edb91bd95 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:29.793013 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:29.835040 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c5a11-db5e-40c7-b296-fecc86c19496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:29.835724 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c5a11-db5e-40c7-b296-fecc86c19496 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:29.836008 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c5a11-db5e-40c7-b296-fecc86c19496 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:29.836310 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c5a11-db5e-40c7-b296-fecc86c19496 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:29.837065 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c5a11-db5e-40c7-b296-fecc86c19496 None admin] RBAC: Adding query filter params (name=member) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:29.837441 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c5a11-db5e-40c7-b296-fecc86c19496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:29.839131 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c5a11-db5e-40c7-b296-fecc86c19496 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:29.855142 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 110/215] 10.222.0.119 () {56 vars in 1106 bytes} [Thu Jul 14 15:35:29 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:29.856448 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c5a11-db5e-40c7-b296-fecc86c19496 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:29.890147 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 106/216] 10.222.0.119 () {60 vars in 1137 bytes} [Thu Jul 14 15:35:29 2022] POST /identity/v3/users => generated 298 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:35:29.978767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c5a11-db5e-40c7-b296-fecc86c19496 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:30.020196 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c277ac-76b5-48e7-ac91-58280a5dddae None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:30.020620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c277ac-76b5-48e7-ac91-58280a5dddae None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:30.020906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c277ac-76b5-48e7-ac91-58280a5dddae None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:30.021391 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baed19e-f90f-4a9e-9c47-e5f9d1bba248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:30.022292 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baed19e-f90f-4a9e-9c47-e5f9d1bba248 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:30.022584 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baed19e-f90f-4a9e-9c47-e5f9d1bba248 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:30.022691 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 107/217] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:35:30.022867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baed19e-f90f-4a9e-9c47-e5f9d1bba248 None admin] PATH_INFO: `/v3/users/be23a8f9fa7842a3bedeb8ae9e66163b` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:30.028548 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f564c0-f2c6-47db-9bfa-e8168c43ce53 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:30.028838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f564c0-f2c6-47db-9bfa-e8168c43ce53 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:30.029120 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f564c0-f2c6-47db-9bfa-e8168c43ce53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:30.040605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baed19e-f90f-4a9e-9c47-e5f9d1bba248 None admin] RBAC: Authorizing `identity:get_user(user_id=be23a8f9fa7842a3bedeb8ae9e66163b)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:30.042634 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baed19e-f90f-4a9e-9c47-e5f9d1bba248 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:30.045148 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 111/218] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:29 2022] GET /identity/v3/users/be23a8f9fa7842a3bedeb8ae9e66163b => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:30.050647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-c7f564c0-f2c6-47db-9bfa-e8168c43ce53 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:30.050928 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baed19e-f90f-4a9e-9c47-e5f9d1bba248 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:30.052007 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-c7f564c0-f2c6-47db-9bfa-e8168c43ce53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:30.089328 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:30.154031 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 108/219] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:30.176552 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baed19e-f90f-4a9e-9c47-e5f9d1bba248 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:30.180994 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f564c0-f2c6-47db-9bfa-e8168c43ce53 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:30.219461 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de836128-a795-408a-87fe-83d9e9b15f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:30.220468 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de836128-a795-408a-87fe-83d9e9b15f1f None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:30.220929 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de836128-a795-408a-87fe-83d9e9b15f1f None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:30.221378 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de836128-a795-408a-87fe-83d9e9b15f1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:30.293249 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:30.306435 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f564c0-f2c6-47db-9bfa-e8168c43ce53 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:30.312445 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de836128-a795-408a-87fe-83d9e9b15f1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:30.312445 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de836128-a795-408a-87fe-83d9e9b15f1f None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:30.347088 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:30.349302 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ecaf2-1aff-4497-aa11-aeb68b454d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:30.350121 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ecaf2-1aff-4497-aa11-aeb68b454d49 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:30.350409 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ecaf2-1aff-4497-aa11-aeb68b454d49 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:30.350688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ecaf2-1aff-4497-aa11-aeb68b454d49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:30.361584 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ecaf2-1aff-4497-aa11-aeb68b454d49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:30.370368 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-b69ecaf2-1aff-4497-aa11-aeb68b454d49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:35:30.370368 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:30.370368 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:30.370368 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:30.370368 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:30.370368 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:30.370368 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:30.370368 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:30.370368 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:30.370368 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:30.370368 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:30.370368 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:30.370368 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:30.370368 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:30.370368 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:30.370368 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:30.371373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:30.371373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:30.371373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:30.371373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:30.371373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:30.371373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:30.371373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:30.371373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:30.371373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:30.371373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:30.371373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:30.371373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:30.371373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:30.371373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:30.371373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:30.371373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:30.372190 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:30.372190 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:30.372190 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:30.372190 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:30.372190 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:30.372190 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:30.372190 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:30.372190 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:30.372190 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:30.372190 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:30.372190 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:35:30.372190 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:30.374595 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 109/220] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:35:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:35:30.376366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d42b3-9f41-46b6-8f2c-345af498889a None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:30.376366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d42b3-9f41-46b6-8f2c-345af498889a None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:30.376631 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d42b3-9f41-46b6-8f2c-345af498889a None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:30.377993 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 110/221] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:30.378700 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d42b3-9f41-46b6-8f2c-345af498889a None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:30.435568 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 112/222] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:35:30 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 15:35:30.436909 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f398c-2060-4dff-8527-47f1b6922dfb None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:30.437259 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f398c-2060-4dff-8527-47f1b6922dfb None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:30.437493 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f398c-2060-4dff-8527-47f1b6922dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:30.455087 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-632f398c-2060-4dff-8527-47f1b6922dfb None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:30.456346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-632f398c-2060-4dff-8527-47f1b6922dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:30.514100 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d42b3-9f41-46b6-8f2c-345af498889a None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:30.553504 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dfa3a-b97f-40a8-94a1-2983a8d41e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:30.554179 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dfa3a-b97f-40a8-94a1-2983a8d41e88 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:30.554468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dfa3a-b97f-40a8-94a1-2983a8d41e88 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:30.554765 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dfa3a-b97f-40a8-94a1-2983a8d41e88 None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:30.555592 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2dfa3a-b97f-40a8-94a1-2983a8d41e88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:30.555902 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2dfa3a-b97f-40a8-94a1-2983a8d41e88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:30.556693 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 113/223] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:30.557451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2dfa3a-b97f-40a8-94a1-2983a8d41e88 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:30.557977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f398c-2060-4dff-8527-47f1b6922dfb None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:30.580422 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 111/224] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:30 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:30.585414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dfa3a-b97f-40a8-94a1-2983a8d41e88 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:30.601384 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:30.651243 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:30.695354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dfa3a-b97f-40a8-94a1-2983a8d41e88 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:30.699547 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f398c-2060-4dff-8527-47f1b6922dfb None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:30.734560 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4134b-c79d-434a-8d38-f733c7563006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:30.735771 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4134b-c79d-434a-8d38-f733c7563006 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:30.736618 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4134b-c79d-434a-8d38-f733c7563006 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:30.737002 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4134b-c79d-434a-8d38-f733c7563006 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:30.746240 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6473b75-1f35-4264-808c-52f5ddc80622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:30.747981 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6473b75-1f35-4264-808c-52f5ddc80622 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:30.748439 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6473b75-1f35-4264-808c-52f5ddc80622 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:30.748863 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6473b75-1f35-4264-808c-52f5ddc80622 None admin] PATH_INFO: `/v3/projects/af3a7f407f014d858258455b61892383` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:30.750569 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6473b75-1f35-4264-808c-52f5ddc80622 None admin] RBAC: Authorizing `identity:get_project(project_id=af3a7f407f014d858258455b61892383)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:30.751136 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd4134b-c79d-434a-8d38-f733c7563006 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:30.752385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6473b75-1f35-4264-808c-52f5ddc80622 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:30.754254 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 114/225] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:30 2022] GET /identity/v3/projects/af3a7f407f014d858258455b61892383 => generated 303 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:30.755234 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6473b75-1f35-4264-808c-52f5ddc80622 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:30.768520 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-bfd4134b-c79d-434a-8d38-f733c7563006 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:35:30.768520 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:30.768520 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:30.768520 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:30.768520 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:30.768520 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:30.768520 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:30.768520 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:30.768520 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:30.768520 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:30.768520 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:30.768520 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:30.768520 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:30.768520 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:30.768520 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:30.768520 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:30.769490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:30.769490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:30.769490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:30.769490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:30.769490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:30.769490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:30.769490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:30.769490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:30.769490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:30.769490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:30.769490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:30.769490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:30.769490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:30.769490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:30.769490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:30.769490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:30.770311 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:30.770311 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:30.770311 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:30.770311 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:30.770311 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:30.770311 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:30.770311 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:30.770311 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:30.770311 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:30.770311 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:30.770311 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:35:30.770311 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:30.771124 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 112/226] 10.222.0.119 () {56 vars in 1119 bytes} [Thu Jul 14 15:35:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:30.772148 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4134b-c79d-434a-8d38-f733c7563006 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:30.925926 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6473b75-1f35-4264-808c-52f5ddc80622 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:30.935718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:30.963003 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:30.975108 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4134b-c79d-434a-8d38-f733c7563006 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:30.978453 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585a7ae-edef-4b8c-8fd0-95c10cf6c70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:30.979679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585a7ae-edef-4b8c-8fd0-95c10cf6c70e None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:30.980199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585a7ae-edef-4b8c-8fd0-95c10cf6c70e None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:30.980740 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585a7ae-edef-4b8c-8fd0-95c10cf6c70e None admin] PATH_INFO: `/v3/users/6c6d4eb601b9493089bb4eff75051c56` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:30.982209 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585a7ae-edef-4b8c-8fd0-95c10cf6c70e None admin] RBAC: Authorizing `identity:get_user(user_id=6c6d4eb601b9493089bb4eff75051c56)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:30.984620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585a7ae-edef-4b8c-8fd0-95c10cf6c70e None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:30.992146 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 115/227] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:30 2022] GET /identity/v3/users/6c6d4eb601b9493089bb4eff75051c56 => generated 284 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:30.992146 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585a7ae-edef-4b8c-8fd0-95c10cf6c70e None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:31.022500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cad03-ab41-475e-aca3-d954533673dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:31.023623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cad03-ab41-475e-aca3-d954533673dd None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:31.024217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cad03-ab41-475e-aca3-d954533673dd None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:31.024698 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cad03-ab41-475e-aca3-d954533673dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:31.025735 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7cad03-ab41-475e-aca3-d954533673dd None admin] RBAC: Adding query filter params (role.id=14c8b3b550ba4f75a147b8851fd17c7c, scope.project.id=af3a7f407f014d858258455b61892383, user.id=be23a8f9fa7842a3bedeb8ae9e66163b) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:31.026384 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7cad03-ab41-475e-aca3-d954533673dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:31.028273 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7cad03-ab41-475e-aca3-d954533673dd None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:31.034882 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 113/228] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:35:30 2022] GET /identity/v3/role_assignments?user.id=be23a8f9fa7842a3bedeb8ae9e66163b&scope.project.id=af3a7f407f014d858258455b61892383&role.id=14c8b3b550ba4f75a147b8851fd17c7c => generated 260 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:31.036035 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cad03-ab41-475e-aca3-d954533673dd None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:31.188791 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585a7ae-edef-4b8c-8fd0-95c10cf6c70e None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:31.246989 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cad03-ab41-475e-aca3-d954533673dd None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:31.254742 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80337227-f34f-46c7-9e01-572a7ff4923d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:31.256509 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80337227-f34f-46c7-9e01-572a7ff4923d None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:31.256629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80337227-f34f-46c7-9e01-572a7ff4923d None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:31.256994 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80337227-f34f-46c7-9e01-572a7ff4923d None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:31.257856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80337227-f34f-46c7-9e01-572a7ff4923d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:31.258464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80337227-f34f-46c7-9e01-572a7ff4923d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:31.259948 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80337227-f34f-46c7-9e01-572a7ff4923d None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:31.269844 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 116/229] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:35:30 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:31.278337 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80337227-f34f-46c7-9e01-572a7ff4923d None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:31.294405 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2bea8-c915-47ae-aa8b-6801f356546b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:31.295292 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2bea8-c915-47ae-aa8b-6801f356546b None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:31.295580 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2bea8-c915-47ae-aa8b-6801f356546b None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:31.295859 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2bea8-c915-47ae-aa8b-6801f356546b None admin] PATH_INFO: `/v3/projects/af3a7f407f014d858258455b61892383` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:31.297109 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d2bea8-c915-47ae-aa8b-6801f356546b None admin] RBAC: Authorizing `identity:get_project(project_id=af3a7f407f014d858258455b61892383)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:31.298586 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d2bea8-c915-47ae-aa8b-6801f356546b None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:31.300411 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 114/230] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:31 2022] GET /identity/v3/projects/af3a7f407f014d858258455b61892383 => generated 303 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:31.315597 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2bea8-c915-47ae-aa8b-6801f356546b None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:31.330728 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:31.394623 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:31.445848 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2bea8-c915-47ae-aa8b-6801f356546b None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:31.486875 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89918ea7-3fea-4b57-960e-fe9cc033b30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:31.486875 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89918ea7-3fea-4b57-960e-fe9cc033b30e None admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:31.486875 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89918ea7-3fea-4b57-960e-fe9cc033b30e None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:31.486875 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89918ea7-3fea-4b57-960e-fe9cc033b30e None admin] PATH_INFO: `/v3/projects/af3a7f407f014d858258455b61892383/users/6c6d4eb601b9493089bb4eff75051c56/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:31.492120 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89918ea7-3fea-4b57-960e-fe9cc033b30e None admin] RBAC: Authorizing `identity:create_grant(project_id=af3a7f407f014d858258455b61892383, user_id=6c6d4eb601b9493089bb4eff75051c56, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:31.492120 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89918ea7-3fea-4b57-960e-fe9cc033b30e None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:31.497219 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80337227-f34f-46c7-9e01-572a7ff4923d None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:31.539983 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03408a90-54fc-46cb-982c-14c72d974505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:31.541073 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03408a90-54fc-46cb-982c-14c72d974505 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:31.541415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03408a90-54fc-46cb-982c-14c72d974505 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:31.541698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03408a90-54fc-46cb-982c-14c72d974505 None admin] PATH_INFO: `/v3/users/6c6d4eb601b9493089bb4eff75051c56` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:31.543032 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03408a90-54fc-46cb-982c-14c72d974505 None admin] RBAC: Authorizing `identity:get_user(user_id=6c6d4eb601b9493089bb4eff75051c56)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:31.544598 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03408a90-54fc-46cb-982c-14c72d974505 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:31.546816 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 117/231] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:31 2022] GET /identity/v3/users/6c6d4eb601b9493089bb4eff75051c56 => generated 284 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:31.552385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03408a90-54fc-46cb-982c-14c72d974505 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:31.602332 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 115/232] 10.222.0.119 () {58 vars in 1444 bytes} [Thu Jul 14 15:35:31 2022] PUT /identity/v3/projects/af3a7f407f014d858258455b61892383/users/6c6d4eb601b9493089bb4eff75051c56/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:35:31.688594 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03408a90-54fc-46cb-982c-14c72d974505 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:31.735877 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:31.743862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e83891-b2cb-4d60-9768-e04c3d01cb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:31.746656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e83891-b2cb-4d60-9768-e04c3d01cb11 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:31.746656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e83891-b2cb-4d60-9768-e04c3d01cb11 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:31.746656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e83891-b2cb-4d60-9768-e04c3d01cb11 None admin] PATH_INFO: `/v3/projects/af3a7f407f014d858258455b61892383` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:31.748987 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e83891-b2cb-4d60-9768-e04c3d01cb11 None admin] RBAC: Authorizing `identity:get_project(project_id=af3a7f407f014d858258455b61892383)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:31.750493 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e83891-b2cb-4d60-9768-e04c3d01cb11 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:31.752869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 118/233] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:31 2022] GET /identity/v3/projects/af3a7f407f014d858258455b61892383 => generated 303 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:31.761864 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89918ea7-3fea-4b57-960e-fe9cc033b30e None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:31.836879 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:31.874135 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89918ea7-3fea-4b57-960e-fe9cc033b30e None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:31.909802 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e4779-8ab2-4c9c-8587-53b60df42f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:31.910708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e4779-8ab2-4c9c-8587-53b60df42f04 None admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:31.911001 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e4779-8ab2-4c9c-8587-53b60df42f04 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:31.911545 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e4779-8ab2-4c9c-8587-53b60df42f04 None admin] PATH_INFO: `/v3/projects/af3a7f407f014d858258455b61892383/users/6c6d4eb601b9493089bb4eff75051c56/roles/71b77f014251450eac200e62300144ab` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:31.913898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e4779-8ab2-4c9c-8587-53b60df42f04 None admin] RBAC: Authorizing `identity:create_grant(project_id=af3a7f407f014d858258455b61892383, user_id=6c6d4eb601b9493089bb4eff75051c56, role_id=71b77f014251450eac200e62300144ab)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:31.915346 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e4779-8ab2-4c9c-8587-53b60df42f04 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:32.008655 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 116/234] 10.222.0.119 () {58 vars in 1444 bytes} [Thu Jul 14 15:35:31 2022] PUT /identity/v3/projects/af3a7f407f014d858258455b61892383/users/6c6d4eb601b9493089bb4eff75051c56/roles/71b77f014251450eac200e62300144ab => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:35:32.350873 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102291c-f723-48f7-be3e-f594dca0c8e8 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:32.351234 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102291c-f723-48f7-be3e-f594dca0c8e8 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:32.351440 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102291c-f723-48f7-be3e-f594dca0c8e8 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:32.353055 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 119/235] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:32.359140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea2f6e-2632-42af-a681-55493d676f1a None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:32.359597 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea2f6e-2632-42af-a681-55493d676f1a None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:32.359804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea2f6e-2632-42af-a681-55493d676f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:32.379260 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-62ea2f6e-2632-42af-a681-55493d676f1a None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:32.381324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-62ea2f6e-2632-42af-a681-55493d676f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:32.466783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 117/236] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:32.508964 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102291c-f723-48f7-be3e-f594dca0c8e8 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:32.641841 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102291c-f723-48f7-be3e-f594dca0c8e8 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:32.647413 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b4495-aad7-4c56-9932-c1d80c1bbe1c None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:32.647975 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b4495-aad7-4c56-9932-c1d80c1bbe1c None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:32.648507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b4495-aad7-4c56-9932-c1d80c1bbe1c None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:32.650090 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 118/237] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:32.655411 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b7c0f-ce74-4629-aa90-b7c9bbbef382 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:32.655944 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b7c0f-ce74-4629-aa90-b7c9bbbef382 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:32.656466 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b7c0f-ce74-4629-aa90-b7c9bbbef382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:32.682216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-286b7c0f-ce74-4629-aa90-b7c9bbbef382 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:32.684424 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-286b7c0f-ce74-4629-aa90-b7c9bbbef382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:32.699336 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f4e08-ecfb-4c6c-bcf1-d95dfe9218fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:32.700529 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f4e08-ecfb-4c6c-bcf1-d95dfe9218fc None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:32.701052 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f4e08-ecfb-4c6c-bcf1-d95dfe9218fc None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:32.701528 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f4e08-ecfb-4c6c-bcf1-d95dfe9218fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:32.719728 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f4e08-ecfb-4c6c-bcf1-d95dfe9218fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:32.729629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-ef2f4e08-ecfb-4c6c-bcf1-d95dfe9218fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:35:32.729629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:32.729629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:32.729629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:32.729629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:32.729629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:32.729629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:32.729629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:32.729629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:32.729629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:32.729629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:32.729629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:32.729629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:32.729629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:32.729629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:32.729629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:32.730522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:32.730522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:32.730522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:32.730522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:32.730522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:32.730522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:32.730522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:32.730522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:32.730522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:32.730522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:32.730522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:32.730522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:32.730522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:32.730522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:32.730522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:32.730522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:32.731333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:32.731333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:32.731333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:32.731333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:32.731333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:32.731333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:32.731333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:32.731333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:32.731333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:32.731333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:32.731333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:35:32.731333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:35:32.734132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 120/238] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:32.742586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f4e08-ecfb-4c6c-bcf1-d95dfe9218fc None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:32.792742 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:32.829665 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 119/239] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:35:32.840672 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:32.870565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b7c0f-ce74-4629-aa90-b7c9bbbef382 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:32.924039 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f4e08-ecfb-4c6c-bcf1-d95dfe9218fc None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:33.002010 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bfe473-915d-4e9a-8097-472418469c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:33.002689 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfe473-915d-4e9a-8097-472418469c27 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:33.002974 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfe473-915d-4e9a-8097-472418469c27 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:33.003251 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfe473-915d-4e9a-8097-472418469c27 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:33.004018 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bfe473-915d-4e9a-8097-472418469c27 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:33.004348 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bfe473-915d-4e9a-8097-472418469c27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:33.005852 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bfe473-915d-4e9a-8097-472418469c27 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:33.020783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b7c0f-ce74-4629-aa90-b7c9bbbef382 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:33.023085 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 121/240] 10.222.0.119 () {56 vars in 1106 bytes} [Thu Jul 14 15:35:32 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:33.024073 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bfe473-915d-4e9a-8097-472418469c27 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:33.084202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f466ec4-d86a-4ac2-9a56-610946241a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:33.085011 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f466ec4-d86a-4ac2-9a56-610946241a03 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:33.085293 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f466ec4-d86a-4ac2-9a56-610946241a03 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:33.085569 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f466ec4-d86a-4ac2-9a56-610946241a03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:33.087404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f466ec4-d86a-4ac2-9a56-610946241a03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:33.088893 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f466ec4-d86a-4ac2-9a56-610946241a03 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:33.090951 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 120/241] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:35:32 2022] GET /identity/v3/domains/default => generated 200 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:33.096283 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f466ec4-d86a-4ac2-9a56-610946241a03 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:33.164301 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bfe473-915d-4e9a-8097-472418469c27 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:33.180242 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:33.190814 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:33.205010 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c740c-efd4-44a6-b4ce-4aa87c367540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:33.205990 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c740c-efd4-44a6-b4ce-4aa87c367540 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:33.206353 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c740c-efd4-44a6-b4ce-4aa87c367540 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:33.206706 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c740c-efd4-44a6-b4ce-4aa87c367540 None admin] PATH_INFO: `/v3/users/56cccf1fdb6a431a863e657e499d619a` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:33.224994 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c740c-efd4-44a6-b4ce-4aa87c367540 None admin] RBAC: Authorizing `identity:get_user(user_id=56cccf1fdb6a431a863e657e499d619a)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:33.226777 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c740c-efd4-44a6-b4ce-4aa87c367540 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:33.229185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 122/242] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:33 2022] GET /identity/v3/users/56cccf1fdb6a431a863e657e499d619a => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:33.234856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c740c-efd4-44a6-b4ce-4aa87c367540 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:33.300488 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f466ec4-d86a-4ac2-9a56-610946241a03 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:33.370593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17801d2-0c8f-4264-ae6e-59ecddbfd6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:33.372112 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17801d2-0c8f-4264-ae6e-59ecddbfd6f4 None admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:33.372601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17801d2-0c8f-4264-ae6e-59ecddbfd6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:33.373081 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17801d2-0c8f-4264-ae6e-59ecddbfd6f4 None admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:33.374199 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17801d2-0c8f-4264-ae6e-59ecddbfd6f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:33.376863 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17801d2-0c8f-4264-ae6e-59ecddbfd6f4 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:33.395129 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c740c-efd4-44a6-b4ce-4aa87c367540 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:33.433251 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcec2ef-3542-4389-9980-58706112737b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:33.434281 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcec2ef-3542-4389-9980-58706112737b None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:33.434842 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcec2ef-3542-4389-9980-58706112737b None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:33.435316 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcec2ef-3542-4389-9980-58706112737b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:33.466019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 121/243] 10.222.0.119 () {60 vars in 1137 bytes} [Thu Jul 14 15:35:33 2022] POST /identity/v3/users => generated 294 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:35:33.478530 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:33.531685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcec2ef-3542-4389-9980-58706112737b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:33.533252 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcec2ef-3542-4389-9980-58706112737b None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:33.601797 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a365e2-fb76-4099-8886-8407153e837d None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:33.602126 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a365e2-fb76-4099-8886-8407153e837d None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:33.602364 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a365e2-fb76-4099-8886-8407153e837d None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:33.605313 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 122/244] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:33 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:33.617350 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd48232-1471-44f8-9ae8-478446c31d56 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:33.617677 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd48232-1471-44f8-9ae8-478446c31d56 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:33.617916 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd48232-1471-44f8-9ae8-478446c31d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:33.640710 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-6fd48232-1471-44f8-9ae8-478446c31d56 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:33.641924 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-6fd48232-1471-44f8-9ae8-478446c31d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:33.686638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 123/245] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:35:33 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 15:35:33.692116 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcec2ef-3542-4389-9980-58706112737b None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:33.739594 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 123/246] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:33.763858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd48232-1471-44f8-9ae8-478446c31d56 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:33.772155 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:33.804978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcec2ef-3542-4389-9980-58706112737b None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:33.809699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:33.845593 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfab3a8-4436-4310-8695-27d6f0332b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:33.846275 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfab3a8-4436-4310-8695-27d6f0332b20 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:33.846562 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfab3a8-4436-4310-8695-27d6f0332b20 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:33.846839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfab3a8-4436-4310-8695-27d6f0332b20 None admin] PATH_INFO: `/v3/projects/af3a7f407f014d858258455b61892383` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:33.848378 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfab3a8-4436-4310-8695-27d6f0332b20 None admin] RBAC: Authorizing `identity:get_project(project_id=af3a7f407f014d858258455b61892383)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:33.850507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfab3a8-4436-4310-8695-27d6f0332b20 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:33.852411 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 124/247] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:33 2022] GET /identity/v3/projects/af3a7f407f014d858258455b61892383 => generated 303 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:33.860274 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfab3a8-4436-4310-8695-27d6f0332b20 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:33.874243 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd48232-1471-44f8-9ae8-478446c31d56 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:33.925194 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fc66e-530e-4200-b5c6-ed10f1a047c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:33.926329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fc66e-530e-4200-b5c6-ed10f1a047c4 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:33.926931 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fc66e-530e-4200-b5c6-ed10f1a047c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:33.927460 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fc66e-530e-4200-b5c6-ed10f1a047c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:33.942118 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012fc66e-530e-4200-b5c6-ed10f1a047c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:33.952954 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-012fc66e-530e-4200-b5c6-ed10f1a047c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:33.952954 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:33.952954 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:33.952954 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:33.952954 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:33.952954 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:33.952954 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:33.952954 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:33.952954 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:33.952954 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:33.952954 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:33.952954 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:33.952954 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:33.952954 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:33.952954 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:33.952954 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:33.953888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:33.953888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:33.953888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:33.953888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:33.953888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:33.953888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:33.953888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:33.953888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:33.953888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:33.953888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:33.953888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:33.953888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:33.953888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:33.953888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:33.953888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:33.953888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:33.954681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:33.954681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:33.954681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:33.954681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:33.954681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:33.954681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:33.954681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:33.954681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:33.954681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:33.954681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:33.954681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:33.954681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:33.959596 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 124/248] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:33.966410 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fc66e-530e-4200-b5c6-ed10f1a047c4 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:33.999822 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfab3a8-4436-4310-8695-27d6f0332b20 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:34.046980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508665f-da2c-4d92-a793-5d1913b729dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:34.047647 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508665f-da2c-4d92-a793-5d1913b729dc None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:34.047934 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508665f-da2c-4d92-a793-5d1913b729dc None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:34.048242 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508665f-da2c-4d92-a793-5d1913b729dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:34.049083 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508665f-da2c-4d92-a793-5d1913b729dc None admin] RBAC: Adding query filter params (role.id=37be94aa89aa45db936809e7f660c225, scope.project.id=af3a7f407f014d858258455b61892383, user.id=56cccf1fdb6a431a863e657e499d619a) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:34.049397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508665f-da2c-4d92-a793-5d1913b729dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:34.051008 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508665f-da2c-4d92-a793-5d1913b729dc None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:34.058067 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 125/249] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:35:33 2022] GET /identity/v3/role_assignments?user.id=56cccf1fdb6a431a863e657e499d619a&scope.project.id=af3a7f407f014d858258455b61892383&role.id=37be94aa89aa45db936809e7f660c225 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:34.059171 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdb35d-32d7-453b-a895-3298dd78199a None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:34.059462 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdb35d-32d7-453b-a895-3298dd78199a None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:34.059797 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdb35d-32d7-453b-a895-3298dd78199a None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:34.061472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 126/250] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:34.070118 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5e83b-5a18-4152-9c29-8eb971f25771 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:34.070437 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5e83b-5a18-4152-9c29-8eb971f25771 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:34.070698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5e83b-5a18-4152-9c29-8eb971f25771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:34.076757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:34.092459 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-fde5e83b-5a18-4152-9c29-8eb971f25771 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:34.094003 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-fde5e83b-5a18-4152-9c29-8eb971f25771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:34.102622 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:34.107803 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fc66e-530e-4200-b5c6-ed10f1a047c4 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:34.159903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480f2a7-2081-42df-b309-a2b65a6a8ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:34.160667 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480f2a7-2081-42df-b309-a2b65a6a8ad7 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:34.161009 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480f2a7-2081-42df-b309-a2b65a6a8ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:34.161794 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480f2a7-2081-42df-b309-a2b65a6a8ad7 None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:34.162612 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480f2a7-2081-42df-b309-a2b65a6a8ad7 None admin] RBAC: Adding query filter params (name=member) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:34.163021 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480f2a7-2081-42df-b309-a2b65a6a8ad7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:34.164433 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480f2a7-2081-42df-b309-a2b65a6a8ad7 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:34.174367 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 125/251] 10.222.0.119 () {56 vars in 1106 bytes} [Thu Jul 14 15:35:33 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:34.180553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480f2a7-2081-42df-b309-a2b65a6a8ad7 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:34.195122 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 127/252] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:34.264391 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5e83b-5a18-4152-9c29-8eb971f25771 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:34.330248 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480f2a7-2081-42df-b309-a2b65a6a8ad7 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:34.388429 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5e83b-5a18-4152-9c29-8eb971f25771 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:34.409654 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a867d-690c-4863-8b2b-ca880c6ca77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:34.410606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a867d-690c-4863-8b2b-ca880c6ca77e None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:34.410897 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a867d-690c-4863-8b2b-ca880c6ca77e None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:34.413508 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a867d-690c-4863-8b2b-ca880c6ca77e None admin] PATH_INFO: `/v3/users/be23a8f9fa7842a3bedeb8ae9e66163b` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:34.415566 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a867d-690c-4863-8b2b-ca880c6ca77e None admin] RBAC: Authorizing `identity:get_user(user_id=be23a8f9fa7842a3bedeb8ae9e66163b)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:34.417064 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a867d-690c-4863-8b2b-ca880c6ca77e None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:34.418758 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 126/253] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:34 2022] GET /identity/v3/users/be23a8f9fa7842a3bedeb8ae9e66163b => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:34.425181 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a867d-690c-4863-8b2b-ca880c6ca77e None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:34.447979 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:34.456897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662803b7-f2a1-428c-834c-56b16aa1dc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:34.457848 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662803b7-f2a1-428c-834c-56b16aa1dc9d None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:34.458248 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662803b7-f2a1-428c-834c-56b16aa1dc9d None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:34.460127 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662803b7-f2a1-428c-834c-56b16aa1dc9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:34.486607 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662803b7-f2a1-428c-834c-56b16aa1dc9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:34.490962 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:34.504719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-662803b7-f2a1-428c-834c-56b16aa1dc9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:35:34.504719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:34.504719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:34.504719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:34.504719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:34.504719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:34.504719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:34.504719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:34.504719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:34.504719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:34.504719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:34.504719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:34.504719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:34.504719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:34.504719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:34.504719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:34.506338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:34.506338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:34.506338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:34.506338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:34.506338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:34.506338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:34.506338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:34.506338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:34.506338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:34.506338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:34.506338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:34.506338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:34.506338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:34.506338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:34.506338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:34.506338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:34.507124 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:34.507124 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:34.507124 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:34.507124 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:34.507124 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:34.507124 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:34.507124 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:34.507124 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:34.507124 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:34.507124 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:34.507124 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:35:34.507124 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:35:34.511250 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 128/254] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:35:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:34.515045 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662803b7-f2a1-428c-834c-56b16aa1dc9d None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:34.625651 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a867d-690c-4863-8b2b-ca880c6ca77e None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:34.685385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662803b7-f2a1-428c-834c-56b16aa1dc9d None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:34.728415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ab928-527c-4044-be7d-b20bdef13913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:34.732122 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ab928-527c-4044-be7d-b20bdef13913 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:34.732122 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ab928-527c-4044-be7d-b20bdef13913 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:34.732122 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ab928-527c-4044-be7d-b20bdef13913 None admin] PATH_INFO: `/v3/projects/af3a7f407f014d858258455b61892383` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:34.732122 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ab928-527c-4044-be7d-b20bdef13913 None admin] RBAC: Authorizing `identity:get_project(project_id=af3a7f407f014d858258455b61892383)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:34.732549 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ab928-527c-4044-be7d-b20bdef13913 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:34.734205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 127/255] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:34 2022] GET /identity/v3/projects/af3a7f407f014d858258455b61892383 => generated 303 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:34.741479 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ab928-527c-4044-be7d-b20bdef13913 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:34.765715 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd53a7-14a1-45ea-82b1-5b109b0a3a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:34.766777 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd53a7-14a1-45ea-82b1-5b109b0a3a80 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:34.767259 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd53a7-14a1-45ea-82b1-5b109b0a3a80 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:34.767726 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd53a7-14a1-45ea-82b1-5b109b0a3a80 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:34.768756 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd53a7-14a1-45ea-82b1-5b109b0a3a80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:34.769258 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd53a7-14a1-45ea-82b1-5b109b0a3a80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:34.771465 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd53a7-14a1-45ea-82b1-5b109b0a3a80 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:34.784158 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 129/256] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:34 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:34.791547 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd53a7-14a1-45ea-82b1-5b109b0a3a80 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:34.860484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:34.905509 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd53a7-14a1-45ea-82b1-5b109b0a3a80 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:34.940877 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3a33b-f94f-489c-8636-404c8090034d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:34.942493 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3a33b-f94f-489c-8636-404c8090034d None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:34.943004 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3a33b-f94f-489c-8636-404c8090034d None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:34.943526 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3a33b-f94f-489c-8636-404c8090034d None admin] PATH_INFO: `/v3/users/6c6d4eb601b9493089bb4eff75051c56` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:34.945667 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f3a33b-f94f-489c-8636-404c8090034d None admin] RBAC: Authorizing `identity:get_user(user_id=6c6d4eb601b9493089bb4eff75051c56)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:34.948382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f3a33b-f94f-489c-8636-404c8090034d None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:34.951483 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 130/257] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:34 2022] GET /identity/v3/users/6c6d4eb601b9493089bb4eff75051c56 => generated 284 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:34.956815 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4125551-7273-4540-98f4-624c49d24f38 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:34.957121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4125551-7273-4540-98f4-624c49d24f38 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:34.957414 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4125551-7273-4540-98f4-624c49d24f38 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:34.959595 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 131/258] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:34 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:34.961700 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4125551-7273-4540-98f4-624c49d24f38 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:34.983876 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ab928-527c-4044-be7d-b20bdef13913 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:34.994334 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:35.069014 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ce1fa-a883-4f88-81c3-3ea8f517945b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:35.070178 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ce1fa-a883-4f88-81c3-3ea8f517945b None admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:35.070612 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ce1fa-a883-4f88-81c3-3ea8f517945b None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:35.071038 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ce1fa-a883-4f88-81c3-3ea8f517945b None admin] PATH_INFO: `/v3/projects/af3a7f407f014d858258455b61892383/users/be23a8f9fa7842a3bedeb8ae9e66163b/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:35.073858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ce1fa-a883-4f88-81c3-3ea8f517945b None admin] RBAC: Authorizing `identity:create_grant(project_id=af3a7f407f014d858258455b61892383, user_id=be23a8f9fa7842a3bedeb8ae9e66163b, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:35.075506 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ce1fa-a883-4f88-81c3-3ea8f517945b None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:35.106159 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4125551-7273-4540-98f4-624c49d24f38 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:35.130625 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:35.144647 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455341bd-8e0a-4a1f-9c4d-9e2d8fdc0d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:35.145360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455341bd-8e0a-4a1f-9c4d-9e2d8fdc0d6e None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:35.145838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455341bd-8e0a-4a1f-9c4d-9e2d8fdc0d6e None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:35.146320 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455341bd-8e0a-4a1f-9c4d-9e2d8fdc0d6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:35.167752 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 128/259] 10.222.0.119 () {58 vars in 1444 bytes} [Thu Jul 14 15:35:34 2022] PUT /identity/v3/projects/af3a7f407f014d858258455b61892383/users/be23a8f9fa7842a3bedeb8ae9e66163b/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:35:35.169277 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6a716-ff0c-4a3f-b94e-5897f17b9095 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:35.169713 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6a716-ff0c-4a3f-b94e-5897f17b9095 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:35.170209 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6a716-ff0c-4a3f-b94e-5897f17b9095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:35.206018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-4dc6a716-ff0c-4a3f-b94e-5897f17b9095 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:35.216130 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-4dc6a716-ff0c-4a3f-b94e-5897f17b9095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:35.252495 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455341bd-8e0a-4a1f-9c4d-9e2d8fdc0d6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:35.253929 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455341bd-8e0a-4a1f-9c4d-9e2d8fdc0d6e None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:35.292266 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 129/260] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:35.328314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6a716-ff0c-4a3f-b94e-5897f17b9095 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:35.416517 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 132/261] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:35:34 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:35.422120 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455341bd-8e0a-4a1f-9c4d-9e2d8fdc0d6e None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:35.468545 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:35.544593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:35.569712 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6a716-ff0c-4a3f-b94e-5897f17b9095 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:35.624481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455341bd-8e0a-4a1f-9c4d-9e2d8fdc0d6e None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:35.640312 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bab457-fb68-4796-bc51-eb83afc799a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:35.641544 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bab457-fb68-4796-bc51-eb83afc799a0 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:35.641840 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bab457-fb68-4796-bc51-eb83afc799a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:35.642123 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bab457-fb68-4796-bc51-eb83afc799a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:35.662970 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bab457-fb68-4796-bc51-eb83afc799a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:35.682883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-b4bab457-fb68-4796-bc51-eb83afc799a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:35:35.682883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:35.682883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:35.682883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:35.682883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:35.682883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:35.682883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:35.682883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:35.682883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:35.682883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:35.682883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:35.682883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:35.682883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:35.682883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:35.682883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:35.682883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:35.683838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:35.683838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:35.683838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:35.683838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:35.683838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:35.683838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:35.683838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:35.683838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:35.683838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:35.683838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:35.683838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:35.683838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:35.683838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:35.683838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:35.683838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:35.683838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:35.684674 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:35.684674 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:35.684674 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:35.684674 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:35.684674 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:35.684674 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:35.684674 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:35.684674 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:35.684674 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:35.684674 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:35.684674 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:35:35.684674 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:35.685279 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 130/262] 10.222.0.119 () {56 vars in 1119 bytes} [Thu Jul 14 15:35:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:35.691166 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bab457-fb68-4796-bc51-eb83afc799a0 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:35.729409 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5173367-7f9f-4d2a-83e9-45c5d216c2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:35.730315 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5173367-7f9f-4d2a-83e9-45c5d216c2fd None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:35.730604 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5173367-7f9f-4d2a-83e9-45c5d216c2fd None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:35.730886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5173367-7f9f-4d2a-83e9-45c5d216c2fd None admin] PATH_INFO: `/v3/projects/af3a7f407f014d858258455b61892383` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:35.736882 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5173367-7f9f-4d2a-83e9-45c5d216c2fd None admin] RBAC: Authorizing `identity:get_project(project_id=af3a7f407f014d858258455b61892383)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:35.738361 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5173367-7f9f-4d2a-83e9-45c5d216c2fd None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:35.741310 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 133/263] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:35 2022] GET /identity/v3/projects/af3a7f407f014d858258455b61892383 => generated 303 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:35.753926 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5173367-7f9f-4d2a-83e9-45c5d216c2fd None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:35.862362 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bab457-fb68-4796-bc51-eb83afc799a0 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:35.899090 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172debee-793c-4242-86ae-e79835e73da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:35.899776 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172debee-793c-4242-86ae-e79835e73da1 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:35.900067 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172debee-793c-4242-86ae-e79835e73da1 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:35.900375 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172debee-793c-4242-86ae-e79835e73da1 None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:35.904008 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172debee-793c-4242-86ae-e79835e73da1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:35.904008 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172debee-793c-4242-86ae-e79835e73da1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:35.904008 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172debee-793c-4242-86ae-e79835e73da1 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:35.912394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 131/264] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:35:35 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:35.921416 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172debee-793c-4242-86ae-e79835e73da1 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:35.937883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:35.944454 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:35.960065 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5173367-7f9f-4d2a-83e9-45c5d216c2fd None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:36.054207 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172debee-793c-4242-86ae-e79835e73da1 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:36.064341 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ffa1b-b08b-4873-a412-1d9adf943dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:36.065095 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ffa1b-b08b-4873-a412-1d9adf943dea None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:36.065393 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ffa1b-b08b-4873-a412-1d9adf943dea None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:36.065674 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ffa1b-b08b-4873-a412-1d9adf943dea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:36.066523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ffa1b-b08b-4873-a412-1d9adf943dea None admin] RBAC: Adding query filter params (role.id=07aaf007cde043318319928d151bdc75, scope.project.id=af3a7f407f014d858258455b61892383, user.id=6c6d4eb601b9493089bb4eff75051c56) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:36.066840 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ffa1b-b08b-4873-a412-1d9adf943dea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:36.069022 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ffa1b-b08b-4873-a412-1d9adf943dea None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:36.085374 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 134/265] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:35:35 2022] GET /identity/v3/role_assignments?user.id=6c6d4eb601b9493089bb4eff75051c56&scope.project.id=af3a7f407f014d858258455b61892383&role.id=07aaf007cde043318319928d151bdc75 => generated 610 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:36.116066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b902a10-37b4-4d69-8881-1a7320132267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:36.116914 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b902a10-37b4-4d69-8881-1a7320132267 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:36.117283 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b902a10-37b4-4d69-8881-1a7320132267 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:36.117574 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b902a10-37b4-4d69-8881-1a7320132267 None admin] PATH_INFO: `/v3/users/6c6d4eb601b9493089bb4eff75051c56` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:36.118827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b902a10-37b4-4d69-8881-1a7320132267 None admin] RBAC: Authorizing `identity:get_user(user_id=6c6d4eb601b9493089bb4eff75051c56)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:36.120393 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b902a10-37b4-4d69-8881-1a7320132267 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:36.122106 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 132/266] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:35 2022] GET /identity/v3/users/6c6d4eb601b9493089bb4eff75051c56 => generated 284 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:36.128061 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ffa1b-b08b-4873-a412-1d9adf943dea None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:36.258960 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ffa1b-b08b-4873-a412-1d9adf943dea None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:36.310044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eaaaf8-c752-473b-be84-f2bbf17ca657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:36.311091 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaaaf8-c752-473b-be84-f2bbf17ca657 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:36.311605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaaaf8-c752-473b-be84-f2bbf17ca657 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:36.312081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaaaf8-c752-473b-be84-f2bbf17ca657 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:36.351238 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:36.413086 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eaaaf8-c752-473b-be84-f2bbf17ca657 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:36.415135 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eaaaf8-c752-473b-be84-f2bbf17ca657 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:36.561987 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 135/267] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:35:36 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:36.567726 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b902a10-37b4-4d69-8881-1a7320132267 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:36.665391 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:36.687534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b902a10-37b4-4d69-8881-1a7320132267 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:36.727465 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfff345-a57b-41f9-b7e2-fa49f3932360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:36.728422 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfff345-a57b-41f9-b7e2-fa49f3932360 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:36.728712 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfff345-a57b-41f9-b7e2-fa49f3932360 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:36.728998 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfff345-a57b-41f9-b7e2-fa49f3932360 None admin] PATH_INFO: `/v3/projects/af3a7f407f014d858258455b61892383` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:36.730257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfff345-a57b-41f9-b7e2-fa49f3932360 None admin] RBAC: Authorizing `identity:get_project(project_id=af3a7f407f014d858258455b61892383)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:36.731812 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfff345-a57b-41f9-b7e2-fa49f3932360 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:36.733568 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 133/268] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:36 2022] GET /identity/v3/projects/af3a7f407f014d858258455b61892383 => generated 303 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:36.739784 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eaaaf8-c752-473b-be84-f2bbf17ca657 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:36.825147 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:36.877765 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eaaaf8-c752-473b-be84-f2bbf17ca657 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:36.915794 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a61d8f-8265-4871-be8a-416c44479756 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:36.916514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a61d8f-8265-4871-be8a-416c44479756 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:36.917000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a61d8f-8265-4871-be8a-416c44479756 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:36.918998 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 134/269] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:36 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:36.924019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d0cde-7fd7-47db-b994-e6ab8943b5f2 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:36.924624 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d0cde-7fd7-47db-b994-e6ab8943b5f2 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:36.925107 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d0cde-7fd7-47db-b994-e6ab8943b5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:36.928384 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119c4ac-4d0c-4892-9e50-d048a1a3e6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:36.929163 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119c4ac-4d0c-4892-9e50-d048a1a3e6b4 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:36.929457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119c4ac-4d0c-4892-9e50-d048a1a3e6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:36.929738 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119c4ac-4d0c-4892-9e50-d048a1a3e6b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:36.930686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119c4ac-4d0c-4892-9e50-d048a1a3e6b4 None admin] RBAC: Adding query filter params (role.id=71b77f014251450eac200e62300144ab, scope.project.id=af3a7f407f014d858258455b61892383, user.id=6c6d4eb601b9493089bb4eff75051c56) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:36.931009 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119c4ac-4d0c-4892-9e50-d048a1a3e6b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:36.932655 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119c4ac-4d0c-4892-9e50-d048a1a3e6b4 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:36.946090 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 136/270] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:35:36 2022] GET /identity/v3/role_assignments?user.id=6c6d4eb601b9493089bb4eff75051c56&scope.project.id=af3a7f407f014d858258455b61892383&role.id=71b77f014251450eac200e62300144ab => generated 610 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:36.958870 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-077d0cde-7fd7-47db-b994-e6ab8943b5f2 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:36.960200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-077d0cde-7fd7-47db-b994-e6ab8943b5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:36.968577 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c189e-49d9-4650-ab32-df9be2581385 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:36.968930 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c189e-49d9-4650-ab32-df9be2581385 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:36.969150 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c189e-49d9-4650-ab32-df9be2581385 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:36.970701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 137/271] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:35:36.985014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823400ed-ef81-4340-bd85-349fe4ddd477 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:36.985313 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823400ed-ef81-4340-bd85-349fe4ddd477 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:36.985580 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823400ed-ef81-4340-bd85-349fe4ddd477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:37.005982 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-823400ed-ef81-4340-bd85-349fe4ddd477 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:37.007416 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-823400ed-ef81-4340-bd85-349fe4ddd477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:37.093501 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 135/272] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:37.122040 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 138/273] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:35:37.129989 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d0cde-7fd7-47db-b994-e6ab8943b5f2 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:37.161006 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823400ed-ef81-4340-bd85-349fe4ddd477 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:37.216766 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:37.224559 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:37.243628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d0cde-7fd7-47db-b994-e6ab8943b5f2 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:37.281976 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823400ed-ef81-4340-bd85-349fe4ddd477 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:37.288904 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602373e4-76c3-4b47-a232-7fb3384f899b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:37.289704 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602373e4-76c3-4b47-a232-7fb3384f899b None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:37.289990 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602373e4-76c3-4b47-a232-7fb3384f899b None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:37.290267 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602373e4-76c3-4b47-a232-7fb3384f899b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:37.301217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602373e4-76c3-4b47-a232-7fb3384f899b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:37.310145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-602373e4-76c3-4b47-a232-7fb3384f899b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:35:37.310145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:37.310145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:37.310145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:37.310145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:37.310145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:37.310145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:37.310145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:37.310145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:37.310145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:37.310145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:37.310145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:37.310145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:37.310145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:37.310145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:37.310145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:37.311017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:37.311017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:37.311017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:37.311017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:37.311017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:37.311017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:37.311017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:37.311017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:37.311017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:37.311017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:37.311017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:37.311017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:37.311017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:37.311017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:37.311017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:37.311017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:37.311805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:37.311805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:37.311805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:37.311805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:37.311805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:37.311805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:37.311805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:37.311805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:37.311805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:37.311805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:37.311805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:35:37.311805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:37.311805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 136/274] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:37.312943 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c0287-199a-4f6d-9b1b-e9557e8ffb6f None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:37.313035 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c0287-199a-4f6d-9b1b-e9557e8ffb6f None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:37.313308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c0287-199a-4f6d-9b1b-e9557e8ffb6f None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:37.314774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 137/275] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:37.320685 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c0287-199a-4f6d-9b1b-e9557e8ffb6f None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:37.325659 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b69d2b-f661-4305-b8d2-1ff7c5b7e36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:37.326456 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b69d2b-f661-4305-b8d2-1ff7c5b7e36b None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:37.326741 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b69d2b-f661-4305-b8d2-1ff7c5b7e36b None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:37.327017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b69d2b-f661-4305-b8d2-1ff7c5b7e36b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:37.328221 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b69d2b-f661-4305-b8d2-1ff7c5b7e36b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:37.329687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b69d2b-f661-4305-b8d2-1ff7c5b7e36b None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:37.336332 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 139/276] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:35:37 2022] GET /identity/v3/domains/default => generated 200 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:37.336332 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c12ff7-f558-462a-904f-ff278e61ea30 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:37.336332 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c12ff7-f558-462a-904f-ff278e61ea30 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:37.336332 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c12ff7-f558-462a-904f-ff278e61ea30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:37.351011 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-f9c12ff7-f558-462a-904f-ff278e61ea30 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:37.352229 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f9c12ff7-f558-462a-904f-ff278e61ea30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:37.422695 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 140/277] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:37.423439 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c12ff7-f558-462a-904f-ff278e61ea30 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:37.445360 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c0287-199a-4f6d-9b1b-e9557e8ffb6f None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:37.479824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:37.482442 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fa33b-b571-4212-b04f-a6d27653315d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:37.483055 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fa33b-b571-4212-b04f-a6d27653315d None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:37.483495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fa33b-b571-4212-b04f-a6d27653315d None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:37.483599 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fa33b-b571-4212-b04f-a6d27653315d None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:37.484386 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fa33b-b571-4212-b04f-a6d27653315d None admin] RBAC: Adding query filter params (name=reader) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:37.484696 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fa33b-b571-4212-b04f-a6d27653315d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:37.486298 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fa33b-b571-4212-b04f-a6d27653315d None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:37.489963 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:37.501754 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 138/278] 10.222.0.119 () {56 vars in 1106 bytes} [Thu Jul 14 15:35:37 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:37.501754 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fa33b-b571-4212-b04f-a6d27653315d None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:37.544005 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c12ff7-f558-462a-904f-ff278e61ea30 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:37.579567 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92940c67-946b-48e9-b485-66e697a281d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:37.580274 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92940c67-946b-48e9-b485-66e697a281d6 None admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:37.580559 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92940c67-946b-48e9-b485-66e697a281d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:37.580833 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92940c67-946b-48e9-b485-66e697a281d6 None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:37.581542 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92940c67-946b-48e9-b485-66e697a281d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:37.582982 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92940c67-946b-48e9-b485-66e697a281d6 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:37.609450 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fa33b-b571-4212-b04f-a6d27653315d None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:37.644646 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e3633-07de-4512-ba4c-8359150f7894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:37.645496 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e3633-07de-4512-ba4c-8359150f7894 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:37.645825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e3633-07de-4512-ba4c-8359150f7894 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:37.646373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e3633-07de-4512-ba4c-8359150f7894 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:37.656043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e3633-07de-4512-ba4c-8359150f7894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:37.664525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-2c8e3633-07de-4512-ba4c-8359150f7894 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:37.664525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:37.664525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:37.664525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:37.664525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:37.664525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:37.664525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:37.664525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:37.664525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:37.664525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:37.664525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:37.664525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:37.664525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:37.664525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:37.664525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:37.664525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:37.665593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:37.665593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:37.665593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:37.665593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:37.665593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:37.665593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:37.665593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:37.665593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:37.665593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:37.665593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:37.665593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:37.665593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:37.665593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:37.665593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:37.665593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:37.665593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:37.666386 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:37.666386 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:37.666386 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:37.666386 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:37.666386 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:37.666386 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:37.666386 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:37.666386 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:37.666386 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:37.666386 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:37.666386 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:37.666386 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:37.666386 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 139/279] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:37.667036 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e3633-07de-4512-ba4c-8359150f7894 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:37.687930 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 141/280] 10.222.0.119 () {60 vars in 1137 bytes} [Thu Jul 14 15:35:37 2022] POST /identity/v3/users => generated 294 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:35:37.688980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92940c67-946b-48e9-b485-66e697a281d6 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:37.752604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:37.812120 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e3633-07de-4512-ba4c-8359150f7894 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:37.816434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92940c67-946b-48e9-b485-66e697a281d6 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:37.818871 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:37.858044 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1a137-25a4-4ea5-a181-80c3364236ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:37.858930 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1a137-25a4-4ea5-a181-80c3364236ef None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:37.859272 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1a137-25a4-4ea5-a181-80c3364236ef None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:37.859549 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1a137-25a4-4ea5-a181-80c3364236ef None admin] PATH_INFO: `/v3/users/56cccf1fdb6a431a863e657e499d619a` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:37.860253 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb971d-9e71-425b-8971-ab04ccfa4e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:37.860781 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1a137-25a4-4ea5-a181-80c3364236ef None admin] RBAC: Authorizing `identity:get_user(user_id=56cccf1fdb6a431a863e657e499d619a)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:37.860937 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb971d-9e71-425b-8971-ab04ccfa4e70 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:37.861227 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb971d-9e71-425b-8971-ab04ccfa4e70 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:37.861509 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb971d-9e71-425b-8971-ab04ccfa4e70 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:37.862219 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1a137-25a4-4ea5-a181-80c3364236ef None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:37.862306 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb971d-9e71-425b-8971-ab04ccfa4e70 None admin] RBAC: Adding query filter params (name=member) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:37.862568 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb971d-9e71-425b-8971-ab04ccfa4e70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:37.864201 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb971d-9e71-425b-8971-ab04ccfa4e70 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:37.864835 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 140/281] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:37 2022] GET /identity/v3/users/56cccf1fdb6a431a863e657e499d619a => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:37.870397 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1a137-25a4-4ea5-a181-80c3364236ef None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:37.874340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 142/282] 10.222.0.119 () {56 vars in 1106 bytes} [Thu Jul 14 15:35:37 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:37.881079 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb971d-9e71-425b-8971-ab04ccfa4e70 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:38.005273 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1a137-25a4-4ea5-a181-80c3364236ef None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:38.018094 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb971d-9e71-425b-8971-ab04ccfa4e70 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:38.037380 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:38.048381 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06103ad6-bf3f-4ce5-beb7-d8b671301e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:38.049271 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06103ad6-bf3f-4ce5-beb7-d8b671301e44 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:38.049540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06103ad6-bf3f-4ce5-beb7-d8b671301e44 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:38.049821 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06103ad6-bf3f-4ce5-beb7-d8b671301e44 None admin] PATH_INFO: `/v3/projects/af3a7f407f014d858258455b61892383` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:38.052069 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06103ad6-bf3f-4ce5-beb7-d8b671301e44 None admin] RBAC: Authorizing `identity:get_project(project_id=af3a7f407f014d858258455b61892383)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:38.053561 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06103ad6-bf3f-4ce5-beb7-d8b671301e44 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:38.055322 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 141/283] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:37 2022] GET /identity/v3/projects/af3a7f407f014d858258455b61892383 => generated 303 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:38.057468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2480a5-ad31-42ec-b7ea-7b7a41eb25a8 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:38.057758 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2480a5-ad31-42ec-b7ea-7b7a41eb25a8 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:38.058034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2480a5-ad31-42ec-b7ea-7b7a41eb25a8 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:38.059298 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 142/284] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:38.061057 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2480a5-ad31-42ec-b7ea-7b7a41eb25a8 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:38.066719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa183b8-5408-4484-b665-acd9861da8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:38.068194 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa183b8-5408-4484-b665-acd9861da8b3 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:38.068483 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa183b8-5408-4484-b665-acd9861da8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:38.068863 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa183b8-5408-4484-b665-acd9861da8b3 None admin] PATH_INFO: `/v3/users/21652dd9beec4c4b9e332574dc016c61` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:38.088915 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa183b8-5408-4484-b665-acd9861da8b3 None admin] RBAC: Authorizing `identity:get_user(user_id=21652dd9beec4c4b9e332574dc016c61)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:38.090678 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa183b8-5408-4484-b665-acd9861da8b3 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:38.092617 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 143/285] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:37 2022] GET /identity/v3/users/21652dd9beec4c4b9e332574dc016c61 => generated 294 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:38.093757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dc259-b1bc-45f7-bf4f-bea1b58f3a9f None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:38.094110 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dc259-b1bc-45f7-bf4f-bea1b58f3a9f None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:38.094394 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dc259-b1bc-45f7-bf4f-bea1b58f3a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:38.113138 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-c84dc259-b1bc-45f7-bf4f-bea1b58f3a9f None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:38.114408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-c84dc259-b1bc-45f7-bf4f-bea1b58f3a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:38.132507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:38.185046 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 144/286] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:38.193516 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84dc259-b1bc-45f7-bf4f-bea1b58f3a9f None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:38.194366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2480a5-ad31-42ec-b7ea-7b7a41eb25a8 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:38.234055 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f553e2f-d051-4e08-85ec-4a444b0c50f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:38.235484 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f553e2f-d051-4e08-85ec-4a444b0c50f2 None admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:38.236316 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f553e2f-d051-4e08-85ec-4a444b0c50f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:38.237045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f553e2f-d051-4e08-85ec-4a444b0c50f2 None admin] PATH_INFO: `/v3/projects/af3a7f407f014d858258455b61892383/users/56cccf1fdb6a431a863e657e499d619a/roles/37be94aa89aa45db936809e7f660c225` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:38.240550 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f553e2f-d051-4e08-85ec-4a444b0c50f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=af3a7f407f014d858258455b61892383, user_id=56cccf1fdb6a431a863e657e499d619a, role_id=37be94aa89aa45db936809e7f660c225)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:38.243068 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f553e2f-d051-4e08-85ec-4a444b0c50f2 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:38.315685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84dc259-b1bc-45f7-bf4f-bea1b58f3a9f None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:38.316559 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 143/287] 10.222.0.119 () {58 vars in 1444 bytes} [Thu Jul 14 15:35:38 2022] PUT /identity/v3/projects/af3a7f407f014d858258455b61892383/users/56cccf1fdb6a431a863e657e499d619a/roles/37be94aa89aa45db936809e7f660c225 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:35:38.322439 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f553e2f-d051-4e08-85ec-4a444b0c50f2 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:38.374168 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391348d-36fe-4527-a813-746c1cbcce0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:38.374959 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391348d-36fe-4527-a813-746c1cbcce0f None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:38.375314 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391348d-36fe-4527-a813-746c1cbcce0f None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:38.376034 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391348d-36fe-4527-a813-746c1cbcce0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:38.376738 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391348d-36fe-4527-a813-746c1cbcce0f None admin] RBAC: Adding query filter params (role.id=14c8b3b550ba4f75a147b8851fd17c7c, user.id=21652dd9beec4c4b9e332574dc016c61, scope.system=all) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:38.377125 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391348d-36fe-4527-a813-746c1cbcce0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:38.378733 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391348d-36fe-4527-a813-746c1cbcce0f None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:38.388918 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 145/288] 10.222.0.119 () {56 vars in 1313 bytes} [Thu Jul 14 15:35:38 2022] GET /identity/v3/role_assignments?user.id=21652dd9beec4c4b9e332574dc016c61&scope.system=all&role.id=14c8b3b550ba4f75a147b8851fd17c7c => generated 227 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:38.424396 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:38.478953 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f553e2f-d051-4e08-85ec-4a444b0c50f2 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:38.534594 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da220904-9c8f-4ee5-ac25-772d4380f372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:38.535422 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da220904-9c8f-4ee5-ac25-772d4380f372 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:38.535709 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da220904-9c8f-4ee5-ac25-772d4380f372 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:38.535991 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da220904-9c8f-4ee5-ac25-772d4380f372 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:38.553164 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da220904-9c8f-4ee5-ac25-772d4380f372 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:38.561782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-da220904-9c8f-4ee5-ac25-772d4380f372 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:38.561782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:38.561782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:38.561782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:38.561782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:38.561782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:38.561782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:38.561782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:38.561782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:38.561782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:38.561782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:38.561782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:38.561782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:38.561782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:38.561782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:38.561782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:38.562737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:38.562737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:38.562737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:38.562737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:38.562737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:38.562737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:38.562737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:38.562737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:38.562737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:38.562737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:38.562737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:38.562737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:38.562737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:38.562737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:38.562737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:38.562737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:38.563515 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:38.563515 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:38.563515 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:38.563515 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:38.563515 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:38.563515 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:38.563515 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:38.563515 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:38.563515 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:38.563515 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:38.563515 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:38.563515 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:38.566406 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 144/289] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:38.574234 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391348d-36fe-4527-a813-746c1cbcce0f None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:38.598014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:38.706879 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391348d-36fe-4527-a813-746c1cbcce0f None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:38.760996 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4b720-c927-42a2-902a-6c5d5e24ed04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:38.761679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4b720-c927-42a2-902a-6c5d5e24ed04 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:38.761966 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4b720-c927-42a2-902a-6c5d5e24ed04 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:38.762248 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4b720-c927-42a2-902a-6c5d5e24ed04 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:38.763009 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4b720-c927-42a2-902a-6c5d5e24ed04 None admin] RBAC: Adding query filter params (name=member) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:38.763321 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4b720-c927-42a2-902a-6c5d5e24ed04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:38.764788 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4b720-c927-42a2-902a-6c5d5e24ed04 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:38.779929 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 146/290] 10.222.0.119 () {56 vars in 1106 bytes} [Thu Jul 14 15:35:38 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:38.785879 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da220904-9c8f-4ee5-ac25-772d4380f372 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:38.946955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da220904-9c8f-4ee5-ac25-772d4380f372 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:38.965901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:38.993717 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508149dc-d316-4d0f-90b7-162eeada4c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:38.994683 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508149dc-d316-4d0f-90b7-162eeada4c34 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:38.994962 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508149dc-d316-4d0f-90b7-162eeada4c34 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:38.995248 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508149dc-d316-4d0f-90b7-162eeada4c34 None admin] PATH_INFO: `/v3/users/be23a8f9fa7842a3bedeb8ae9e66163b` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:38.996497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508149dc-d316-4d0f-90b7-162eeada4c34 None admin] RBAC: Authorizing `identity:get_user(user_id=be23a8f9fa7842a3bedeb8ae9e66163b)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:38.997945 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508149dc-d316-4d0f-90b7-162eeada4c34 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:38.999882 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 145/291] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:38 2022] GET /identity/v3/users/be23a8f9fa7842a3bedeb8ae9e66163b => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:39.005224 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4b720-c927-42a2-902a-6c5d5e24ed04 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:39.148675 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:39.176204 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4b720-c927-42a2-902a-6c5d5e24ed04 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:39.230785 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19007023-09a4-4ffe-8134-1a96b3037302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:39.231376 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19007023-09a4-4ffe-8134-1a96b3037302 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:39.231665 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19007023-09a4-4ffe-8134-1a96b3037302 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:39.231946 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19007023-09a4-4ffe-8134-1a96b3037302 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:39.312353 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19007023-09a4-4ffe-8134-1a96b3037302 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:39.313838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19007023-09a4-4ffe-8134-1a96b3037302 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:39.413600 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:39.440930 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 147/292] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:35:39 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:39.446694 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508149dc-d316-4d0f-90b7-162eeada4c34 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:39.625084 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508149dc-d316-4d0f-90b7-162eeada4c34 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:39.661384 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18092974-6bd9-44de-b06b-60aed5b76e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:39.662257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18092974-6bd9-44de-b06b-60aed5b76e1e None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:39.662546 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18092974-6bd9-44de-b06b-60aed5b76e1e None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:39.662825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18092974-6bd9-44de-b06b-60aed5b76e1e None admin] PATH_INFO: `/v3/projects/af3a7f407f014d858258455b61892383` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:39.664025 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18092974-6bd9-44de-b06b-60aed5b76e1e None admin] RBAC: Authorizing `identity:get_project(project_id=af3a7f407f014d858258455b61892383)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:39.665492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18092974-6bd9-44de-b06b-60aed5b76e1e None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:39.672064 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 146/293] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:39 2022] GET /identity/v3/projects/af3a7f407f014d858258455b61892383 => generated 303 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:39.673433 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19007023-09a4-4ffe-8134-1a96b3037302 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:39.787626 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19007023-09a4-4ffe-8134-1a96b3037302 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:39.822768 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374cb40-4b0b-4f72-be83-e96ae13ded73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:39.823432 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374cb40-4b0b-4f72-be83-e96ae13ded73 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:39.823718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374cb40-4b0b-4f72-be83-e96ae13ded73 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:39.823996 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374cb40-4b0b-4f72-be83-e96ae13ded73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:39.824869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374cb40-4b0b-4f72-be83-e96ae13ded73 None admin] RBAC: Adding query filter params (role.id=14c8b3b550ba4f75a147b8851fd17c7c, scope.project.id=af3a7f407f014d858258455b61892383, user.id=be23a8f9fa7842a3bedeb8ae9e66163b) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:39.825181 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374cb40-4b0b-4f72-be83-e96ae13ded73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:39.826626 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374cb40-4b0b-4f72-be83-e96ae13ded73 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:39.840388 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 148/294] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:35:39 2022] GET /identity/v3/role_assignments?user.id=be23a8f9fa7842a3bedeb8ae9e66163b&scope.project.id=af3a7f407f014d858258455b61892383&role.id=14c8b3b550ba4f75a147b8851fd17c7c => generated 610 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:40.196958 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390b9b9-af34-47f0-b5a6-24920f4e7e5e None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:40.197475 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390b9b9-af34-47f0-b5a6-24920f4e7e5e None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:40.197970 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390b9b9-af34-47f0-b5a6-24920f4e7e5e None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:40.200902 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 147/295] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:40 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:40.208593 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea058b9-9131-49dc-b733-5dbd6decf030 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:40.209024 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea058b9-9131-49dc-b733-5dbd6decf030 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:40.209400 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea058b9-9131-49dc-b733-5dbd6decf030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:40.226588 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-aea058b9-9131-49dc-b733-5dbd6decf030 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:40.227781 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-aea058b9-9131-49dc-b733-5dbd6decf030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:40.265057 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:40.299670 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 149/296] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:40.323374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390b9b9-af34-47f0-b5a6-24920f4e7e5e None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:40.383988 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:40.407845 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6de992-c8b1-449d-8e94-cec2faa59a73 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:40.408178 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6de992-c8b1-449d-8e94-cec2faa59a73 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:40.408461 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6de992-c8b1-449d-8e94-cec2faa59a73 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:40.409905 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 150/297] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:40.415589 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae7a3a-2a57-4d19-8746-b790c0894e8e None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:40.415976 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae7a3a-2a57-4d19-8746-b790c0894e8e None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:40.416279 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae7a3a-2a57-4d19-8746-b790c0894e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:40.434547 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-92ae7a3a-2a57-4d19-8746-b790c0894e8e None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:40.435731 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-92ae7a3a-2a57-4d19-8746-b790c0894e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:40.444329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390b9b9-af34-47f0-b5a6-24920f4e7e5e None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:40.494377 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa948d-5956-4f24-91e6-b9fd5922e76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:40.495108 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa948d-5956-4f24-91e6-b9fd5922e76f None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:40.495713 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa948d-5956-4f24-91e6-b9fd5922e76f None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:40.496038 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa948d-5956-4f24-91e6-b9fd5922e76f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:40.509683 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa948d-5956-4f24-91e6-b9fd5922e76f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:40.520045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-30fa948d-5956-4f24-91e6-b9fd5922e76f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:35:40.520045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:40.520045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:40.520045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:40.520045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:40.520045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:40.520045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:40.520045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:40.520045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:40.520045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:40.520045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:40.520045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:40.520045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:40.520045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:40.520045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:40.520045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:40.521059 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:40.521059 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:40.521059 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:40.521059 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:40.521059 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:40.521059 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:40.521059 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:40.521059 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:40.521059 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:40.521059 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:40.521059 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:40.521059 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:40.521059 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:40.521059 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:40.521059 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:40.521059 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:40.524564 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:40.524564 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:40.524564 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:40.524564 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:40.524564 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:40.524564 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:40.524564 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:40.524564 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:40.524564 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:40.524564 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:40.524564 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:35:40.524564 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:40.524564 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 148/298] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:40.527931 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 151/299] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:35:40.536175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa948d-5956-4f24-91e6-b9fd5922e76f None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:40.551962 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae7a3a-2a57-4d19-8746-b790c0894e8e None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:40.660668 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa948d-5956-4f24-91e6-b9fd5922e76f None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:40.677784 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:40.679316 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae7a3a-2a57-4d19-8746-b790c0894e8e None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:40.681555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:40.715336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93062446-c2ad-4368-8b19-737a5d51f07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:40.716698 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93062446-c2ad-4368-8b19-737a5d51f07c None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:40.717158 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93062446-c2ad-4368-8b19-737a5d51f07c None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:40.717870 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93062446-c2ad-4368-8b19-737a5d51f07c None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:40.718881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93062446-c2ad-4368-8b19-737a5d51f07c None admin] RBAC: Adding query filter params (name=reader) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:40.719333 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93062446-c2ad-4368-8b19-737a5d51f07c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:40.721097 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93062446-c2ad-4368-8b19-737a5d51f07c None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:40.721849 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3546ed8-257c-4792-882b-0170a7933837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:40.722980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3546ed8-257c-4792-882b-0170a7933837 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:40.723359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3546ed8-257c-4792-882b-0170a7933837 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:40.723697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3546ed8-257c-4792-882b-0170a7933837 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:40.725505 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3546ed8-257c-4792-882b-0170a7933837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:40.727057 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3546ed8-257c-4792-882b-0170a7933837 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:40.729551 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 152/300] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:35:40 2022] GET /identity/v3/domains/default => generated 200 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:40.735311 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3546ed8-257c-4792-882b-0170a7933837 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:40.736900 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 149/301] 10.222.0.119 () {56 vars in 1106 bytes} [Thu Jul 14 15:35:40 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:40.743918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93062446-c2ad-4368-8b19-737a5d51f07c None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:40.885405 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3546ed8-257c-4792-882b-0170a7933837 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:40.885613 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93062446-c2ad-4368-8b19-737a5d51f07c None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:40.931660 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25256b60-a72c-4806-aacc-39feb586f644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:40.932590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25256b60-a72c-4806-aacc-39feb586f644 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:40.932875 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25256b60-a72c-4806-aacc-39feb586f644 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:40.933155 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25256b60-a72c-4806-aacc-39feb586f644 None admin] PATH_INFO: `/v3/users/bb7869beeaf1459fbf2962dc442dbe5a` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:40.933454 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06033956-63c8-4719-8288-7fcd902eabe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:40.934523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06033956-63c8-4719-8288-7fcd902eabe0 None admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:40.935138 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06033956-63c8-4719-8288-7fcd902eabe0 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:40.935629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06033956-63c8-4719-8288-7fcd902eabe0 None admin] PATH_INFO: `/v3/groups` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:40.936661 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06033956-63c8-4719-8288-7fcd902eabe0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:40.938313 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06033956-63c8-4719-8288-7fcd902eabe0 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:40.949849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25256b60-a72c-4806-aacc-39feb586f644 None admin] RBAC: Authorizing `identity:get_user(user_id=bb7869beeaf1459fbf2962dc442dbe5a)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:40.951301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25256b60-a72c-4806-aacc-39feb586f644 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:40.953433 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 150/302] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:40 2022] GET /identity/v3/users/bb7869beeaf1459fbf2962dc442dbe5a => generated 294 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:40.960234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25256b60-a72c-4806-aacc-39feb586f644 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:40.993671 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:41.012222 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 153/303] 10.222.0.119 () {60 vars in 1139 bytes} [Thu Jul 14 15:35:40 2022] POST /identity/v3/groups => generated 230 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:35:41.023271 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dfd7f-702a-41e8-a713-6f83c5cdfcd6 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:41.023741 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dfd7f-702a-41e8-a713-6f83c5cdfcd6 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:41.024278 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dfd7f-702a-41e8-a713-6f83c5cdfcd6 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:41.026594 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 154/304] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:41 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:41.034285 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bf1b6-f4c3-454d-aeea-ca7b24ac807e None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:41.035137 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bf1b6-f4c3-454d-aeea-ca7b24ac807e None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:41.035684 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bf1b6-f4c3-454d-aeea-ca7b24ac807e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:41.080414 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-c26bf1b6-f4c3-454d-aeea-ca7b24ac807e None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:41.081890 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-c26bf1b6-f4c3-454d-aeea-ca7b24ac807e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:41.135915 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:41.174563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25256b60-a72c-4806-aacc-39feb586f644 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:41.199118 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 155/305] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:35:41.200807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a4e0b-d00e-4d84-b02b-0dda0db4f9ae None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:41.201132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a4e0b-d00e-4d84-b02b-0dda0db4f9ae None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:41.201954 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a4e0b-d00e-4d84-b02b-0dda0db4f9ae None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:41.203813 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 156/306] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:41.209674 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b815db-098a-472b-ba9f-e26e9907d03f None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:41.210228 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b815db-098a-472b-ba9f-e26e9907d03f None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:41.210336 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b815db-098a-472b-ba9f-e26e9907d03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:41.220309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4dfb7-bd1e-4883-b318-0840c2c252d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:41.220981 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4dfb7-bd1e-4883-b318-0840c2c252d4 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:41.221267 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4dfb7-bd1e-4883-b318-0840c2c252d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:41.221547 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4dfb7-bd1e-4883-b318-0840c2c252d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:41.222474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4dfb7-bd1e-4883-b318-0840c2c252d4 None admin] RBAC: Adding query filter params (role.id=37be94aa89aa45db936809e7f660c225, user.id=bb7869beeaf1459fbf2962dc442dbe5a, scope.system=all) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:41.222793 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4dfb7-bd1e-4883-b318-0840c2c252d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:41.224890 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4dfb7-bd1e-4883-b318-0840c2c252d4 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:41.230007 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-58b815db-098a-472b-ba9f-e26e9907d03f None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:41.230346 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 151/307] 10.222.0.119 () {56 vars in 1313 bytes} [Thu Jul 14 15:35:40 2022] GET /identity/v3/role_assignments?user.id=bb7869beeaf1459fbf2962dc442dbe5a&scope.system=all&role.id=37be94aa89aa45db936809e7f660c225 => generated 227 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:41.231143 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4dfb7-bd1e-4883-b318-0840c2c252d4 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:41.231705 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-58b815db-098a-472b-ba9f-e26e9907d03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:41.365477 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:41.371826 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4dfb7-bd1e-4883-b318-0840c2c252d4 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:41.384041 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 157/308] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:35:41.418849 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b815db-098a-472b-ba9f-e26e9907d03f None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:41.428945 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5c243-1a80-41dc-b7ad-eab1049e55aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:41.429769 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5c243-1a80-41dc-b7ad-eab1049e55aa None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:41.430060 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5c243-1a80-41dc-b7ad-eab1049e55aa None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:41.430343 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5c243-1a80-41dc-b7ad-eab1049e55aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:41.442034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5c243-1a80-41dc-b7ad-eab1049e55aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:41.459340 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-42a5c243-1a80-41dc-b7ad-eab1049e55aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:41.459340 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:41.459340 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:41.459340 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:41.459340 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:41.459340 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:41.459340 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:41.459340 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:41.459340 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:41.459340 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:41.459340 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:41.459340 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:41.459340 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:41.459340 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:41.459340 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:41.459340 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:41.460389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:41.460389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:41.460389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:41.460389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:41.460389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:41.460389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:41.460389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:41.460389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:41.460389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:41.460389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:41.460389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:41.460389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:41.460389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:41.460389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:41.460389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:41.460389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:41.461174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:41.461174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:41.461174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:41.461174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:41.461174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:41.461174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:41.461174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:41.461174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:41.461174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:41.461174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:41.461174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:41.461174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:41.461174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 152/309] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:41.468238 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5c243-1a80-41dc-b7ad-eab1049e55aa None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:41.604392 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:41.616461 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b815db-098a-472b-ba9f-e26e9907d03f None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:41.631324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5c243-1a80-41dc-b7ad-eab1049e55aa None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:41.662816 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5e3ed-aac2-4161-9827-84285dbc8e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:41.663624 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5e3ed-aac2-4161-9827-84285dbc8e26 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:41.663908 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5e3ed-aac2-4161-9827-84285dbc8e26 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:41.664210 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5e3ed-aac2-4161-9827-84285dbc8e26 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:41.678450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5e3ed-aac2-4161-9827-84285dbc8e26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:41.680638 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99730c0-2407-4f03-9ad3-8055f580ffad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:41.681387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99730c0-2407-4f03-9ad3-8055f580ffad None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:41.681752 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99730c0-2407-4f03-9ad3-8055f580ffad None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:41.682098 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99730c0-2407-4f03-9ad3-8055f580ffad None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:41.682914 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99730c0-2407-4f03-9ad3-8055f580ffad None admin] RBAC: Adding query filter params (name=member) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:41.683287 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99730c0-2407-4f03-9ad3-8055f580ffad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:41.684789 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99730c0-2407-4f03-9ad3-8055f580ffad None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:41.688227 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-42b5e3ed-aac2-4161-9827-84285dbc8e26 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:35:41.688227 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:41.688227 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:41.688227 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:41.688227 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:41.688227 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:41.688227 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:41.688227 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:41.688227 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:41.688227 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:41.688227 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:41.688227 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:41.688227 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:41.688227 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:41.688227 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:41.688227 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:41.689075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:41.689075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:41.689075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:41.689075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:41.689075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:41.689075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:41.689075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:41.689075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:41.689075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:41.689075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:41.689075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:41.689075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:41.689075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:41.689075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:41.689075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:41.689075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:41.689855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:41.689855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:41.689855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:41.689855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:41.689855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:41.689855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:41.689855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:41.689855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:41.689855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:41.689855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:41.689855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:35:41.689855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:35:41.692520 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 158/310] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:35:41.694017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 153/311] 10.222.0.119 () {56 vars in 1106 bytes} [Thu Jul 14 15:35:41 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:41.701397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5e3ed-aac2-4161-9827-84285dbc8e26 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:41.701547 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99730c0-2407-4f03-9ad3-8055f580ffad None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:41.722201 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:41.812121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5e3ed-aac2-4161-9827-84285dbc8e26 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:41.816774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99730c0-2407-4f03-9ad3-8055f580ffad None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:41.849908 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5037a0-4351-4ed1-b57c-a23958ddb77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:41.851018 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5037a0-4351-4ed1-b57c-a23958ddb77b None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:41.851498 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5037a0-4351-4ed1-b57c-a23958ddb77b None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:41.851969 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5037a0-4351-4ed1-b57c-a23958ddb77b None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:41.853054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5037a0-4351-4ed1-b57c-a23958ddb77b None admin] RBAC: Adding query filter params (name=reader) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:41.853636 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5037a0-4351-4ed1-b57c-a23958ddb77b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:41.855434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5037a0-4351-4ed1-b57c-a23958ddb77b None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:41.855765 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d301c4-8f27-494c-be79-41e2303d0583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:41.856717 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d301c4-8f27-494c-be79-41e2303d0583 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:41.857006 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d301c4-8f27-494c-be79-41e2303d0583 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:41.857284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d301c4-8f27-494c-be79-41e2303d0583 None admin] PATH_INFO: `/v3/users/21652dd9beec4c4b9e332574dc016c61` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:41.858583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d301c4-8f27-494c-be79-41e2303d0583 None admin] RBAC: Authorizing `identity:get_user(user_id=21652dd9beec4c4b9e332574dc016c61)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:41.860125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d301c4-8f27-494c-be79-41e2303d0583 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:41.861783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 154/312] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:41 2022] GET /identity/v3/users/21652dd9beec4c4b9e332574dc016c61 => generated 294 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:41.868119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d301c4-8f27-494c-be79-41e2303d0583 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:41.873219 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 159/313] 10.222.0.119 () {56 vars in 1106 bytes} [Thu Jul 14 15:35:41 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:41.878706 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5037a0-4351-4ed1-b57c-a23958ddb77b None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:41.894408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:41.969114 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:41.985981 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d301c4-8f27-494c-be79-41e2303d0583 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:41.986392 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5037a0-4351-4ed1-b57c-a23958ddb77b None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:42.022980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24ecf5-2d41-4195-a45a-f7319f6544f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:42.023697 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200ffaf-a5da-49f9-b671-017df4d114d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:42.023892 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24ecf5-2d41-4195-a45a-f7319f6544f5 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:42.024162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24ecf5-2d41-4195-a45a-f7319f6544f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:42.024445 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24ecf5-2d41-4195-a45a-f7319f6544f5 None admin] PATH_INFO: `/v3/users/56cccf1fdb6a431a863e657e499d619a` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:42.025505 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200ffaf-a5da-49f9-b671-017df4d114d9 None admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:42.025693 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24ecf5-2d41-4195-a45a-f7319f6544f5 None admin] RBAC: Authorizing `identity:get_user(user_id=56cccf1fdb6a431a863e657e499d619a)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:42.026155 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200ffaf-a5da-49f9-b671-017df4d114d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:42.026624 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200ffaf-a5da-49f9-b671-017df4d114d9 None admin] PATH_INFO: `/v3/system/users/21652dd9beec4c4b9e332574dc016c61/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:42.027301 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24ecf5-2d41-4195-a45a-f7319f6544f5 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:42.028552 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200ffaf-a5da-49f9-b671-017df4d114d9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=21652dd9beec4c4b9e332574dc016c61, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:42.029149 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 160/314] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:41 2022] GET /identity/v3/users/56cccf1fdb6a431a863e657e499d619a => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:42.030691 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200ffaf-a5da-49f9-b671-017df4d114d9 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:42.034288 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24ecf5-2d41-4195-a45a-f7319f6544f5 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:42.120792 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:42.138562 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 155/315] 10.222.0.119 () {58 vars in 1339 bytes} [Thu Jul 14 15:35:41 2022] PUT /identity/v3/system/users/21652dd9beec4c4b9e332574dc016c61/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:35:42.150270 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24ecf5-2d41-4195-a45a-f7319f6544f5 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:42.191486 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61c0fb-f715-42b7-a993-f97ba057296c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:42.192895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61c0fb-f715-42b7-a993-f97ba057296c None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:42.193495 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61c0fb-f715-42b7-a993-f97ba057296c None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:42.194021 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61c0fb-f715-42b7-a993-f97ba057296c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:42.271913 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61c0fb-f715-42b7-a993-f97ba057296c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:42.274274 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61c0fb-f715-42b7-a993-f97ba057296c None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:42.369123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:42.389332 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 161/316] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:35:42 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 15:35:42.395187 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200ffaf-a5da-49f9-b671-017df4d114d9 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:42.508027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200ffaf-a5da-49f9-b671-017df4d114d9 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:42.545476 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33525af-9464-4734-9fb5-52eaf259ba2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:42.546576 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33525af-9464-4734-9fb5-52eaf259ba2b None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:42.547004 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33525af-9464-4734-9fb5-52eaf259ba2b None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:42.547444 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33525af-9464-4734-9fb5-52eaf259ba2b None admin] PATH_INFO: `/v3/projects/af3a7f407f014d858258455b61892383` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:42.548791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33525af-9464-4734-9fb5-52eaf259ba2b None admin] RBAC: Authorizing `identity:get_project(project_id=af3a7f407f014d858258455b61892383)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:42.550365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33525af-9464-4734-9fb5-52eaf259ba2b None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:42.553085 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 156/317] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:42 2022] GET /identity/v3/projects/af3a7f407f014d858258455b61892383 => generated 303 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:42.561170 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61c0fb-f715-42b7-a993-f97ba057296c None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:42.667344 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61c0fb-f715-42b7-a993-f97ba057296c None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:42.703145 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba76c25-cc62-40ab-98a2-cc09d122e1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:42.703809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba76c25-cc62-40ab-98a2-cc09d122e1e8 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:42.704093 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba76c25-cc62-40ab-98a2-cc09d122e1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:42.704406 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba76c25-cc62-40ab-98a2-cc09d122e1e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:42.705240 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba76c25-cc62-40ab-98a2-cc09d122e1e8 None admin] RBAC: Adding query filter params (role.id=37be94aa89aa45db936809e7f660c225, scope.project.id=af3a7f407f014d858258455b61892383, user.id=56cccf1fdb6a431a863e657e499d619a) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:42.705552 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba76c25-cc62-40ab-98a2-cc09d122e1e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:42.706982 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba76c25-cc62-40ab-98a2-cc09d122e1e8 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:42.713175 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 162/318] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:35:42 2022] GET /identity/v3/role_assignments?user.id=56cccf1fdb6a431a863e657e499d619a&scope.project.id=af3a7f407f014d858258455b61892383&role.id=37be94aa89aa45db936809e7f660c225 => generated 610 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:43.258235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9c087-447a-4003-a904-e4401db99029 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:43.258631 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9c087-447a-4003-a904-e4401db99029 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:43.258814 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9c087-447a-4003-a904-e4401db99029 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:43.260470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 157/319] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:43.265445 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41c9fc-048d-4637-8bc6-d16e1da1c45f None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:43.265741 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41c9fc-048d-4637-8bc6-d16e1da1c45f None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:43.266021 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41c9fc-048d-4637-8bc6-d16e1da1c45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:43.282997 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-9f41c9fc-048d-4637-8bc6-d16e1da1c45f None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:43.284203 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-9f41c9fc-048d-4637-8bc6-d16e1da1c45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:43.328874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:43.360144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 163/320] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:43.379155 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9c087-447a-4003-a904-e4401db99029 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:43.391334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20ccd3-1450-4d37-b70a-0fe59bf2d789 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:43.391623 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20ccd3-1450-4d37-b70a-0fe59bf2d789 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:43.391906 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20ccd3-1450-4d37-b70a-0fe59bf2d789 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:43.393442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 164/321] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:43.398593 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bff9a-f0af-4dd2-b9c7-3fb44e251d74 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:43.398888 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bff9a-f0af-4dd2-b9c7-3fb44e251d74 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:43.399166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bff9a-f0af-4dd2-b9c7-3fb44e251d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:43.399819 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:43.416256 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-813bff9a-f0af-4dd2-b9c7-3fb44e251d74 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:43.417439 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-813bff9a-f0af-4dd2-b9c7-3fb44e251d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:43.489731 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 165/322] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:35:43.490289 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9c087-447a-4003-a904-e4401db99029 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:43.517476 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bff9a-f0af-4dd2-b9c7-3fb44e251d74 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:43.530417 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7fe90-8cef-46db-b3b2-5bd86ef0a7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:43.531216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7fe90-8cef-46db-b3b2-5bd86ef0a7a8 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:43.531503 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7fe90-8cef-46db-b3b2-5bd86ef0a7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:43.531782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7fe90-8cef-46db-b3b2-5bd86ef0a7a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:43.532974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7fe90-8cef-46db-b3b2-5bd86ef0a7a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:43.534394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7fe90-8cef-46db-b3b2-5bd86ef0a7a8 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:43.536010 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 158/323] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:35:43 2022] GET /identity/v3/domains/default => generated 200 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:43.542122 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7fe90-8cef-46db-b3b2-5bd86ef0a7a8 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:43.622422 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bff9a-f0af-4dd2-b9c7-3fb44e251d74 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:43.624766 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:43.630973 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:43.647040 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7fe90-8cef-46db-b3b2-5bd86ef0a7a8 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:43.658313 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843ceb5-fe0c-42e4-a593-c6b311d74028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:43.658313 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843ceb5-fe0c-42e4-a593-c6b311d74028 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:43.658559 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843ceb5-fe0c-42e4-a593-c6b311d74028 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:43.658805 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843ceb5-fe0c-42e4-a593-c6b311d74028 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:43.670057 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843ceb5-fe0c-42e4-a593-c6b311d74028 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:43.677931 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-b843ceb5-fe0c-42e4-a593-c6b311d74028 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:35:43.677931 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:43.677931 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:43.677931 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:43.677931 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:43.677931 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:43.677931 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:43.677931 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:43.677931 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:43.677931 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:43.677931 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:43.677931 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:43.677931 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:43.677931 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:43.677931 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:43.677931 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:43.678824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:43.678824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:43.678824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:43.678824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:43.678824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:43.678824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:43.678824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:43.678824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:43.678824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:43.678824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:43.678824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:43.678824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:43.678824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:43.678824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:43.678824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:43.678824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:43.679756 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:43.679756 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:43.679756 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:43.679756 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:43.679756 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:43.679756 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:43.679756 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:43.679756 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:43.679756 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:43.679756 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:43.679756 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:35:43.679756 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:35:43.679756 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 166/324] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:43.685276 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843ceb5-fe0c-42e4-a593-c6b311d74028 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:43.685392 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99016513-510b-492e-b96b-51e1fc4dc5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:43.686036 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99016513-510b-492e-b96b-51e1fc4dc5fd None admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:43.686360 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99016513-510b-492e-b96b-51e1fc4dc5fd None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:43.686872 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99016513-510b-492e-b96b-51e1fc4dc5fd None admin] PATH_INFO: `/v3/groups` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:43.687780 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99016513-510b-492e-b96b-51e1fc4dc5fd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:43.689358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99016513-510b-492e-b96b-51e1fc4dc5fd None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:43.793197 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 159/325] 10.222.0.119 () {60 vars in 1139 bytes} [Thu Jul 14 15:35:43 2022] POST /identity/v3/groups => generated 227 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:35:43.793403 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843ceb5-fe0c-42e4-a593-c6b311d74028 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:43.827175 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61196e-f870-4d86-91e2-16813a7d202e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:43.828398 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61196e-f870-4d86-91e2-16813a7d202e None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:43.828398 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61196e-f870-4d86-91e2-16813a7d202e None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:43.828569 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61196e-f870-4d86-91e2-16813a7d202e None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:43.829295 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61196e-f870-4d86-91e2-16813a7d202e None admin] RBAC: Adding query filter params (name=reader) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:43.829612 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61196e-f870-4d86-91e2-16813a7d202e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:43.831063 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61196e-f870-4d86-91e2-16813a7d202e None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:43.846569 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 167/326] 10.222.0.119 () {56 vars in 1106 bytes} [Thu Jul 14 15:35:43 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:43.847877 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99016513-510b-492e-b96b-51e1fc4dc5fd None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:43.981983 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99016513-510b-492e-b96b-51e1fc4dc5fd None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:44.018544 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02488b-0a76-4ff9-9e5e-5e48e848f4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:44.019795 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02488b-0a76-4ff9-9e5e-5e48e848f4a9 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:44.020086 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02488b-0a76-4ff9-9e5e-5e48e848f4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:44.020395 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02488b-0a76-4ff9-9e5e-5e48e848f4a9 None admin] PATH_INFO: `/v3/users/bb7869beeaf1459fbf2962dc442dbe5a` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:44.022196 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02488b-0a76-4ff9-9e5e-5e48e848f4a9 None admin] RBAC: Authorizing `identity:get_user(user_id=bb7869beeaf1459fbf2962dc442dbe5a)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:44.023650 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02488b-0a76-4ff9-9e5e-5e48e848f4a9 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:44.025760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 160/327] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:43 2022] GET /identity/v3/users/bb7869beeaf1459fbf2962dc442dbe5a => generated 294 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:44.031275 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61196e-f870-4d86-91e2-16813a7d202e None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:44.063094 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:44.142187 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61196e-f870-4d86-91e2-16813a7d202e None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:44.179763 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce883dc9-ff87-4b36-9676-081d90a3e3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:44.181151 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce883dc9-ff87-4b36-9676-081d90a3e3e5 None admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:44.181685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce883dc9-ff87-4b36-9676-081d90a3e3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:44.181943 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce883dc9-ff87-4b36-9676-081d90a3e3e5 None admin] PATH_INFO: `/v3/system/users/bb7869beeaf1459fbf2962dc442dbe5a/roles/37be94aa89aa45db936809e7f660c225` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:44.183527 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce883dc9-ff87-4b36-9676-081d90a3e3e5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bb7869beeaf1459fbf2962dc442dbe5a, role_id=37be94aa89aa45db936809e7f660c225)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:44.186705 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce883dc9-ff87-4b36-9676-081d90a3e3e5 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:44.260815 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 168/328] 10.222.0.119 () {58 vars in 1339 bytes} [Thu Jul 14 15:35:44 2022] PUT /identity/v3/system/users/bb7869beeaf1459fbf2962dc442dbe5a/roles/37be94aa89aa45db936809e7f660c225 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:35:44.289410 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef30efb-79ac-4e5f-b1a6-c01bae094c0e None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:44.290072 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef30efb-79ac-4e5f-b1a6-c01bae094c0e None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:44.290582 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef30efb-79ac-4e5f-b1a6-c01bae094c0e None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:44.292678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 161/329] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:44 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:44.299654 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60daa12-7b70-4eb9-a84d-bb4cbbb2db6f None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:44.300181 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60daa12-7b70-4eb9-a84d-bb4cbbb2db6f None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:44.300387 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60daa12-7b70-4eb9-a84d-bb4cbbb2db6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:44.320524 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-c60daa12-7b70-4eb9-a84d-bb4cbbb2db6f None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:44.321680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-c60daa12-7b70-4eb9-a84d-bb4cbbb2db6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:44.416590 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 169/330] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:35:44.443763 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef30efb-79ac-4e5f-b1a6-c01bae094c0e None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:44.464135 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:44.593293 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef30efb-79ac-4e5f-b1a6-c01bae094c0e None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:44.635204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff505b-e4f8-487b-bc3a-745bb3af2187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:44.636025 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff505b-e4f8-487b-bc3a-745bb3af2187 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:44.636362 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff505b-e4f8-487b-bc3a-745bb3af2187 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:44.636641 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff505b-e4f8-487b-bc3a-745bb3af2187 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:44.650194 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff505b-e4f8-487b-bc3a-745bb3af2187 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:44.660523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-c1ff505b-e4f8-487b-bc3a-745bb3af2187 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:44.660523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:44.660523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:44.660523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:44.660523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:44.660523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:44.660523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:44.660523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:44.660523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:44.660523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:44.660523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:44.660523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:44.660523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:44.660523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:44.660523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:44.660523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:44.661591 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:44.661591 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:44.661591 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:44.661591 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:44.661591 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:44.661591 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:44.661591 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:44.661591 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:44.661591 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:44.661591 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:44.661591 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:44.661591 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:44.661591 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:44.661591 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:44.661591 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:44.661591 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:44.662798 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:44.662798 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:44.662798 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:44.662798 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:44.662798 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:44.662798 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:44.662798 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:44.662798 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:44.662798 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:44.662798 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:44.662798 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:44.662798 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:44.662798 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 162/331] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:35:44.669594 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60daa12-7b70-4eb9-a84d-bb4cbbb2db6f None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:44.707809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:44.806909 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60daa12-7b70-4eb9-a84d-bb4cbbb2db6f None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:44.896255 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0179563-586d-4a43-8f4f-f0b23934e989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:44.896849 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0179563-586d-4a43-8f4f-f0b23934e989 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:44.897135 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0179563-586d-4a43-8f4f-f0b23934e989 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:44.897412 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0179563-586d-4a43-8f4f-f0b23934e989 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:44.898178 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0179563-586d-4a43-8f4f-f0b23934e989 None admin] RBAC: Adding query filter params (name=member) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:44.898485 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0179563-586d-4a43-8f4f-f0b23934e989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:44.899878 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0179563-586d-4a43-8f4f-f0b23934e989 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:44.912893 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 170/332] 10.222.0.119 () {56 vars in 1106 bytes} [Thu Jul 14 15:35:44 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:44.918655 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff505b-e4f8-487b-bc3a-745bb3af2187 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:45.049229 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:45.088247 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff505b-e4f8-487b-bc3a-745bb3af2187 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:45.129821 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60688e-b74f-470e-8141-1a1f251c49ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:45.131485 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60688e-b74f-470e-8141-1a1f251c49ed None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:45.131881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60688e-b74f-470e-8141-1a1f251c49ed None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:45.132188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60688e-b74f-470e-8141-1a1f251c49ed None admin] PATH_INFO: `/v3/users/21652dd9beec4c4b9e332574dc016c61` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:45.133594 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60688e-b74f-470e-8141-1a1f251c49ed None admin] RBAC: Authorizing `identity:get_user(user_id=21652dd9beec4c4b9e332574dc016c61)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:45.135885 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60688e-b74f-470e-8141-1a1f251c49ed None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:45.138615 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 163/333] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:44 2022] GET /identity/v3/users/21652dd9beec4c4b9e332574dc016c61 => generated 294 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:45.144547 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0179563-586d-4a43-8f4f-f0b23934e989 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:45.264063 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:45.282915 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0179563-586d-4a43-8f4f-f0b23934e989 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:45.319123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fba356-fff6-420f-852f-3eea5d35c114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:45.319881 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fba356-fff6-420f-852f-3eea5d35c114 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:45.320134 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fba356-fff6-420f-852f-3eea5d35c114 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:45.320489 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fba356-fff6-420f-852f-3eea5d35c114 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:45.321334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fba356-fff6-420f-852f-3eea5d35c114 None admin] RBAC: Adding query filter params (role.id=14c8b3b550ba4f75a147b8851fd17c7c, user.id=21652dd9beec4c4b9e332574dc016c61, scope.system=all) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:45.321647 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fba356-fff6-420f-852f-3eea5d35c114 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:45.323106 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fba356-fff6-420f-852f-3eea5d35c114 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:45.344210 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 171/334] 10.222.0.119 () {56 vars in 1313 bytes} [Thu Jul 14 15:35:45 2022] GET /identity/v3/role_assignments?user.id=21652dd9beec4c4b9e332574dc016c61&scope.system=all&role.id=14c8b3b550ba4f75a147b8851fd17c7c => generated 512 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:46.481533 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50253c73-96c7-4ba3-8469-24d12283c2b1 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:46.482389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50253c73-96c7-4ba3-8469-24d12283c2b1 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:46.482820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50253c73-96c7-4ba3-8469-24d12283c2b1 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:46.484384 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 164/335] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:46.489878 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d4360-5615-41c4-8a0f-a291f4adabfc None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:46.490800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d4360-5615-41c4-8a0f-a291f4adabfc None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:46.491257 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d4360-5615-41c4-8a0f-a291f4adabfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:46.513733 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-830d4360-5615-41c4-8a0f-a291f4adabfc None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:46.516972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-830d4360-5615-41c4-8a0f-a291f4adabfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:46.622296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 172/336] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:46.657910 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50253c73-96c7-4ba3-8469-24d12283c2b1 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:46.793656 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50253c73-96c7-4ba3-8469-24d12283c2b1 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:46.793821 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f52ee2-3121-451d-a42b-97642cb2f2bf None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:46.793821 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f52ee2-3121-451d-a42b-97642cb2f2bf None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:46.793821 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f52ee2-3121-451d-a42b-97642cb2f2bf None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:46.793821 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 173/337] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:35:46.799653 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ce94c-859a-4ffb-9733-bdb8e697374e None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:46.800273 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ce94c-859a-4ffb-9733-bdb8e697374e None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:46.801163 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ce94c-859a-4ffb-9733-bdb8e697374e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:46.834687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-5a4ce94c-859a-4ffb-9733-bdb8e697374e None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:46.835908 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-5a4ce94c-859a-4ffb-9733-bdb8e697374e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:46.854432 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61b34f-9007-48fe-86af-018768be39ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:46.855257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61b34f-9007-48fe-86af-018768be39ad None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:46.855543 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61b34f-9007-48fe-86af-018768be39ad None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:46.855820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61b34f-9007-48fe-86af-018768be39ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:46.870874 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:46.877610 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61b34f-9007-48fe-86af-018768be39ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:46.890441 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-da61b34f-9007-48fe-86af-018768be39ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:46.890441 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:46.890441 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:46.890441 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:46.890441 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:46.890441 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:46.890441 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:46.890441 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:46.890441 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:46.890441 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:46.890441 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:46.890441 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:46.890441 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:46.890441 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:46.890441 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:46.890441 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:46.891382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:46.891382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:46.891382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:46.891382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:46.891382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:46.891382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:46.891382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:46.891382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:46.891382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:46.891382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:46.891382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:46.891382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:46.891382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:46.891382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:46.891382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:46.891382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:46.892643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:46.892643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:46.892643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:46.892643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:46.892643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:46.892643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:46.892643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:46.892643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:46.892643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:46.892643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:46.892643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:46.892643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:46.892643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 165/338] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:46.899475 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61b34f-9007-48fe-86af-018768be39ad None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:46.946536 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:46.958921 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 174/339] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:47.011897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ce94c-859a-4ffb-9733-bdb8e697374e None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:47.071299 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61b34f-9007-48fe-86af-018768be39ad None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:47.168861 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180fd20-9639-45f0-82e2-4aa44b9abad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:47.169813 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180fd20-9639-45f0-82e2-4aa44b9abad2 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:47.170243 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180fd20-9639-45f0-82e2-4aa44b9abad2 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:47.170666 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180fd20-9639-45f0-82e2-4aa44b9abad2 None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:47.171443 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ce94c-859a-4ffb-9733-bdb8e697374e None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:47.171760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180fd20-9639-45f0-82e2-4aa44b9abad2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:47.172254 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180fd20-9639-45f0-82e2-4aa44b9abad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:47.173793 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180fd20-9639-45f0-82e2-4aa44b9abad2 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:47.187865 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 166/340] 10.222.0.119 () {56 vars in 1106 bytes} [Thu Jul 14 15:35:46 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:47.193760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180fd20-9639-45f0-82e2-4aa44b9abad2 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:47.223220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55104bf7-50c9-4d16-bceb-558c6f7797f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:47.224581 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55104bf7-50c9-4d16-bceb-558c6f7797f4 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:47.224954 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55104bf7-50c9-4d16-bceb-558c6f7797f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:47.228120 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55104bf7-50c9-4d16-bceb-558c6f7797f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:47.241870 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55104bf7-50c9-4d16-bceb-558c6f7797f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:47.254365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-55104bf7-50c9-4d16-bceb-558c6f7797f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:35:47.254365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:47.254365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:47.254365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:47.254365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:47.254365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:47.254365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:47.254365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:47.254365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:47.254365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:47.254365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:47.254365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:47.254365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:47.254365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:47.254365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:47.254365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:47.255775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:47.255775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:47.255775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:47.255775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:47.255775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:47.255775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:47.255775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:47.255775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:47.255775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:47.255775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:47.255775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:47.255775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:47.255775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:47.255775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:47.255775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:47.255775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:47.256744 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:47.256744 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:47.256744 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:47.256744 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:47.256744 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:47.256744 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:47.256744 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:47.256744 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:47.256744 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:47.256744 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:47.256744 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:35:47.256744 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:35:47.256744 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 175/341] 10.222.0.119 () {56 vars in 1119 bytes} [Thu Jul 14 15:35:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:47.265427 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55104bf7-50c9-4d16-bceb-558c6f7797f4 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:47.340720 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:47.352374 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:47.409333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55104bf7-50c9-4d16-bceb-558c6f7797f4 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:47.450133 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180fd20-9639-45f0-82e2-4aa44b9abad2 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:47.462722 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2dfc3-f5e9-4b2f-a044-1e64880f0e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:47.463403 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2dfc3-f5e9-4b2f-a044-1e64880f0e3c None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:47.463688 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2dfc3-f5e9-4b2f-a044-1e64880f0e3c None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:47.463963 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2dfc3-f5e9-4b2f-a044-1e64880f0e3c None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:47.464769 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2dfc3-f5e9-4b2f-a044-1e64880f0e3c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:47.465076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2dfc3-f5e9-4b2f-a044-1e64880f0e3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:47.466880 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2dfc3-f5e9-4b2f-a044-1e64880f0e3c None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:47.475998 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 176/342] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:35:47 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:47.486213 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2dfc3-f5e9-4b2f-a044-1e64880f0e3c None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:47.529518 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b870a-bf91-4046-aa21-8136d724450d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:47.530908 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b870a-bf91-4046-aa21-8136d724450d None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:47.531434 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b870a-bf91-4046-aa21-8136d724450d None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:47.531909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b870a-bf91-4046-aa21-8136d724450d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:47.638771 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b870a-bf91-4046-aa21-8136d724450d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:47.640615 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b870a-bf91-4046-aa21-8136d724450d None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:47.656049 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2dfc3-f5e9-4b2f-a044-1e64880f0e3c None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:47.691600 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:47.710788 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7104a-d6d9-4e5c-8332-6eed0b3dafbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:47.711458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7104a-d6d9-4e5c-8332-6eed0b3dafbf None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:47.711765 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7104a-d6d9-4e5c-8332-6eed0b3dafbf None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:47.712059 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7104a-d6d9-4e5c-8332-6eed0b3dafbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:47.713101 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:47.765612 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 167/343] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:35:47 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:47.772334 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b870a-bf91-4046-aa21-8136d724450d None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:47.848327 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7104a-d6d9-4e5c-8332-6eed0b3dafbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:47.851263 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7104a-d6d9-4e5c-8332-6eed0b3dafbf None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:47.946530 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b870a-bf91-4046-aa21-8136d724450d None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:47.970133 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 177/344] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:35:47 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:47.976121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0531374-e7d0-4f47-812f-1e616b04ff60 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:47.976121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0531374-e7d0-4f47-812f-1e616b04ff60 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:47.976121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0531374-e7d0-4f47-812f-1e616b04ff60 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:47.976121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 178/345] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:47.976121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7b12a-a89f-47ca-a5e2-e81420ea3fce None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:47.976121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7b12a-a89f-47ca-a5e2-e81420ea3fce None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:47.976550 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7b12a-a89f-47ca-a5e2-e81420ea3fce None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:47.977249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 179/346] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:47.977945 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7b12a-a89f-47ca-a5e2-e81420ea3fce None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:47.996873 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ec152-b049-4cd3-b75c-1d743b271ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:47.998298 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ec152-b049-4cd3-b75c-1d743b271ff6 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:47.998790 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ec152-b049-4cd3-b75c-1d743b271ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:47.999349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ec152-b049-4cd3-b75c-1d743b271ff6 None admin] PATH_INFO: `/v3/projects/327221ec271a4464b199d5dd0216670d` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:48.000623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ec152-b049-4cd3-b75c-1d743b271ff6 None admin] RBAC: Authorizing `identity:get_project(project_id=327221ec271a4464b199d5dd0216670d)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:48.002178 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ec152-b049-4cd3-b75c-1d743b271ff6 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:48.003914 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 168/347] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:47 2022] GET /identity/v3/projects/327221ec271a4464b199d5dd0216670d => generated 299 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:48.004801 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:48.006547 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb0961-2bd3-4872-9594-1e018733e49c None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:48.006903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb0961-2bd3-4872-9594-1e018733e49c None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:48.007189 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb0961-2bd3-4872-9594-1e018733e49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:48.026661 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-1dfb0961-2bd3-4872-9594-1e018733e49c None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:48.028279 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-1dfb0961-2bd3-4872-9594-1e018733e49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:48.061582 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:48.100059 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7b12a-a89f-47ca-a5e2-e81420ea3fce None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:48.126812 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 169/348] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:48.128497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a835dd7-81d6-455b-a3de-58307c277e82 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:48.129010 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a835dd7-81d6-455b-a3de-58307c277e82 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:48.129550 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a835dd7-81d6-455b-a3de-58307c277e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:48.151214 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-8a835dd7-81d6-455b-a3de-58307c277e82 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:48.152767 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-8a835dd7-81d6-455b-a3de-58307c277e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:48.159655 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a5af4-115e-44a2-9c48-5c4084ff3a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:48.160710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a5af4-115e-44a2-9c48-5c4084ff3a40 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:48.161096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a5af4-115e-44a2-9c48-5c4084ff3a40 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:48.162119 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a5af4-115e-44a2-9c48-5c4084ff3a40 None admin] PATH_INFO: `/v3/projects/327221ec271a4464b199d5dd0216670d` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:48.164921 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a5af4-115e-44a2-9c48-5c4084ff3a40 None admin] RBAC: Authorizing `identity:get_project(project_id=327221ec271a4464b199d5dd0216670d)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:48.166462 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a5af4-115e-44a2-9c48-5c4084ff3a40 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:48.168237 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 180/349] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:47 2022] GET /identity/v3/projects/327221ec271a4464b199d5dd0216670d => generated 299 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:48.169680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f122c-fc79-4f50-8c45-1df0fd002a7a None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:48.169978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f122c-fc79-4f50-8c45-1df0fd002a7a None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:48.170263 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f122c-fc79-4f50-8c45-1df0fd002a7a None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:48.171615 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 181/350] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:48.172348 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f122c-fc79-4f50-8c45-1df0fd002a7a None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:48.243313 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 170/351] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:48.244123 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a835dd7-81d6-455b-a3de-58307c277e82 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:48.285393 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:48.293294 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f122c-fc79-4f50-8c45-1df0fd002a7a None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:48.339220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f27d7-7d78-430e-a36c-ff57e23ab56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:48.341081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f27d7-7d78-430e-a36c-ff57e23ab56a None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:48.341934 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f27d7-7d78-430e-a36c-ff57e23ab56a None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:48.342305 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f27d7-7d78-430e-a36c-ff57e23ab56a None admin] PATH_INFO: `/v3/groups/b4fc586369ae470cbdb2f810d6158486` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:48.349252 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f27d7-7d78-430e-a36c-ff57e23ab56a None admin] RBAC: Authorizing `identity:get_group(group_id=b4fc586369ae470cbdb2f810d6158486)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:48.352026 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f27d7-7d78-430e-a36c-ff57e23ab56a None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:48.355290 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:48.359513 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 182/352] 10.222.0.119 () {56 vars in 1185 bytes} [Thu Jul 14 15:35:48 2022] GET /identity/v3/groups/b4fc586369ae470cbdb2f810d6158486 => generated 227 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:48.360870 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6470a6-fe01-41b6-b2f7-3678d1938c21 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:48.361154 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6470a6-fe01-41b6-b2f7-3678d1938c21 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:48.361447 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6470a6-fe01-41b6-b2f7-3678d1938c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:48.363702 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a835dd7-81d6-455b-a3de-58307c277e82 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:48.380345 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-bc6470a6-fe01-41b6-b2f7-3678d1938c21 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:48.381556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-bc6470a6-fe01-41b6-b2f7-3678d1938c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:48.409923 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5eae5-4692-4c7a-b1c3-637dae928327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:48.410788 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5eae5-4692-4c7a-b1c3-637dae928327 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:48.411073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5eae5-4692-4c7a-b1c3-637dae928327 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:48.411752 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5eae5-4692-4c7a-b1c3-637dae928327 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:48.426640 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5eae5-4692-4c7a-b1c3-637dae928327 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:48.438126 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-4dd5eae5-4692-4c7a-b1c3-637dae928327 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:35:48.438126 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:48.438126 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:48.438126 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:48.438126 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:48.438126 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:48.438126 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:48.438126 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:48.438126 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:48.438126 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:48.438126 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:48.438126 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:48.438126 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:48.438126 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:48.438126 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:48.438126 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:48.439087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:48.439087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:48.439087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:48.439087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:48.439087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:48.439087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:48.439087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:48.439087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:48.439087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:48.439087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:48.439087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:48.439087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:48.439087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:48.439087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:48.439087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:48.439087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:48.439903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:48.439903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:48.439903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:48.439903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:48.439903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:48.439903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:48.439903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:48.439903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:48.439903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:48.439903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:48.439903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:35:48.439903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:48.439903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 171/353] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:48.441160 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5eae5-4692-4c7a-b1c3-637dae928327 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:48.472161 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 183/354] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:48.472161 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6470a6-fe01-41b6-b2f7-3678d1938c21 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:48.578239 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5eae5-4692-4c7a-b1c3-637dae928327 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:48.581610 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:48.603038 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6470a6-fe01-41b6-b2f7-3678d1938c21 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:48.619893 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a9335-4500-43be-8c02-0022cc0b8948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:48.620819 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a9335-4500-43be-8c02-0022cc0b8948 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:48.621108 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a9335-4500-43be-8c02-0022cc0b8948 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:48.621392 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a9335-4500-43be-8c02-0022cc0b8948 None admin] PATH_INFO: `/v3/groups/b4fc586369ae470cbdb2f810d6158486` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:48.622566 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a9335-4500-43be-8c02-0022cc0b8948 None admin] RBAC: Authorizing `identity:get_group(group_id=b4fc586369ae470cbdb2f810d6158486)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:48.624020 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a9335-4500-43be-8c02-0022cc0b8948 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:48.625700 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 172/355] 10.222.0.119 () {56 vars in 1185 bytes} [Thu Jul 14 15:35:48 2022] GET /identity/v3/groups/b4fc586369ae470cbdb2f810d6158486 => generated 227 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:48.626547 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a9335-4500-43be-8c02-0022cc0b8948 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:48.648003 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc6ffa-737c-4dfc-86ff-68466b2b4df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:48.649328 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc6ffa-737c-4dfc-86ff-68466b2b4df4 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:48.649938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc6ffa-737c-4dfc-86ff-68466b2b4df4 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:48.650358 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc6ffa-737c-4dfc-86ff-68466b2b4df4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:48.650796 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:48.668508 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc6ffa-737c-4dfc-86ff-68466b2b4df4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:48.677277 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-30cc6ffa-737c-4dfc-86ff-68466b2b4df4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:48.677277 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:48.677277 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:48.677277 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:48.677277 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:48.677277 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:48.677277 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:48.677277 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:48.677277 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:48.677277 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:48.677277 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:48.677277 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:48.677277 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:48.677277 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:48.677277 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:48.677277 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:48.678184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:48.678184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:48.678184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:48.678184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:48.678184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:48.678184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:48.678184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:48.678184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:48.678184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:48.678184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:48.678184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:48.678184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:48.678184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:48.678184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:48.678184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:48.678184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:48.678948 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:48.678948 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:48.678948 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:48.678948 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:48.678948 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:48.678948 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:48.678948 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:48.678948 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:48.678948 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:48.678948 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:48.678948 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:48.678948 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:35:48.681651 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 184/356] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:48.682624 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc6ffa-737c-4dfc-86ff-68466b2b4df4 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:48.756143 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a9335-4500-43be-8c02-0022cc0b8948 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:48.799730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550fe20-f92f-4917-b07d-269a1783feab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:48.800394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550fe20-f92f-4917-b07d-269a1783feab None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:48.800686 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550fe20-f92f-4917-b07d-269a1783feab None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:48.800965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550fe20-f92f-4917-b07d-269a1783feab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:48.801811 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550fe20-f92f-4917-b07d-269a1783feab None admin] RBAC: Adding query filter params (group.id=b4fc586369ae470cbdb2f810d6158486, role.id=14c8b3b550ba4f75a147b8851fd17c7c, scope.project.id=327221ec271a4464b199d5dd0216670d) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:48.802201 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550fe20-f92f-4917-b07d-269a1783feab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:48.803965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550fe20-f92f-4917-b07d-269a1783feab None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:48.810363 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 173/357] 10.222.0.119 () {56 vars in 1381 bytes} [Thu Jul 14 15:35:48 2022] GET /identity/v3/role_assignments?group.id=b4fc586369ae470cbdb2f810d6158486&scope.project.id=327221ec271a4464b199d5dd0216670d&role.id=14c8b3b550ba4f75a147b8851fd17c7c => generated 261 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:48.812368 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550fe20-f92f-4917-b07d-269a1783feab None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:48.826864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc6ffa-737c-4dfc-86ff-68466b2b4df4 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:48.883335 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666294c-0419-4dae-92a4-da15d6a94f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:48.884505 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666294c-0419-4dae-92a4-da15d6a94f13 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:48.884798 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666294c-0419-4dae-92a4-da15d6a94f13 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:48.885082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666294c-0419-4dae-92a4-da15d6a94f13 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:48.885865 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666294c-0419-4dae-92a4-da15d6a94f13 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:48.886184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666294c-0419-4dae-92a4-da15d6a94f13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:48.887727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666294c-0419-4dae-92a4-da15d6a94f13 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:48.906352 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 185/358] 10.222.0.119 () {56 vars in 1106 bytes} [Thu Jul 14 15:35:48 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:48.906352 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666294c-0419-4dae-92a4-da15d6a94f13 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:48.920460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:48.933756 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:48.968679 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550fe20-f92f-4917-b07d-269a1783feab None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:49.019204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df785302-4054-4961-8529-2ead0b2f9c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:49.020082 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df785302-4054-4961-8529-2ead0b2f9c52 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:49.020415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df785302-4054-4961-8529-2ead0b2f9c52 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:49.020745 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df785302-4054-4961-8529-2ead0b2f9c52 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:49.032558 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df785302-4054-4961-8529-2ead0b2f9c52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:49.039295 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666294c-0419-4dae-92a4-da15d6a94f13 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:49.042804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-df785302-4054-4961-8529-2ead0b2f9c52 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:35:49.042804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:49.042804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:49.042804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:49.042804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:49.042804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:49.042804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:49.042804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:49.042804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:49.042804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:49.042804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:49.042804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:49.042804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:49.042804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:49.042804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:49.042804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:49.043673 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:49.043673 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:49.043673 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:49.043673 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:49.043673 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:49.043673 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:49.043673 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:49.043673 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:49.043673 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:49.043673 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:49.043673 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:49.043673 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:49.043673 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:49.043673 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:49.043673 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:49.043673 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:49.044483 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:49.044483 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:49.044483 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:49.044483 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:49.044483 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:49.044483 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:49.044483 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:49.044483 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:49.044483 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:49.044483 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:49.044483 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:35:49.044483 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:49.044483 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 174/359] 10.222.0.119 () {56 vars in 1119 bytes} [Thu Jul 14 15:35:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:49.045709 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df785302-4054-4961-8529-2ead0b2f9c52 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:49.084767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23324048-5a2c-4c1c-ba3f-535f90879c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:49.085447 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23324048-5a2c-4c1c-ba3f-535f90879c72 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:49.085736 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23324048-5a2c-4c1c-ba3f-535f90879c72 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:49.086020 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23324048-5a2c-4c1c-ba3f-535f90879c72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:49.086940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23324048-5a2c-4c1c-ba3f-535f90879c72 None admin] RBAC: Adding query filter params (group.id=b4fc586369ae470cbdb2f810d6158486, role.id=71b77f014251450eac200e62300144ab, scope.project.id=327221ec271a4464b199d5dd0216670d) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:49.087394 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23324048-5a2c-4c1c-ba3f-535f90879c72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:49.089006 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23324048-5a2c-4c1c-ba3f-535f90879c72 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:49.097274 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 186/360] 10.222.0.119 () {56 vars in 1381 bytes} [Thu Jul 14 15:35:48 2022] GET /identity/v3/role_assignments?group.id=b4fc586369ae470cbdb2f810d6158486&scope.project.id=327221ec271a4464b199d5dd0216670d&role.id=71b77f014251450eac200e62300144ab => generated 261 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:49.097574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23324048-5a2c-4c1c-ba3f-535f90879c72 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:49.182919 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df785302-4054-4961-8529-2ead0b2f9c52 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:49.208084 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:49.230700 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c95f6-f591-43b3-8101-3242e663de2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:49.235183 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c95f6-f591-43b3-8101-3242e663de2b None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:49.235183 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c95f6-f591-43b3-8101-3242e663de2b None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:49.235183 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c95f6-f591-43b3-8101-3242e663de2b None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:49.235183 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c95f6-f591-43b3-8101-3242e663de2b None admin] RBAC: Adding query filter params (name=member) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:49.235183 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c95f6-f591-43b3-8101-3242e663de2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:49.235183 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c95f6-f591-43b3-8101-3242e663de2b None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:49.245995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 175/361] 10.222.0.119 () {56 vars in 1106 bytes} [Thu Jul 14 15:35:49 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:49.252524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5c3df-2a6c-408d-b46b-3b78cdfaa8f2 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:49.252762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23324048-5a2c-4c1c-ba3f-535f90879c72 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:49.253042 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5c3df-2a6c-408d-b46b-3b78cdfaa8f2 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:49.253302 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5c3df-2a6c-408d-b46b-3b78cdfaa8f2 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:49.256739 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 176/362] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:49 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:49.257779 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5c3df-2a6c-408d-b46b-3b78cdfaa8f2 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:49.264345 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:49.297575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1b97d-b5c3-424a-b9a8-6e11832c0b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:49.299078 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1b97d-b5c3-424a-b9a8-6e11832c0b70 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:49.299557 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1b97d-b5c3-424a-b9a8-6e11832c0b70 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:49.300389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1b97d-b5c3-424a-b9a8-6e11832c0b70 None admin] PATH_INFO: `/v3/users/bb7869beeaf1459fbf2962dc442dbe5a` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:49.302917 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1b97d-b5c3-424a-b9a8-6e11832c0b70 None admin] RBAC: Authorizing `identity:get_user(user_id=bb7869beeaf1459fbf2962dc442dbe5a)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:49.304433 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1b97d-b5c3-424a-b9a8-6e11832c0b70 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:49.306518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 187/363] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:35:49 2022] GET /identity/v3/users/bb7869beeaf1459fbf2962dc442dbe5a => generated 294 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:49.308237 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1b97d-b5c3-424a-b9a8-6e11832c0b70 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:49.405301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5c3df-2a6c-408d-b46b-3b78cdfaa8f2 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:49.444323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e4a16-89b1-4ce0-8a5b-5c3388e6d207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:49.445010 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e4a16-89b1-4ce0-8a5b-5c3388e6d207 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:49.445294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e4a16-89b1-4ce0-8a5b-5c3388e6d207 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:49.445570 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e4a16-89b1-4ce0-8a5b-5c3388e6d207 None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:49.446331 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e4a16-89b1-4ce0-8a5b-5c3388e6d207 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:49.446646 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e4a16-89b1-4ce0-8a5b-5c3388e6d207 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:49.448026 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e4a16-89b1-4ce0-8a5b-5c3388e6d207 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:49.455212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1b97d-b5c3-424a-b9a8-6e11832c0b70 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:49.457222 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 177/364] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:35:49 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:49.458553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff921b-6bfe-42fa-aa59-44ce1c213140 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:49.458874 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff921b-6bfe-42fa-aa59-44ce1c213140 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:49.459266 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff921b-6bfe-42fa-aa59-44ce1c213140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:49.480659 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-efff921b-6bfe-42fa-aa59-44ce1c213140 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:49.481872 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-efff921b-6bfe-42fa-aa59-44ce1c213140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:49.501608 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbd0d1-c1e2-4f52-aa1d-72adc21c7eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:49.502277 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbd0d1-c1e2-4f52-aa1d-72adc21c7eba None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:49.502617 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbd0d1-c1e2-4f52-aa1d-72adc21c7eba None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:49.502950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbd0d1-c1e2-4f52-aa1d-72adc21c7eba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:49.520121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:49.561660 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:49.570119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 178/365] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:49.570968 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff921b-6bfe-42fa-aa59-44ce1c213140 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:49.593624 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afbd0d1-c1e2-4f52-aa1d-72adc21c7eba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:49.595154 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afbd0d1-c1e2-4f52-aa1d-72adc21c7eba None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:49.729287 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff921b-6bfe-42fa-aa59-44ce1c213140 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:49.734161 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 188/366] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:35:49 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:49.734161 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbd0d1-c1e2-4f52-aa1d-72adc21c7eba None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:49.779241 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:49.781049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92e7ab-cdad-45a7-bb96-3c1deb5b1bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:49.782043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92e7ab-cdad-45a7-bb96-3c1deb5b1bfc None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:49.782547 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92e7ab-cdad-45a7-bb96-3c1deb5b1bfc None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:49.783037 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92e7ab-cdad-45a7-bb96-3c1deb5b1bfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:49.784075 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92e7ab-cdad-45a7-bb96-3c1deb5b1bfc None admin] RBAC: Adding query filter params (role.id=37be94aa89aa45db936809e7f660c225, user.id=bb7869beeaf1459fbf2962dc442dbe5a, scope.system=all) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:49.785150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92e7ab-cdad-45a7-bb96-3c1deb5b1bfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:49.786857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92e7ab-cdad-45a7-bb96-3c1deb5b1bfc None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:49.804221 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 179/367] 10.222.0.119 () {56 vars in 1313 bytes} [Thu Jul 14 15:35:49 2022] GET /identity/v3/role_assignments?user.id=bb7869beeaf1459fbf2962dc442dbe5a&scope.system=all&role.id=37be94aa89aa45db936809e7f660c225 => generated 512 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:49.805500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92e7ab-cdad-45a7-bb96-3c1deb5b1bfc None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:49.852748 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbd0d1-c1e2-4f52-aa1d-72adc21c7eba None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:49.895106 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02316da-fe25-4132-9f85-4cfe87afb07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:49.896362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02316da-fe25-4132-9f85-4cfe87afb07b None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:49.896660 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02316da-fe25-4132-9f85-4cfe87afb07b None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:49.896934 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02316da-fe25-4132-9f85-4cfe87afb07b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:49.924271 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:49.976294 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02316da-fe25-4132-9f85-4cfe87afb07b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:49.978008 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02316da-fe25-4132-9f85-4cfe87afb07b None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:49.987293 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92e7ab-cdad-45a7-bb96-3c1deb5b1bfc None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:50.032481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:50.035928 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc9eee-c470-448d-ac34-8db79bf639e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:50.037243 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc9eee-c470-448d-ac34-8db79bf639e6 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:50.041795 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc9eee-c470-448d-ac34-8db79bf639e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:50.041795 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc9eee-c470-448d-ac34-8db79bf639e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:50.051407 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc9eee-c470-448d-ac34-8db79bf639e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:50.061043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-bfdc9eee-c470-448d-ac34-8db79bf639e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:35:50.061043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:50.061043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:50.061043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:50.061043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:50.061043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:50.061043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:50.061043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:50.061043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:50.061043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:50.061043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:50.061043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:50.061043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:50.061043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:50.061043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:50.061043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:50.062308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:50.062308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:50.062308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:50.062308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:50.062308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:50.062308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:50.062308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:50.062308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:50.062308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:50.062308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:50.062308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:50.062308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:50.062308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:50.062308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:50.062308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:50.062308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:50.063141 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:50.063141 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:50.063141 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:50.063141 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:50.063141 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:50.063141 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:50.063141 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:50.063141 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:50.063141 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:50.063141 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:50.063141 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:35:50.063141 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:50.066077 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 180/368] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:35:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:50.067261 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc9eee-c470-448d-ac34-8db79bf639e6 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:50.094842 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 189/369] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:35:49 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:50.095814 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02316da-fe25-4132-9f85-4cfe87afb07b None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:50.183811 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc9eee-c470-448d-ac34-8db79bf639e6 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:50.202195 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:50.214587 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02316da-fe25-4132-9f85-4cfe87afb07b None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:50.223793 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f64f61-1ee2-4118-8073-fee82e9b2cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:50.225802 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f64f61-1ee2-4118-8073-fee82e9b2cb7 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:50.226277 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f64f61-1ee2-4118-8073-fee82e9b2cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:50.226800 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f64f61-1ee2-4118-8073-fee82e9b2cb7 None admin] PATH_INFO: `/v3/projects/af3a7f407f014d858258455b61892383` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:50.228974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f64f61-1ee2-4118-8073-fee82e9b2cb7 None admin] RBAC: Authorizing `identity:get_project(project_id=af3a7f407f014d858258455b61892383)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:50.230904 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f64f61-1ee2-4118-8073-fee82e9b2cb7 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:50.235686 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 181/370] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:50 2022] GET /identity/v3/projects/af3a7f407f014d858258455b61892383 => generated 303 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:50.236791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f64f61-1ee2-4118-8073-fee82e9b2cb7 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:50.255887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eaec4e-289a-4498-81bf-8f115f3d28c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:50.257629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaec4e-289a-4498-81bf-8f115f3d28c3 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:50.257925 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaec4e-289a-4498-81bf-8f115f3d28c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:50.258491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaec4e-289a-4498-81bf-8f115f3d28c3 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:50.259194 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eaec4e-289a-4498-81bf-8f115f3d28c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:50.259515 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eaec4e-289a-4498-81bf-8f115f3d28c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:50.261074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eaec4e-289a-4498-81bf-8f115f3d28c3 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:50.269238 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:50.272467 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 190/371] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:50 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:50.273274 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eaec4e-289a-4498-81bf-8f115f3d28c3 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:50.348557 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f64f61-1ee2-4118-8073-fee82e9b2cb7 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:50.387635 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eaec4e-289a-4498-81bf-8f115f3d28c3 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:50.388038 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e272b5-269b-47b2-9c2e-9afe88bd0bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:50.389163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e272b5-269b-47b2-9c2e-9afe88bd0bc4 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:50.389638 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e272b5-269b-47b2-9c2e-9afe88bd0bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:50.390098 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e272b5-269b-47b2-9c2e-9afe88bd0bc4 None admin] PATH_INFO: `/v3/projects/af3a7f407f014d858258455b61892383` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:50.396926 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e272b5-269b-47b2-9c2e-9afe88bd0bc4 None admin] RBAC: Authorizing `identity:get_project(project_id=af3a7f407f014d858258455b61892383)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:50.398391 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e272b5-269b-47b2-9c2e-9afe88bd0bc4 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:50.400505 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 182/372] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:50 2022] GET /identity/v3/projects/af3a7f407f014d858258455b61892383 => generated 303 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:50.401281 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e272b5-269b-47b2-9c2e-9afe88bd0bc4 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:50.432670 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fad41-bdf9-4f79-94b8-00b3109ed9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:50.433553 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fad41-bdf9-4f79-94b8-00b3109ed9d5 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:50.433897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fad41-bdf9-4f79-94b8-00b3109ed9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:50.434177 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fad41-bdf9-4f79-94b8-00b3109ed9d5 None admin] PATH_INFO: `/v3/groups/b4fc586369ae470cbdb2f810d6158486` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:50.435391 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fad41-bdf9-4f79-94b8-00b3109ed9d5 None admin] RBAC: Authorizing `identity:get_group(group_id=b4fc586369ae470cbdb2f810d6158486)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:50.436887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fad41-bdf9-4f79-94b8-00b3109ed9d5 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:50.438817 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 191/373] 10.222.0.119 () {56 vars in 1185 bytes} [Thu Jul 14 15:35:50 2022] GET /identity/v3/groups/b4fc586369ae470cbdb2f810d6158486 => generated 227 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:50.439595 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fad41-bdf9-4f79-94b8-00b3109ed9d5 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:50.500764 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:50.533584 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:50.572894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e272b5-269b-47b2-9c2e-9afe88bd0bc4 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:50.580694 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fad41-bdf9-4f79-94b8-00b3109ed9d5 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:50.614448 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86d548-9c38-4774-ac38-b0013c8f5dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:50.616119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86d548-9c38-4774-ac38-b0013c8f5dd9 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:50.616638 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86d548-9c38-4774-ac38-b0013c8f5dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:50.617109 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86d548-9c38-4774-ac38-b0013c8f5dd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:50.632637 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0580c3-c7ee-4326-be22-d781767f5cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:50.634591 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0580c3-c7ee-4326-be22-d781767f5cbd None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:50.635008 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0580c3-c7ee-4326-be22-d781767f5cbd None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:50.635424 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0580c3-c7ee-4326-be22-d781767f5cbd None admin] PATH_INFO: `/v3/groups/b4fc586369ae470cbdb2f810d6158486` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:50.637003 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0580c3-c7ee-4326-be22-d781767f5cbd None admin] RBAC: Authorizing `identity:get_group(group_id=b4fc586369ae470cbdb2f810d6158486)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:50.638459 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0580c3-c7ee-4326-be22-d781767f5cbd None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:50.640283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 192/374] 10.222.0.119 () {56 vars in 1185 bytes} [Thu Jul 14 15:35:50 2022] GET /identity/v3/groups/b4fc586369ae470cbdb2f810d6158486 => generated 227 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:50.642671 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0580c3-c7ee-4326-be22-d781767f5cbd None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:50.703897 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86d548-9c38-4774-ac38-b0013c8f5dd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:50.705408 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86d548-9c38-4774-ac38-b0013c8f5dd9 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:50.782414 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0580c3-c7ee-4326-be22-d781767f5cbd None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:50.783317 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:50.830368 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ece7a-ad25-48cc-9273-78165bb18091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:50.831039 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ece7a-ad25-48cc-9273-78165bb18091 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:50.831330 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ece7a-ad25-48cc-9273-78165bb18091 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:50.831879 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ece7a-ad25-48cc-9273-78165bb18091 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:50.833767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ece7a-ad25-48cc-9273-78165bb18091 None admin] RBAC: Adding query filter params (group.id=b4fc586369ae470cbdb2f810d6158486, role.id=14c8b3b550ba4f75a147b8851fd17c7c, scope.project.id=af3a7f407f014d858258455b61892383) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:50.834099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ece7a-ad25-48cc-9273-78165bb18091 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:50.836293 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ece7a-ad25-48cc-9273-78165bb18091 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:50.841312 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:50.843674 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 183/375] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:35:50 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:50.844642 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86d548-9c38-4774-ac38-b0013c8f5dd9 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:50.845617 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 193/376] 10.222.0.119 () {56 vars in 1381 bytes} [Thu Jul 14 15:35:50 2022] GET /identity/v3/role_assignments?group.id=b4fc586369ae470cbdb2f810d6158486&scope.project.id=af3a7f407f014d858258455b61892383&role.id=14c8b3b550ba4f75a147b8851fd17c7c => generated 261 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:50.851428 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ece7a-ad25-48cc-9273-78165bb18091 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:50.999500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86d548-9c38-4774-ac38-b0013c8f5dd9 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:51.028322 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ece7a-ad25-48cc-9273-78165bb18091 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:51.060500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224aa31-6308-4420-ad7e-a1e11abddac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:51.061369 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224aa31-6308-4420-ad7e-a1e11abddac0 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:51.062304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224aa31-6308-4420-ad7e-a1e11abddac0 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:51.062597 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224aa31-6308-4420-ad7e-a1e11abddac0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:51.063464 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224aa31-6308-4420-ad7e-a1e11abddac0 None admin] RBAC: Adding query filter params (group.id=b4fc586369ae470cbdb2f810d6158486, role.id=71b77f014251450eac200e62300144ab, scope.project.id=af3a7f407f014d858258455b61892383) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:51.063785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224aa31-6308-4420-ad7e-a1e11abddac0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:51.065329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224aa31-6308-4420-ad7e-a1e11abddac0 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:51.079137 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 184/377] 10.222.0.119 () {56 vars in 1381 bytes} [Thu Jul 14 15:35:50 2022] GET /identity/v3/role_assignments?group.id=b4fc586369ae470cbdb2f810d6158486&scope.project.id=af3a7f407f014d858258455b61892383&role.id=71b77f014251450eac200e62300144ab => generated 261 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:51.090867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b5fca-f0be-45b8-9772-a9e5e63e293a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:51.092261 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b5fca-f0be-45b8-9772-a9e5e63e293a None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:51.092759 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b5fca-f0be-45b8-9772-a9e5e63e293a None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:51.093241 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b5fca-f0be-45b8-9772-a9e5e63e293a None admin] PATH_INFO: `/v3/projects/a12def5ec62e451d99b7e6dd6faef1ba` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:51.094942 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b5fca-f0be-45b8-9772-a9e5e63e293a None admin] RBAC: Authorizing `identity:get_project(project_id=a12def5ec62e451d99b7e6dd6faef1ba)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:51.096805 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b5fca-f0be-45b8-9772-a9e5e63e293a None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:51.099251 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 194/378] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:50 2022] GET /identity/v3/projects/a12def5ec62e451d99b7e6dd6faef1ba => generated 345 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:51.104890 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224aa31-6308-4420-ad7e-a1e11abddac0 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:51.131099 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:51.252872 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224aa31-6308-4420-ad7e-a1e11abddac0 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:51.291095 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2097d-f40e-4067-8890-e2c3a641bfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:51.291967 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2097d-f40e-4067-8890-e2c3a641bfb8 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:51.292299 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2097d-f40e-4067-8890-e2c3a641bfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:51.292572 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2097d-f40e-4067-8890-e2c3a641bfb8 None admin] PATH_INFO: `/v3/groups/40e773591d5048ec8cbf414185684c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:51.299181 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2097d-f40e-4067-8890-e2c3a641bfb8 None admin] RBAC: Authorizing `identity:get_group(group_id=40e773591d5048ec8cbf414185684c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:51.300681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2097d-f40e-4067-8890-e2c3a641bfb8 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:51.302851 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 185/379] 10.222.0.119 () {56 vars in 1185 bytes} [Thu Jul 14 15:35:51 2022] GET /identity/v3/groups/40e773591d5048ec8cbf414185684c7c => generated 230 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:51.308199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b5fca-f0be-45b8-9772-a9e5e63e293a None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:51.326423 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61005279-b7e7-41a9-bdbf-25d97d7748ff None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:51.326610 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61005279-b7e7-41a9-bdbf-25d97d7748ff None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:51.326896 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61005279-b7e7-41a9-bdbf-25d97d7748ff None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:51.328516 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 186/380] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:51.334695 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b499d-f78d-46e6-b701-bebea3acde12 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:51.334989 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b499d-f78d-46e6-b701-bebea3acde12 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:51.335268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b499d-f78d-46e6-b701-bebea3acde12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:51.353542 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-1d6b499d-f78d-46e6-b701-bebea3acde12 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:51.354740 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-1d6b499d-f78d-46e6-b701-bebea3acde12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:51.411915 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:51.452191 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b5fca-f0be-45b8-9772-a9e5e63e293a None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:51.502315 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 187/381] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:35:51.507678 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8572d8b-7ac4-4451-9751-c25b9a4f21ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:51.508397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8572d8b-7ac4-4451-9751-c25b9a4f21ae None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:51.508687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8572d8b-7ac4-4451-9751-c25b9a4f21ae None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:51.508974 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8572d8b-7ac4-4451-9751-c25b9a4f21ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:51.509835 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8572d8b-7ac4-4451-9751-c25b9a4f21ae None admin] RBAC: Adding query filter params (group.id=40e773591d5048ec8cbf414185684c7c, role.id=07aaf007cde043318319928d151bdc75, scope.project.id=a12def5ec62e451d99b7e6dd6faef1ba) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:51.510155 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8572d8b-7ac4-4451-9751-c25b9a4f21ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:51.511630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8572d8b-7ac4-4451-9751-c25b9a4f21ae None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:51.520169 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 195/382] 10.222.0.119 () {56 vars in 1381 bytes} [Thu Jul 14 15:35:51 2022] GET /identity/v3/role_assignments?group.id=40e773591d5048ec8cbf414185684c7c&scope.project.id=a12def5ec62e451d99b7e6dd6faef1ba&role.id=07aaf007cde043318319928d151bdc75 => generated 261 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:51.546379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b499d-f78d-46e6-b701-bebea3acde12 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:51.558033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:51.685075 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b499d-f78d-46e6-b701-bebea3acde12 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:51.728416 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081aef8-dd3d-40ee-985e-199d6f393a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:51.729602 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081aef8-dd3d-40ee-985e-199d6f393a40 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:51.730086 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081aef8-dd3d-40ee-985e-199d6f393a40 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:51.730577 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081aef8-dd3d-40ee-985e-199d6f393a40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:51.742215 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081aef8-dd3d-40ee-985e-199d6f393a40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:51.750436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-5081aef8-dd3d-40ee-985e-199d6f393a40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:51.750436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:51.750436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:51.750436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:51.750436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:51.750436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:51.750436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:51.750436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:51.750436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:51.750436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:51.750436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:51.750436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:51.750436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:51.750436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:51.750436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:51.750436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:51.751324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:51.751324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:51.751324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:51.751324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:51.751324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:51.751324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:51.751324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:51.751324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:51.751324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:51.751324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:51.751324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:51.751324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:51.751324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:51.751324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:51.751324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:51.751324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:51.752129 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:51.752129 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:51.752129 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:51.752129 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:51.752129 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:51.752129 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:51.752129 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:51.752129 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:51.752129 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:51.752129 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:51.752129 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:51.752129 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:51.755006 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 188/383] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:51.761384 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8572d8b-7ac4-4451-9751-c25b9a4f21ae None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:51.863037 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064ca20-b45a-40ea-bd2c-c1b469edfc04 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:51.864009 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064ca20-b45a-40ea-bd2c-c1b469edfc04 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:51.864714 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064ca20-b45a-40ea-bd2c-c1b469edfc04 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:51.866565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 189/384] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:51 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:35:51.875671 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb51ea-caec-48df-b933-f3f0bd9a8388 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:51.876292 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb51ea-caec-48df-b933-f3f0bd9a8388 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:51.876790 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb51ea-caec-48df-b933-f3f0bd9a8388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:51.910824 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-8bcb51ea-caec-48df-b933-f3f0bd9a8388 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:51.913548 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-8bcb51ea-caec-48df-b933-f3f0bd9a8388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:51.943405 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8572d8b-7ac4-4451-9751-c25b9a4f21ae None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:52.007863 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:52.013622 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c618f4-14e6-415f-88e3-3c6b1dcdbc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:52.014308 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c618f4-14e6-415f-88e3-3c6b1dcdbc80 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:52.014594 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c618f4-14e6-415f-88e3-3c6b1dcdbc80 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:52.014875 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c618f4-14e6-415f-88e3-3c6b1dcdbc80 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:52.015635 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c618f4-14e6-415f-88e3-3c6b1dcdbc80 None admin] RBAC: Adding query filter params (name=member) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:52.015940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c618f4-14e6-415f-88e3-3c6b1dcdbc80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:52.017367 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c618f4-14e6-415f-88e3-3c6b1dcdbc80 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:52.035489 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 196/385] 10.222.0.119 () {56 vars in 1106 bytes} [Thu Jul 14 15:35:51 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:52.043077 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c618f4-14e6-415f-88e3-3c6b1dcdbc80 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:52.056645 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:52.064133 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 190/386] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:35:52.098970 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb51ea-caec-48df-b933-f3f0bd9a8388 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:52.209632 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c618f4-14e6-415f-88e3-3c6b1dcdbc80 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:52.275151 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72f574-dee6-4f6f-901c-2f70b8fe8e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:52.276017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72f574-dee6-4f6f-901c-2f70b8fe8e83 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:52.276332 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72f574-dee6-4f6f-901c-2f70b8fe8e83 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:52.276613 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72f574-dee6-4f6f-901c-2f70b8fe8e83 None admin] PATH_INFO: `/v3/groups/b4fc586369ae470cbdb2f810d6158486` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:52.278802 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72f574-dee6-4f6f-901c-2f70b8fe8e83 None admin] RBAC: Authorizing `identity:get_group(group_id=b4fc586369ae470cbdb2f810d6158486)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:52.280288 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72f574-dee6-4f6f-901c-2f70b8fe8e83 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:52.285499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 197/387] 10.222.0.119 () {56 vars in 1185 bytes} [Thu Jul 14 15:35:52 2022] GET /identity/v3/groups/b4fc586369ae470cbdb2f810d6158486 => generated 227 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:52.288931 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb51ea-caec-48df-b933-f3f0bd9a8388 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:52.291298 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72f574-dee6-4f6f-901c-2f70b8fe8e83 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:52.357246 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83d2d1-8176-47dc-9b9b-af8d0038cf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:52.358438 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83d2d1-8176-47dc-9b9b-af8d0038cf92 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:52.358966 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83d2d1-8176-47dc-9b9b-af8d0038cf92 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:52.359458 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83d2d1-8176-47dc-9b9b-af8d0038cf92 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:52.374315 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83d2d1-8176-47dc-9b9b-af8d0038cf92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:52.384942 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-ae83d2d1-8176-47dc-9b9b-af8d0038cf92 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:35:52.384942 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:52.384942 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:52.384942 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:52.384942 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:52.384942 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:52.384942 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:52.384942 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:52.384942 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:52.384942 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:52.384942 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:52.384942 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:52.384942 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:52.384942 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:52.384942 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:52.384942 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:52.385912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:52.385912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:52.385912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:52.385912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:52.385912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:52.385912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:52.385912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:52.385912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:52.385912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:52.385912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:52.385912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:52.385912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:52.385912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:52.385912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:52.385912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:52.385912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:52.386717 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:52.386717 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:52.386717 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:52.386717 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:52.386717 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:52.386717 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:52.386717 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:52.386717 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:52.386717 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:52.386717 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:52.386717 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:35:52.386717 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:52.390007 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 191/388] 10.222.0.119 () {56 vars in 1119 bytes} [Thu Jul 14 15:35:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:52.397240 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83d2d1-8176-47dc-9b9b-af8d0038cf92 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:52.437852 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:52.490283 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:52.532578 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72f574-dee6-4f6f-901c-2f70b8fe8e83 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:52.584448 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83d2d1-8176-47dc-9b9b-af8d0038cf92 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:52.603674 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a406c-8829-4426-a2aa-eb0d6ac2b5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:52.604589 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a406c-8829-4426-a2aa-eb0d6ac2b5c4 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:52.604883 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a406c-8829-4426-a2aa-eb0d6ac2b5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:52.605168 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a406c-8829-4426-a2aa-eb0d6ac2b5c4 None admin] PATH_INFO: `/v3/projects/327221ec271a4464b199d5dd0216670d` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:52.606481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a406c-8829-4426-a2aa-eb0d6ac2b5c4 None admin] RBAC: Authorizing `identity:get_project(project_id=327221ec271a4464b199d5dd0216670d)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:52.607938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a406c-8829-4426-a2aa-eb0d6ac2b5c4 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:52.610235 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 198/389] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:52 2022] GET /identity/v3/projects/327221ec271a4464b199d5dd0216670d => generated 299 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:52.616214 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a406c-8829-4426-a2aa-eb0d6ac2b5c4 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:52.630180 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ad8e5-1003-4bae-bda4-a265a3cd050c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:52.631861 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ad8e5-1003-4bae-bda4-a265a3cd050c None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:52.632182 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ad8e5-1003-4bae-bda4-a265a3cd050c None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:52.632474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ad8e5-1003-4bae-bda4-a265a3cd050c None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:52.633242 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ad8e5-1003-4bae-bda4-a265a3cd050c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:52.633573 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ad8e5-1003-4bae-bda4-a265a3cd050c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:52.635581 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ad8e5-1003-4bae-bda4-a265a3cd050c None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:52.652931 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 192/390] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:35:52 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:52.659913 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ad8e5-1003-4bae-bda4-a265a3cd050c None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:52.801807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a406c-8829-4426-a2aa-eb0d6ac2b5c4 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:52.833281 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:52.840925 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ad8e5-1003-4bae-bda4-a265a3cd050c None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:52.849484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3c9c8-3907-4640-8065-01960396865e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:52.850647 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3c9c8-3907-4640-8065-01960396865e None admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:52.850939 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3c9c8-3907-4640-8065-01960396865e None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:52.851224 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3c9c8-3907-4640-8065-01960396865e None admin] PATH_INFO: `/v3/projects/327221ec271a4464b199d5dd0216670d/groups/b4fc586369ae470cbdb2f810d6158486/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:52.853465 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3c9c8-3907-4640-8065-01960396865e None admin] RBAC: Authorizing `identity:create_grant(project_id=327221ec271a4464b199d5dd0216670d, group_id=b4fc586369ae470cbdb2f810d6158486, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:52.855188 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3c9c8-3907-4640-8065-01960396865e None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:52.861355 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:52.881162 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25536d01-502e-409a-ac60-7492ebd463c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:52.882051 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25536d01-502e-409a-ac60-7492ebd463c5 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:52.882340 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25536d01-502e-409a-ac60-7492ebd463c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:52.882626 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25536d01-502e-409a-ac60-7492ebd463c5 None admin] PATH_INFO: `/v3/groups/b4fc586369ae470cbdb2f810d6158486` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:52.883825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25536d01-502e-409a-ac60-7492ebd463c5 None admin] RBAC: Authorizing `identity:get_group(group_id=b4fc586369ae470cbdb2f810d6158486)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:52.885363 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25536d01-502e-409a-ac60-7492ebd463c5 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:52.887595 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 193/391] 10.222.0.119 () {56 vars in 1185 bytes} [Thu Jul 14 15:35:52 2022] GET /identity/v3/groups/b4fc586369ae470cbdb2f810d6158486 => generated 227 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:52.892676 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25536d01-502e-409a-ac60-7492ebd463c5 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:52.939241 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 199/392] 10.222.0.119 () {58 vars in 1447 bytes} [Thu Jul 14 15:35:52 2022] PUT /identity/v3/projects/327221ec271a4464b199d5dd0216670d/groups/b4fc586369ae470cbdb2f810d6158486/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:35:53.051429 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25536d01-502e-409a-ac60-7492ebd463c5 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:53.092320 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884e89b-7cb7-4228-860c-dd799ab72674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:53.093275 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884e89b-7cb7-4228-860c-dd799ab72674 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:53.093625 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884e89b-7cb7-4228-860c-dd799ab72674 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:53.093904 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884e89b-7cb7-4228-860c-dd799ab72674 None admin] PATH_INFO: `/v3/projects/327221ec271a4464b199d5dd0216670d` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:53.095116 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884e89b-7cb7-4228-860c-dd799ab72674 None admin] RBAC: Authorizing `identity:get_project(project_id=327221ec271a4464b199d5dd0216670d)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:53.096601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884e89b-7cb7-4228-860c-dd799ab72674 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:53.098629 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 194/393] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:52 2022] GET /identity/v3/projects/327221ec271a4464b199d5dd0216670d => generated 299 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:53.109255 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3c9c8-3907-4640-8065-01960396865e None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:53.242377 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3c9c8-3907-4640-8065-01960396865e None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:53.287411 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff74e9-9624-4195-87ab-fb54162200e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:53.288860 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff74e9-9624-4195-87ab-fb54162200e3 None admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:53.289372 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff74e9-9624-4195-87ab-fb54162200e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:53.289874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff74e9-9624-4195-87ab-fb54162200e3 None admin] PATH_INFO: `/v3/projects/327221ec271a4464b199d5dd0216670d/groups/b4fc586369ae470cbdb2f810d6158486/roles/71b77f014251450eac200e62300144ab` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:53.294775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff74e9-9624-4195-87ab-fb54162200e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=327221ec271a4464b199d5dd0216670d, group_id=b4fc586369ae470cbdb2f810d6158486, role_id=71b77f014251450eac200e62300144ab)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:53.296577 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff74e9-9624-4195-87ab-fb54162200e3 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:53.373023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 200/394] 10.222.0.119 () {58 vars in 1447 bytes} [Thu Jul 14 15:35:53 2022] PUT /identity/v3/projects/327221ec271a4464b199d5dd0216670d/groups/b4fc586369ae470cbdb2f810d6158486/roles/71b77f014251450eac200e62300144ab => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:35:53.531582 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb84359-75e1-49ae-970a-954fef2f65e5 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:53.531913 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb84359-75e1-49ae-970a-954fef2f65e5 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:53.532163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb84359-75e1-49ae-970a-954fef2f65e5 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:53.533834 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 195/395] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:53.539995 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea2fe8-ad95-464e-b412-3b80021cdf5f None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:53.540348 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea2fe8-ad95-464e-b412-3b80021cdf5f None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:53.540609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea2fe8-ad95-464e-b412-3b80021cdf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:53.565893 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-c1ea2fe8-ad95-464e-b412-3b80021cdf5f None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:53.567131 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-c1ea2fe8-ad95-464e-b412-3b80021cdf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:53.633820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319e232-062d-4912-844f-bf1fe019cdf7 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:53.634035 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319e232-062d-4912-844f-bf1fe019cdf7 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:53.634321 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319e232-062d-4912-844f-bf1fe019cdf7 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:53.635855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:53.637326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 196/396] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:35:53.642623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf7511-181b-435d-b320-238f6a48a33a None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:53.642918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf7511-181b-435d-b320-238f6a48a33a None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:53.660853 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf7511-181b-435d-b320-238f6a48a33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:53.661914 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 201/397] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:53.672200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-3fcf7511-181b-435d-b320-238f6a48a33a None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:53.673699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-3fcf7511-181b-435d-b320-238f6a48a33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:53.685368 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea2fe8-ad95-464e-b412-3b80021cdf5f None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:53.744504 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:53.776479 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 197/398] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:53.838434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea2fe8-ad95-464e-b412-3b80021cdf5f None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:53.854918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf7511-181b-435d-b320-238f6a48a33a None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:53.878920 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a096cbd-2789-4a91-a0e6-12e2a3ab9d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:53.880133 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a096cbd-2789-4a91-a0e6-12e2a3ab9d15 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:53.881150 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a096cbd-2789-4a91-a0e6-12e2a3ab9d15 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:53.881626 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a096cbd-2789-4a91-a0e6-12e2a3ab9d15 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:53.906342 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a096cbd-2789-4a91-a0e6-12e2a3ab9d15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:53.920512 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-4a096cbd-2789-4a91-a0e6-12e2a3ab9d15 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:53.920512 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:53.920512 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:53.920512 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:53.920512 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:53.920512 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:53.920512 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:53.920512 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:53.920512 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:53.920512 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:53.920512 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:53.920512 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:53.920512 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:53.920512 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:53.920512 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:53.920512 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:53.921472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:53.921472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:53.921472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:53.921472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:53.921472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:53.921472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:53.921472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:53.921472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:53.921472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:53.921472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:53.921472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:53.921472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:53.921472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:53.921472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:53.921472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:53.921472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:53.922295 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:53.922295 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:53.922295 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:53.922295 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:53.922295 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:53.922295 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:53.922295 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:53.922295 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:53.922295 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:53.922295 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:53.922295 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:53.922295 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:35:53.922295 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 202/399] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:53.927563 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a096cbd-2789-4a91-a0e6-12e2a3ab9d15 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:54.013040 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:54.053883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf7511-181b-435d-b320-238f6a48a33a None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:54.104061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190504ec-181c-470c-bc98-6b16f61f5da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:54.105297 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190504ec-181c-470c-bc98-6b16f61f5da8 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:54.105789 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190504ec-181c-470c-bc98-6b16f61f5da8 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:54.105985 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a096cbd-2789-4a91-a0e6-12e2a3ab9d15 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:54.106464 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190504ec-181c-470c-bc98-6b16f61f5da8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:54.125404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190504ec-181c-470c-bc98-6b16f61f5da8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:54.140565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-190504ec-181c-470c-bc98-6b16f61f5da8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:35:54.140565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:54.140565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:54.140565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:54.140565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:54.140565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:54.140565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:54.140565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:54.140565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:54.140565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:54.140565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:54.140565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:54.140565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:54.140565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:54.140565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:54.140565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:54.141479 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:54.141479 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:54.141479 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:54.141479 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:54.141479 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:54.141479 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:54.141479 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:54.141479 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:54.141479 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:54.141479 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:54.141479 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:54.141479 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:54.141479 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:54.141479 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:54.141479 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:54.141479 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:54.142268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:54.142268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:54.142268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:54.142268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:54.142268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:54.142268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:54.142268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:54.142268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:54.142268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:54.142268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:54.142268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:35:54.142268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:54.142268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 198/400] 10.222.0.119 () {56 vars in 1119 bytes} [Thu Jul 14 15:35:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:54.150823 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a8030-766d-4a2b-992f-796b7539f716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:54.151331 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5f22d-454d-43e7-826b-3daa9dd3003d None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:54.151574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a8030-766d-4a2b-992f-796b7539f716 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:54.151790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a8030-766d-4a2b-992f-796b7539f716 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:54.152152 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a8030-766d-4a2b-992f-796b7539f716 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:54.152500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5f22d-454d-43e7-826b-3daa9dd3003d None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:54.152925 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a8030-766d-4a2b-992f-796b7539f716 None admin] RBAC: Adding query filter params (name=member) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:54.153223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5f22d-454d-43e7-826b-3daa9dd3003d None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:54.153328 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a8030-766d-4a2b-992f-796b7539f716 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:54.154687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a8030-766d-4a2b-992f-796b7539f716 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:54.155337 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 199/401] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:54 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:35:54.159267 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5f22d-454d-43e7-826b-3daa9dd3003d None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:54.166345 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 203/402] 10.222.0.119 () {56 vars in 1106 bytes} [Thu Jul 14 15:35:53 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:54.168070 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6711320-66f9-4152-ad20-9274ec10f6bb None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:54.168627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6711320-66f9-4152-ad20-9274ec10f6bb None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:54.169191 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6711320-66f9-4152-ad20-9274ec10f6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:54.196245 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-d6711320-66f9-4152-ad20-9274ec10f6bb None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:54.197892 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-d6711320-66f9-4152-ad20-9274ec10f6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:54.214291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:54.276964 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5f22d-454d-43e7-826b-3daa9dd3003d None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:54.308400 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 204/403] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:54.308400 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6711320-66f9-4152-ad20-9274ec10f6bb None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:54.337805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e251ffd-4452-41d1-8e16-6ae8be35ade4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:54.338925 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e251ffd-4452-41d1-8e16-6ae8be35ade4 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:54.339425 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e251ffd-4452-41d1-8e16-6ae8be35ade4 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:54.339966 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e251ffd-4452-41d1-8e16-6ae8be35ade4 None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:54.341229 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e251ffd-4452-41d1-8e16-6ae8be35ade4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:54.341800 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e251ffd-4452-41d1-8e16-6ae8be35ade4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:54.343477 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e251ffd-4452-41d1-8e16-6ae8be35ade4 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:54.354970 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 200/404] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:35:54 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:54.356218 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e251ffd-4452-41d1-8e16-6ae8be35ade4 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:54.361280 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:54.459275 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6711320-66f9-4152-ad20-9274ec10f6bb None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:54.473203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e251ffd-4452-41d1-8e16-6ae8be35ade4 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:54.484049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:54.510561 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7f0ee-2cec-4dab-8505-e192c0fceaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:54.510561 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7f0ee-2cec-4dab-8505-e192c0fceaa8 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:54.510561 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7f0ee-2cec-4dab-8505-e192c0fceaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:54.510561 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7f0ee-2cec-4dab-8505-e192c0fceaa8 None admin] PATH_INFO: `/v3/groups/b4fc586369ae470cbdb2f810d6158486` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:54.510978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7f0ee-2cec-4dab-8505-e192c0fceaa8 None admin] RBAC: Authorizing `identity:get_group(group_id=b4fc586369ae470cbdb2f810d6158486)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:54.512291 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7f0ee-2cec-4dab-8505-e192c0fceaa8 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:54.520452 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 205/405] 10.222.0.119 () {56 vars in 1185 bytes} [Thu Jul 14 15:35:54 2022] GET /identity/v3/groups/b4fc586369ae470cbdb2f810d6158486 => generated 227 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:54.522208 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7f0ee-2cec-4dab-8505-e192c0fceaa8 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:54.536471 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27ad43-2bf2-4694-aac2-bf970bb6e70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:54.537989 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27ad43-2bf2-4694-aac2-bf970bb6e70e None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:54.538486 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27ad43-2bf2-4694-aac2-bf970bb6e70e None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:54.538961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27ad43-2bf2-4694-aac2-bf970bb6e70e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:54.553513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27ad43-2bf2-4694-aac2-bf970bb6e70e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:54.564495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-4e27ad43-2bf2-4694-aac2-bf970bb6e70e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:35:54.564495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:54.564495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:54.564495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:54.564495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:54.564495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:54.564495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:54.564495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:54.564495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:54.564495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:54.564495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:54.564495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:54.564495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:54.564495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:54.564495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:54.564495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:54.567304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:54.567304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:54.567304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:54.567304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:54.567304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:54.567304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:54.567304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:54.567304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:54.567304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:54.567304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:54.567304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:54.567304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:54.567304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:54.567304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:54.567304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:54.567304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:54.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:54.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:54.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:54.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:54.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:54.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:54.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:54.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:54.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:54.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:54.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:35:54.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:54.570800 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 201/406] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:35:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:54.572313 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27ad43-2bf2-4694-aac2-bf970bb6e70e None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:54.649627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:54.653512 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7f0ee-2cec-4dab-8505-e192c0fceaa8 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:54.708052 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ea857-d3a8-403a-a5d1-69da5e4757da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:54.709478 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27ad43-2bf2-4694-aac2-bf970bb6e70e None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:54.710572 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ea857-d3a8-403a-a5d1-69da5e4757da None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:54.711084 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ea857-d3a8-403a-a5d1-69da5e4757da None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:54.711708 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ea857-d3a8-403a-a5d1-69da5e4757da None admin] PATH_INFO: `/v3/groups/b4fc586369ae470cbdb2f810d6158486` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:54.713470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ea857-d3a8-403a-a5d1-69da5e4757da None admin] RBAC: Authorizing `identity:get_group(group_id=b4fc586369ae470cbdb2f810d6158486)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:54.715219 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ea857-d3a8-403a-a5d1-69da5e4757da None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:54.717785 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 206/407] 10.222.0.119 () {56 vars in 1185 bytes} [Thu Jul 14 15:35:54 2022] GET /identity/v3/groups/b4fc586369ae470cbdb2f810d6158486 => generated 227 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:54.718771 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ea857-d3a8-403a-a5d1-69da5e4757da None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:54.765265 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377ce12-a2a1-4716-b77e-758708c7306c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:54.766624 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377ce12-a2a1-4716-b77e-758708c7306c None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:54.767218 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377ce12-a2a1-4716-b77e-758708c7306c None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:54.767748 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377ce12-a2a1-4716-b77e-758708c7306c None admin] PATH_INFO: `/v3/projects/af3a7f407f014d858258455b61892383` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:54.769312 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377ce12-a2a1-4716-b77e-758708c7306c None admin] RBAC: Authorizing `identity:get_project(project_id=af3a7f407f014d858258455b61892383)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:54.771067 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377ce12-a2a1-4716-b77e-758708c7306c None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:54.774169 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 202/408] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:54 2022] GET /identity/v3/projects/af3a7f407f014d858258455b61892383 => generated 303 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:54.775215 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377ce12-a2a1-4716-b77e-758708c7306c None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:54.817130 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:54.854695 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ea857-d3a8-403a-a5d1-69da5e4757da None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:54.899378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377ce12-a2a1-4716-b77e-758708c7306c None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:54.903976 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e8ac4-3d91-46ee-8bef-c762822facc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:54.904990 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e8ac4-3d91-46ee-8bef-c762822facc4 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:54.905477 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e8ac4-3d91-46ee-8bef-c762822facc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:54.906012 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e8ac4-3d91-46ee-8bef-c762822facc4 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:54.907040 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e8ac4-3d91-46ee-8bef-c762822facc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:54.907548 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e8ac4-3d91-46ee-8bef-c762822facc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:54.909240 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e8ac4-3d91-46ee-8bef-c762822facc4 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:54.922093 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 207/409] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:54 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:54.928745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e8ac4-3d91-46ee-8bef-c762822facc4 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:54.947198 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e97f24-2489-4651-93b5-99d4f08af426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:54.948454 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e97f24-2489-4651-93b5-99d4f08af426 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:54.948454 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e97f24-2489-4651-93b5-99d4f08af426 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:54.948825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e97f24-2489-4651-93b5-99d4f08af426 None admin] PATH_INFO: `/v3/projects/af3a7f407f014d858258455b61892383` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:54.950449 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e97f24-2489-4651-93b5-99d4f08af426 None admin] RBAC: Authorizing `identity:get_project(project_id=af3a7f407f014d858258455b61892383)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:54.955804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e97f24-2489-4651-93b5-99d4f08af426 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:54.955804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 203/410] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:54 2022] GET /identity/v3/projects/af3a7f407f014d858258455b61892383 => generated 303 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:54.960646 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e97f24-2489-4651-93b5-99d4f08af426 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:54.979416 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:55.069820 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e8ac4-3d91-46ee-8bef-c762822facc4 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:55.089528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e97f24-2489-4651-93b5-99d4f08af426 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:55.092467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:55.116957 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88228102-2209-4dd2-b823-44df51970e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:55.117937 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88228102-2209-4dd2-b823-44df51970e0f None admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:55.118356 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88228102-2209-4dd2-b823-44df51970e0f None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:55.118746 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88228102-2209-4dd2-b823-44df51970e0f None admin] PATH_INFO: `/v3/projects/af3a7f407f014d858258455b61892383/groups/b4fc586369ae470cbdb2f810d6158486/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:55.121081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88228102-2209-4dd2-b823-44df51970e0f None admin] RBAC: Authorizing `identity:create_grant(project_id=af3a7f407f014d858258455b61892383, group_id=b4fc586369ae470cbdb2f810d6158486, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:55.122669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88228102-2209-4dd2-b823-44df51970e0f None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:55.137821 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a53ec1-c18a-49f9-bd64-a067440a5a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:55.145783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a53ec1-c18a-49f9-bd64-a067440a5a60 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:55.145783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a53ec1-c18a-49f9-bd64-a067440a5a60 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:55.145783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a53ec1-c18a-49f9-bd64-a067440a5a60 None admin] PATH_INFO: `/v3/groups/40e773591d5048ec8cbf414185684c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:55.145783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a53ec1-c18a-49f9-bd64-a067440a5a60 None admin] RBAC: Authorizing `identity:get_group(group_id=40e773591d5048ec8cbf414185684c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:55.145783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a53ec1-c18a-49f9-bd64-a067440a5a60 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:55.145783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 204/411] 10.222.0.119 () {56 vars in 1185 bytes} [Thu Jul 14 15:35:54 2022] GET /identity/v3/groups/40e773591d5048ec8cbf414185684c7c => generated 230 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:55.147265 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a53ec1-c18a-49f9-bd64-a067440a5a60 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:55.235328 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 208/412] 10.222.0.119 () {58 vars in 1447 bytes} [Thu Jul 14 15:35:54 2022] PUT /identity/v3/projects/af3a7f407f014d858258455b61892383/groups/b4fc586369ae470cbdb2f810d6158486/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:35:55.236557 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88228102-2209-4dd2-b823-44df51970e0f None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:55.279275 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a53ec1-c18a-49f9-bd64-a067440a5a60 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:55.316157 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd39dc-6315-421d-8a12-84152e96b498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:55.317355 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd39dc-6315-421d-8a12-84152e96b498 None admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:55.317787 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd39dc-6315-421d-8a12-84152e96b498 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:55.318769 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd39dc-6315-421d-8a12-84152e96b498 None admin] PATH_INFO: `/v3/projects/af3a7f407f014d858258455b61892383/groups/b4fc586369ae470cbdb2f810d6158486/roles/71b77f014251450eac200e62300144ab` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:55.321419 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd39dc-6315-421d-8a12-84152e96b498 None admin] RBAC: Authorizing `identity:create_grant(project_id=af3a7f407f014d858258455b61892383, group_id=b4fc586369ae470cbdb2f810d6158486, role_id=71b77f014251450eac200e62300144ab)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:55.323073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd39dc-6315-421d-8a12-84152e96b498 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:55.383349 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:55.395185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88228102-2209-4dd2-b823-44df51970e0f None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:55.423688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 205/413] 10.222.0.119 () {58 vars in 1447 bytes} [Thu Jul 14 15:35:55 2022] PUT /identity/v3/projects/af3a7f407f014d858258455b61892383/groups/b4fc586369ae470cbdb2f810d6158486/roles/71b77f014251450eac200e62300144ab => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:35:55.440151 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4e37c-0a0f-461c-8e94-0c615fbdb303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:55.441105 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4e37c-0a0f-461c-8e94-0c615fbdb303 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:55.441392 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4e37c-0a0f-461c-8e94-0c615fbdb303 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:55.441677 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4e37c-0a0f-461c-8e94-0c615fbdb303 None admin] PATH_INFO: `/v3/projects/a12def5ec62e451d99b7e6dd6faef1ba` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:55.449209 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4e37c-0a0f-461c-8e94-0c615fbdb303 None admin] RBAC: Authorizing `identity:get_project(project_id=a12def5ec62e451d99b7e6dd6faef1ba)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:55.456449 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4e37c-0a0f-461c-8e94-0c615fbdb303 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:55.456449 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 209/414] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:55 2022] GET /identity/v3/projects/a12def5ec62e451d99b7e6dd6faef1ba => generated 345 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:55.459190 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd39dc-6315-421d-8a12-84152e96b498 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:55.540571 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:55.621712 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e04bb-6b2e-41ef-bfb3-3e7abb31e27f None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:55.621994 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e04bb-6b2e-41ef-bfb3-3e7abb31e27f None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:55.622278 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e04bb-6b2e-41ef-bfb3-3e7abb31e27f None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:55.623993 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 210/415] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:55.627422 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd39dc-6315-421d-8a12-84152e96b498 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:55.629524 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f1a6c-7650-41e6-9470-91b80ad43a4c None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:55.631500 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f1a6c-7650-41e6-9470-91b80ad43a4c None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:55.631993 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f1a6c-7650-41e6-9470-91b80ad43a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:55.655886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-c07f1a6c-7650-41e6-9470-91b80ad43a4c None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:55.657879 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-c07f1a6c-7650-41e6-9470-91b80ad43a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:55.666821 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755962f-ca53-4e30-ad0f-b4e3f265b7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:55.667749 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755962f-ca53-4e30-ad0f-b4e3f265b7b9 None admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:55.668037 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755962f-ca53-4e30-ad0f-b4e3f265b7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:55.668357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755962f-ca53-4e30-ad0f-b4e3f265b7b9 None admin] PATH_INFO: `/v3/projects/a12def5ec62e451d99b7e6dd6faef1ba/groups/40e773591d5048ec8cbf414185684c7c/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:55.671448 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755962f-ca53-4e30-ad0f-b4e3f265b7b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a12def5ec62e451d99b7e6dd6faef1ba, group_id=40e773591d5048ec8cbf414185684c7c, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:55.673100 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755962f-ca53-4e30-ad0f-b4e3f265b7b9 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:55.744791 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 211/416] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:55.751386 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 206/417] 10.222.0.119 () {58 vars in 1447 bytes} [Thu Jul 14 15:35:55 2022] PUT /identity/v3/projects/a12def5ec62e451d99b7e6dd6faef1ba/groups/40e773591d5048ec8cbf414185684c7c/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:35:55.793468 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f1a6c-7650-41e6-9470-91b80ad43a4c None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:55.808473 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2ae45-8e14-41f6-8521-f27d3e7fe08f None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:55.809561 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2ae45-8e14-41f6-8521-f27d3e7fe08f None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:55.810053 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2ae45-8e14-41f6-8521-f27d3e7fe08f None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:55.812482 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 207/418] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:55 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:55.818097 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76119f-ad06-495e-888d-4e30d98b471a None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:55.818378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76119f-ad06-495e-888d-4e30d98b471a None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:55.818670 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76119f-ad06-495e-888d-4e30d98b471a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:55.855639 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-7c76119f-ad06-495e-888d-4e30d98b471a None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:55.856881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-7c76119f-ad06-495e-888d-4e30d98b471a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:55.943647 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:55.956829 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f1a6c-7650-41e6-9470-91b80ad43a4c None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:55.974362 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 208/419] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:35:55.998011 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76119f-ad06-495e-888d-4e30d98b471a None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:56.000023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333a050-6984-46b7-937f-d28985c211b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:56.001054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333a050-6984-46b7-937f-d28985c211b7 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:56.001347 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333a050-6984-46b7-937f-d28985c211b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:56.001627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333a050-6984-46b7-937f-d28985c211b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:56.015486 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9333a050-6984-46b7-937f-d28985c211b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:56.023267 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:56.025765 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-9333a050-6984-46b7-937f-d28985c211b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:56.025765 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:56.025765 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:56.025765 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:56.025765 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:56.025765 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:56.025765 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:56.025765 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:56.025765 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:56.025765 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:56.025765 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:56.025765 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:56.025765 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:56.025765 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:56.025765 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:56.025765 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:56.026669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:56.026669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:56.026669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:56.026669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:56.026669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:56.026669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:56.026669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:56.026669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:56.026669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:56.026669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:56.026669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:56.026669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:56.026669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:56.026669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:56.026669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:56.026669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:56.027467 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:56.027467 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:56.027467 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:56.027467 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:56.027467 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:56.027467 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:56.027467 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:56.027467 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:56.027467 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:56.027467 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:56.027467 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:56.027467 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:35:56.030184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 212/420] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:35:56.036929 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333a050-6984-46b7-937f-d28985c211b7 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:56.159090 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76119f-ad06-495e-888d-4e30d98b471a None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:56.216781 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333a050-6984-46b7-937f-d28985c211b7 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:56.231111 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebe4aa-fbe9-4101-bba6-5d6eb94e0fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:56.232285 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebe4aa-fbe9-4101-bba6-5d6eb94e0fc1 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:56.233443 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebe4aa-fbe9-4101-bba6-5d6eb94e0fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:56.234079 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebe4aa-fbe9-4101-bba6-5d6eb94e0fc1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:56.254909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebe4aa-fbe9-4101-bba6-5d6eb94e0fc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:56.264608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-64ebe4aa-fbe9-4101-bba6-5d6eb94e0fc1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:35:56.264608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:56.264608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:56.264608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:56.264608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:56.264608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:56.264608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:56.264608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:56.264608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:56.264608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:56.264608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:56.264608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:56.264608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:56.264608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:56.264608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:56.264608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:56.265507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:56.265507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:56.265507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:56.265507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:56.265507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:56.265507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:56.265507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:56.265507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:56.265507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:56.265507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:56.265507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:56.265507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:56.265507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:56.265507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:56.265507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:56.265507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:56.266284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:56.266284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:56.266284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:56.266284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:56.266284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:56.266284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:56.266284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:56.266284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:56.266284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:56.266284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:56.266284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:35:56.266284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:56.274751 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 209/421] 10.222.0.119 () {56 vars in 1119 bytes} [Thu Jul 14 15:35:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:56.279694 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9411e6-fada-4bac-b306-2a10b9505e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:56.281159 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebe4aa-fbe9-4101-bba6-5d6eb94e0fc1 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:56.282481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9411e6-fada-4bac-b306-2a10b9505e93 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:56.283318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9411e6-fada-4bac-b306-2a10b9505e93 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:56.285153 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9411e6-fada-4bac-b306-2a10b9505e93 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:56.286108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9411e6-fada-4bac-b306-2a10b9505e93 None admin] RBAC: Adding query filter params (name=member) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:56.287652 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9411e6-fada-4bac-b306-2a10b9505e93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:56.289264 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9411e6-fada-4bac-b306-2a10b9505e93 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:56.308406 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 213/422] 10.222.0.119 () {56 vars in 1106 bytes} [Thu Jul 14 15:35:56 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:56.312438 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9411e6-fada-4bac-b306-2a10b9505e93 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:56.332850 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:56.387860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:56.407638 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebe4aa-fbe9-4101-bba6-5d6eb94e0fc1 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:56.454095 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246819e9-201e-4670-9b03-684420d2c28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:56.455090 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246819e9-201e-4670-9b03-684420d2c28a None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:56.455799 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246819e9-201e-4670-9b03-684420d2c28a None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:56.456326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246819e9-201e-4670-9b03-684420d2c28a None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:56.457196 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246819e9-201e-4670-9b03-684420d2c28a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:56.457574 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246819e9-201e-4670-9b03-684420d2c28a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:56.461012 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246819e9-201e-4670-9b03-684420d2c28a None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:56.471465 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 210/423] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:35:56 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:56.478718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246819e9-201e-4670-9b03-684420d2c28a None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:56.554622 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9411e6-fada-4bac-b306-2a10b9505e93 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:56.582761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246819e9-201e-4670-9b03-684420d2c28a None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:56.618544 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5012dfb-736f-496e-99c6-77084ab7fc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:56.619315 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5012dfb-736f-496e-99c6-77084ab7fc0e None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:56.619674 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5012dfb-736f-496e-99c6-77084ab7fc0e None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:56.620022 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5012dfb-736f-496e-99c6-77084ab7fc0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:56.629920 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8f24b-c3ce-44b5-a2e7-9ea11999c0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:56.631059 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8f24b-c3ce-44b5-a2e7-9ea11999c0a1 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:56.631728 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8f24b-c3ce-44b5-a2e7-9ea11999c0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:56.632516 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8f24b-c3ce-44b5-a2e7-9ea11999c0a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:56.636842 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:56.696307 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5012dfb-736f-496e-99c6-77084ab7fc0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:56.698059 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5012dfb-736f-496e-99c6-77084ab7fc0e None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:56.757108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8f24b-c3ce-44b5-a2e7-9ea11999c0a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:56.758510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8f24b-c3ce-44b5-a2e7-9ea11999c0a1 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:56.796576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:56.817276 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 211/424] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:35:56 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:56.818539 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5012dfb-736f-496e-99c6-77084ab7fc0e None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:56.876837 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:56.926751 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5012dfb-736f-496e-99c6-77084ab7fc0e None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:56.961713 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9807d-181b-467f-bb51-5737b0ff21d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:56.962689 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9807d-181b-467f-bb51-5737b0ff21d0 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:56.963050 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9807d-181b-467f-bb51-5737b0ff21d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:56.963402 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9807d-181b-467f-bb51-5737b0ff21d0 None admin] PATH_INFO: `/v3/projects/327221ec271a4464b199d5dd0216670d` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:56.964696 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9807d-181b-467f-bb51-5737b0ff21d0 None admin] RBAC: Authorizing `identity:get_project(project_id=327221ec271a4464b199d5dd0216670d)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:56.966473 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9807d-181b-467f-bb51-5737b0ff21d0 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:56.968669 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 212/425] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:56 2022] GET /identity/v3/projects/327221ec271a4464b199d5dd0216670d => generated 299 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:56.973949 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9807d-181b-467f-bb51-5737b0ff21d0 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:57.027214 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 214/426] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:35:56 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 715 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:57.033058 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8f24b-c3ce-44b5-a2e7-9ea11999c0a1 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:57.075332 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9807d-181b-467f-bb51-5737b0ff21d0 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:57.096644 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:57.117608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a951cc-7bc6-40b4-895a-18a8a67aa646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:57.118586 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a951cc-7bc6-40b4-895a-18a8a67aa646 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:57.118865 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a951cc-7bc6-40b4-895a-18a8a67aa646 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:57.119141 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a951cc-7bc6-40b4-895a-18a8a67aa646 None admin] PATH_INFO: `/v3/groups/b4fc586369ae470cbdb2f810d6158486` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:57.122392 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a951cc-7bc6-40b4-895a-18a8a67aa646 None admin] RBAC: Authorizing `identity:get_group(group_id=b4fc586369ae470cbdb2f810d6158486)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:57.123946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a951cc-7bc6-40b4-895a-18a8a67aa646 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:57.126740 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 213/427] 10.222.0.119 () {56 vars in 1185 bytes} [Thu Jul 14 15:35:56 2022] GET /identity/v3/groups/b4fc586369ae470cbdb2f810d6158486 => generated 227 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:57.137671 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a951cc-7bc6-40b4-895a-18a8a67aa646 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:57.270272 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8f24b-c3ce-44b5-a2e7-9ea11999c0a1 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:57.277922 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a951cc-7bc6-40b4-895a-18a8a67aa646 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:57.292520 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:57.336706 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278ac56-a046-4163-911c-ac116ab33ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:57.337578 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278ac56-a046-4163-911c-ac116ab33ab3 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:57.337865 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278ac56-a046-4163-911c-ac116ab33ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:57.338146 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278ac56-a046-4163-911c-ac116ab33ab3 None admin] PATH_INFO: `/v3/projects/327221ec271a4464b199d5dd0216670d` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:57.339478 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278ac56-a046-4163-911c-ac116ab33ab3 None admin] RBAC: Authorizing `identity:get_project(project_id=327221ec271a4464b199d5dd0216670d)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:57.341233 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278ac56-a046-4163-911c-ac116ab33ab3 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:57.345271 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 215/428] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:57 2022] GET /identity/v3/projects/327221ec271a4464b199d5dd0216670d => generated 299 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:57.349275 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278ac56-a046-4163-911c-ac116ab33ab3 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:57.351500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2815be-cc60-4c02-a1ee-e1f3e755f1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:57.352218 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2815be-cc60-4c02-a1ee-e1f3e755f1fd None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:57.352506 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2815be-cc60-4c02-a1ee-e1f3e755f1fd None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:57.352784 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2815be-cc60-4c02-a1ee-e1f3e755f1fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:57.353627 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2815be-cc60-4c02-a1ee-e1f3e755f1fd None admin] RBAC: Adding query filter params (group.id=b4fc586369ae470cbdb2f810d6158486, role.id=71b77f014251450eac200e62300144ab, scope.project.id=327221ec271a4464b199d5dd0216670d) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:57.353938 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2815be-cc60-4c02-a1ee-e1f3e755f1fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:57.355375 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2815be-cc60-4c02-a1ee-e1f3e755f1fd None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:57.373549 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 214/429] 10.222.0.119 () {56 vars in 1381 bytes} [Thu Jul 14 15:35:57 2022] GET /identity/v3/role_assignments?group.id=b4fc586369ae470cbdb2f810d6158486&scope.project.id=327221ec271a4464b199d5dd0216670d&role.id=71b77f014251450eac200e62300144ab => generated 613 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:57.469112 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278ac56-a046-4163-911c-ac116ab33ab3 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:57.517214 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ffb70-d2cf-48d1-9f57-55235515cf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:57.518126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ffb70-d2cf-48d1-9f57-55235515cf3d None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:57.518411 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ffb70-d2cf-48d1-9f57-55235515cf3d None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:57.518689 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ffb70-d2cf-48d1-9f57-55235515cf3d None admin] PATH_INFO: `/v3/groups/b4fc586369ae470cbdb2f810d6158486` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:57.520048 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ffb70-d2cf-48d1-9f57-55235515cf3d None admin] RBAC: Authorizing `identity:get_group(group_id=b4fc586369ae470cbdb2f810d6158486)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:57.522167 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ffb70-d2cf-48d1-9f57-55235515cf3d None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:57.524376 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 216/430] 10.222.0.119 () {56 vars in 1185 bytes} [Thu Jul 14 15:35:57 2022] GET /identity/v3/groups/b4fc586369ae470cbdb2f810d6158486 => generated 227 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:57.533409 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2815be-cc60-4c02-a1ee-e1f3e755f1fd None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:57.604229 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:57.689514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2815be-cc60-4c02-a1ee-e1f3e755f1fd None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:57.728448 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11135eff-783d-4819-bd46-9f993f80bd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:57.729543 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11135eff-783d-4819-bd46-9f993f80bd37 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:57.730039 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11135eff-783d-4819-bd46-9f993f80bd37 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:57.730561 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11135eff-783d-4819-bd46-9f993f80bd37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:57.731587 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11135eff-783d-4819-bd46-9f993f80bd37 None admin] RBAC: Adding query filter params (group.id=b4fc586369ae470cbdb2f810d6158486, role.id=14c8b3b550ba4f75a147b8851fd17c7c, scope.project.id=327221ec271a4464b199d5dd0216670d) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:57.732125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11135eff-783d-4819-bd46-9f993f80bd37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:57.733741 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11135eff-783d-4819-bd46-9f993f80bd37 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:57.740848 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 215/431] 10.222.0.119 () {56 vars in 1381 bytes} [Thu Jul 14 15:35:57 2022] GET /identity/v3/role_assignments?group.id=b4fc586369ae470cbdb2f810d6158486&scope.project.id=327221ec271a4464b199d5dd0216670d&role.id=14c8b3b550ba4f75a147b8851fd17c7c => generated 613 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:57.778632 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2796f-db0a-4644-afa7-1698c9e2ea96 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:57.778968 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2796f-db0a-4644-afa7-1698c9e2ea96 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:57.779209 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2796f-db0a-4644-afa7-1698c9e2ea96 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:57.782271 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 217/432] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:57 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:57.797119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb4f1f-4212-4b60-a7bb-e853f99100b7 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:57.797119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb4f1f-4212-4b60-a7bb-e853f99100b7 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:57.797119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb4f1f-4212-4b60-a7bb-e853f99100b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:57.813521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-99fb4f1f-4212-4b60-a7bb-e853f99100b7 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:57.815095 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-99fb4f1f-4212-4b60-a7bb-e853f99100b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:57.904387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 216/433] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:57.929465 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2796f-db0a-4644-afa7-1698c9e2ea96 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:57.985142 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:58.041669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2796f-db0a-4644-afa7-1698c9e2ea96 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:58.065350 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe7238-94b6-43d2-a8b7-2d6c4dffe4fa None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:58.065964 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe7238-94b6-43d2-a8b7-2d6c4dffe4fa None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:58.066459 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe7238-94b6-43d2-a8b7-2d6c4dffe4fa None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:58.068407 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 217/434] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:58 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:58.074643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5f6eb-2db4-4f70-89a1-a3a460b45da6 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:58.075174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5f6eb-2db4-4f70-89a1-a3a460b45da6 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:58.075654 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5f6eb-2db4-4f70-89a1-a3a460b45da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:58.083537 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94e925-95f4-4cb9-bdd6-1a2629f0e435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:58.084882 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94e925-95f4-4cb9-bdd6-1a2629f0e435 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:58.085173 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94e925-95f4-4cb9-bdd6-1a2629f0e435 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:58.085448 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94e925-95f4-4cb9-bdd6-1a2629f0e435 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:58.094890 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-77c5f6eb-2db4-4f70-89a1-a3a460b45da6 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:58.096093 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-77c5f6eb-2db4-4f70-89a1-a3a460b45da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:58.103326 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94e925-95f4-4cb9-bdd6-1a2629f0e435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:58.111185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-1b94e925-95f4-4cb9-bdd6-1a2629f0e435 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:58.111185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:58.111185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:58.111185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:58.111185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:58.111185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:58.111185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:58.111185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:58.111185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:58.111185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:58.111185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:58.111185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:58.111185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:58.111185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:58.111185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:58.111185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:58.112093 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:58.112093 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:58.112093 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:58.112093 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:58.112093 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:58.112093 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:58.112093 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:58.112093 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:58.112093 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:58.112093 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:58.112093 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:58.112093 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:58.112093 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:58.112093 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:58.112093 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:58.112093 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:58.112896 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:58.112896 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:58.112896 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:58.112896 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:58.112896 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:58.112896 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:58.112896 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:58.112896 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:58.112896 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:58.112896 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:58.112896 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:35:58.112896 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:35:58.112896 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 218/435] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:58.120956 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94e925-95f4-4cb9-bdd6-1a2629f0e435 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:58.137019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:58.189955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 218/436] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:58.217250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5f6eb-2db4-4f70-89a1-a3a460b45da6 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:58.240504 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94e925-95f4-4cb9-bdd6-1a2629f0e435 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:58.248605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:58.283085 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be9120-e6b3-4a40-9da6-af892ab94602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:58.283770 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be9120-e6b3-4a40-9da6-af892ab94602 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:58.284063 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be9120-e6b3-4a40-9da6-af892ab94602 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:58.284435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be9120-e6b3-4a40-9da6-af892ab94602 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:58.285471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be9120-e6b3-4a40-9da6-af892ab94602 None admin] RBAC: Adding query filter params (name=member) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:58.285471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be9120-e6b3-4a40-9da6-af892ab94602 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:58.287785 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be9120-e6b3-4a40-9da6-af892ab94602 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:58.298429 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 219/437] 10.222.0.119 () {56 vars in 1106 bytes} [Thu Jul 14 15:35:58 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:58.299746 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24b085-5138-497e-a808-c45b941ca240 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:58.300043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24b085-5138-497e-a808-c45b941ca240 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:58.300357 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24b085-5138-497e-a808-c45b941ca240 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:58.301607 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 220/438] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:35:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:35:58.303977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24b085-5138-497e-a808-c45b941ca240 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:58.346638 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5f6eb-2db4-4f70-89a1-a3a460b45da6 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:58.388031 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202a0b3-1472-457f-8626-cbc96ab1d914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:58.389013 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202a0b3-1472-457f-8626-cbc96ab1d914 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:58.389305 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202a0b3-1472-457f-8626-cbc96ab1d914 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:58.389587 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202a0b3-1472-457f-8626-cbc96ab1d914 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:58.402117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202a0b3-1472-457f-8626-cbc96ab1d914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:58.410497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-b202a0b3-1472-457f-8626-cbc96ab1d914 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:35:58.410497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:58.410497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:58.410497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:58.410497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:58.410497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:58.410497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:58.410497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:58.410497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:58.410497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:58.410497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:58.410497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:58.410497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:58.410497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:58.410497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:58.410497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:58.411534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:58.411534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:58.411534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:58.411534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:58.411534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:58.411534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:58.411534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:58.411534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:58.411534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:58.411534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:58.411534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:58.411534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:58.411534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:58.411534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:58.411534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:58.411534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:58.412702 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:58.412702 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:58.412702 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:58.412702 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:58.412702 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:58.412702 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:58.412702 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:58.412702 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:58.412702 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:58.412702 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:58.412702 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:35:58.412702 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:35:58.412702 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 219/439] 10.222.0.119 () {56 vars in 1119 bytes} [Thu Jul 14 15:35:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:58.413387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a0c33-6567-4b5b-bf27-4b3041c53bf7 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:58.413835 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a0c33-6567-4b5b-bf27-4b3041c53bf7 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:58.413941 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a0c33-6567-4b5b-bf27-4b3041c53bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:58.433066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-8b4a0c33-6567-4b5b-bf27-4b3041c53bf7 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:58.434273 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-8b4a0c33-6567-4b5b-bf27-4b3041c53bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:58.435130 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24b085-5138-497e-a808-c45b941ca240 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:58.462590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:58.471559 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa965c-6aea-41d2-b59c-99be2aebe52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:58.478916 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa965c-6aea-41d2-b59c-99be2aebe52a None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:58.478916 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa965c-6aea-41d2-b59c-99be2aebe52a None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:58.478916 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa965c-6aea-41d2-b59c-99be2aebe52a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:58.509007 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 220/440] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:35:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:35:58.509007 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a0c33-6567-4b5b-bf27-4b3041c53bf7 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:58.509781 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:58.549366 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa965c-6aea-41d2-b59c-99be2aebe52a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:58.550846 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa965c-6aea-41d2-b59c-99be2aebe52a None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:58.622565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a0c33-6567-4b5b-bf27-4b3041c53bf7 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:58.655325 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 221/441] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:35:58 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 15:35:58.656195 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa965c-6aea-41d2-b59c-99be2aebe52a None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:58.661500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3c364-0245-4c48-849f-e92a8084528e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:58.662336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3c364-0245-4c48-849f-e92a8084528e None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:58.662665 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3c364-0245-4c48-849f-e92a8084528e None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:58.662951 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3c364-0245-4c48-849f-e92a8084528e None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:58.663712 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3c364-0245-4c48-849f-e92a8084528e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:58.664027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3c364-0245-4c48-849f-e92a8084528e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:58.665424 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3c364-0245-4c48-849f-e92a8084528e None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:58.673661 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 221/442] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:35:58 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:58.674450 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3c364-0245-4c48-849f-e92a8084528e None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:58.696894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:58.728191 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:58.762292 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa965c-6aea-41d2-b59c-99be2aebe52a None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:58.776049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3c364-0245-4c48-849f-e92a8084528e None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:58.797501 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178378a-73b1-477a-9c76-b5794f654094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:58.798222 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178378a-73b1-477a-9c76-b5794f654094 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:58.798510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178378a-73b1-477a-9c76-b5794f654094 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:58.798792 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178378a-73b1-477a-9c76-b5794f654094 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:58.810000 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178378a-73b1-477a-9c76-b5794f654094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:35:58.812961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a9bf0-0414-4c4d-ae89-3c6034324a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:58.813888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a9bf0-0414-4c4d-ae89-3c6034324a6f None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:58.814179 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a9bf0-0414-4c4d-ae89-3c6034324a6f None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:58.814461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a9bf0-0414-4c4d-ae89-3c6034324a6f None admin] PATH_INFO: `/v3/projects/af3a7f407f014d858258455b61892383` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:58.815663 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a9bf0-0414-4c4d-ae89-3c6034324a6f None admin] RBAC: Authorizing `identity:get_project(project_id=af3a7f407f014d858258455b61892383)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:58.817181 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a9bf0-0414-4c4d-ae89-3c6034324a6f None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:58.817855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-d178378a-73b1-477a-9c76-b5794f654094 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:35:58.817855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:35:58.817855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:35:58.817855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:35:58.817855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:35:58.817855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:35:58.817855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:35:58.817855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:35:58.817855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:35:58.817855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:35:58.817855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:35:58.817855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:35:58.817855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:35:58.817855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:35:58.817855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:35:58.817855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:35:58.818716 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:35:58.818716 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:35:58.818716 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:35:58.818716 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:35:58.818716 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:35:58.818716 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:35:58.818716 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:35:58.818716 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:35:58.818716 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:35:58.818716 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:35:58.818716 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:35:58.818716 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:35:58.818716 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:35:58.818716 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:35:58.818716 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:35:58.818716 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:35:58.819593 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:35:58.819593 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:35:58.819593 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:35:58.819593 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:35:58.819593 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:35:58.819593 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:35:58.819593 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:35:58.819593 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:35:58.819593 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:35:58.819593 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:35:58.819593 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:35:58.819593 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:35:58.819593 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 222/443] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:35:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:35:58.820275 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 222/444] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:58 2022] GET /identity/v3/projects/af3a7f407f014d858258455b61892383 => generated 303 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:58.820927 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178378a-73b1-477a-9c76-b5794f654094 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:58.824838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a9bf0-0414-4c4d-ae89-3c6034324a6f None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:58.918151 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:58.931382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a9bf0-0414-4c4d-ae89-3c6034324a6f None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:58.937144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178378a-73b1-477a-9c76-b5794f654094 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:58.963184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:58.965519 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c437ab-34c3-47cd-ae72-d6906c905e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:58.966627 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c437ab-34c3-47cd-ae72-d6906c905e21 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:58.966907 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c437ab-34c3-47cd-ae72-d6906c905e21 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:58.967189 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c437ab-34c3-47cd-ae72-d6906c905e21 None admin] PATH_INFO: `/v3/groups/b4fc586369ae470cbdb2f810d6158486` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:58.968390 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c437ab-34c3-47cd-ae72-d6906c905e21 None admin] RBAC: Authorizing `identity:get_group(group_id=b4fc586369ae470cbdb2f810d6158486)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:58.969829 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c437ab-34c3-47cd-ae72-d6906c905e21 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:58.970856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f86b5c-85c7-459d-bc3c-d9f2b2a92400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:58.971445 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 223/445] 10.222.0.119 () {56 vars in 1185 bytes} [Thu Jul 14 15:35:58 2022] GET /identity/v3/groups/b4fc586369ae470cbdb2f810d6158486 => generated 227 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:58.971562 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f86b5c-85c7-459d-bc3c-d9f2b2a92400 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:58.971775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f86b5c-85c7-459d-bc3c-d9f2b2a92400 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:58.972126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f86b5c-85c7-459d-bc3c-d9f2b2a92400 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:58.972221 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c437ab-34c3-47cd-ae72-d6906c905e21 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:59.041021 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f86b5c-85c7-459d-bc3c-d9f2b2a92400 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:59.042472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f86b5c-85c7-459d-bc3c-d9f2b2a92400 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:59.070525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c437ab-34c3-47cd-ae72-d6906c905e21 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:59.103712 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5f16f-89ef-47b0-a166-d68b512b3db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:59.104399 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5f16f-89ef-47b0-a166-d68b512b3db8 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:59.104684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5f16f-89ef-47b0-a166-d68b512b3db8 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:59.105119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5f16f-89ef-47b0-a166-d68b512b3db8 None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:59.105873 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5f16f-89ef-47b0-a166-d68b512b3db8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:59.106181 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5f16f-89ef-47b0-a166-d68b512b3db8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:59.107532 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5f16f-89ef-47b0-a166-d68b512b3db8 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:59.116320 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 224/446] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:35:58 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:59.117110 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5f16f-89ef-47b0-a166-d68b512b3db8 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:59.136362 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:59.150170 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 223/447] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:35:58 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:59.150170 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f86b5c-85c7-459d-bc3c-d9f2b2a92400 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:59.185053 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:59.218081 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5f16f-89ef-47b0-a166-d68b512b3db8 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:59.251190 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c3708-03f4-47f4-b18b-a002d11e883b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:59.251845 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c3708-03f4-47f4-b18b-a002d11e883b None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:59.252156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c3708-03f4-47f4-b18b-a002d11e883b None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:59.252442 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c3708-03f4-47f4-b18b-a002d11e883b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:59.253282 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c3708-03f4-47f4-b18b-a002d11e883b None admin] RBAC: Adding query filter params (group.id=b4fc586369ae470cbdb2f810d6158486, role.id=14c8b3b550ba4f75a147b8851fd17c7c, scope.project.id=af3a7f407f014d858258455b61892383) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:59.253597 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c3708-03f4-47f4-b18b-a002d11e883b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:59.255018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c3708-03f4-47f4-b18b-a002d11e883b None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:59.255263 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f86b5c-85c7-459d-bc3c-d9f2b2a92400 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:59.261928 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 225/448] 10.222.0.119 () {56 vars in 1381 bytes} [Thu Jul 14 15:35:59 2022] GET /identity/v3/role_assignments?group.id=b4fc586369ae470cbdb2f810d6158486&scope.project.id=af3a7f407f014d858258455b61892383&role.id=14c8b3b550ba4f75a147b8851fd17c7c => generated 613 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:59.262715 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c3708-03f4-47f4-b18b-a002d11e883b None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:59.296652 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb783c-6071-45c0-bc34-026c3ecc06ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:59.297329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb783c-6071-45c0-bc34-026c3ecc06ec None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:59.297621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb783c-6071-45c0-bc34-026c3ecc06ec None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:59.297902 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb783c-6071-45c0-bc34-026c3ecc06ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:59.366084 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:59.379692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb783c-6071-45c0-bc34-026c3ecc06ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:59.381639 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb783c-6071-45c0-bc34-026c3ecc06ec None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:59.387324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c3708-03f4-47f4-b18b-a002d11e883b None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:59.414218 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:59.429952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996e0e0-bcde-4484-a889-14555d2fb2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:59.430823 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996e0e0-bcde-4484-a889-14555d2fb2f5 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:59.431110 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996e0e0-bcde-4484-a889-14555d2fb2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:59.431389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996e0e0-bcde-4484-a889-14555d2fb2f5 None admin] PATH_INFO: `/v3/projects/af3a7f407f014d858258455b61892383` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:59.433118 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996e0e0-bcde-4484-a889-14555d2fb2f5 None admin] RBAC: Authorizing `identity:get_project(project_id=af3a7f407f014d858258455b61892383)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:59.434575 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996e0e0-bcde-4484-a889-14555d2fb2f5 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:59.436367 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 226/449] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:59 2022] GET /identity/v3/projects/af3a7f407f014d858258455b61892383 => generated 303 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:59.445377 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996e0e0-bcde-4484-a889-14555d2fb2f5 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:59.504241 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 224/450] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:35:59 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:59.513662 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb783c-6071-45c0-bc34-026c3ecc06ec None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:59.569300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996e0e0-bcde-4484-a889-14555d2fb2f5 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:59.608737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232e9d1-3593-4776-adfb-53d5772a646c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:59.609601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232e9d1-3593-4776-adfb-53d5772a646c None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:59.609883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232e9d1-3593-4776-adfb-53d5772a646c None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:59.610154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232e9d1-3593-4776-adfb-53d5772a646c None admin] PATH_INFO: `/v3/groups/b4fc586369ae470cbdb2f810d6158486` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:59.611543 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232e9d1-3593-4776-adfb-53d5772a646c None admin] RBAC: Authorizing `identity:get_group(group_id=b4fc586369ae470cbdb2f810d6158486)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:59.613137 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232e9d1-3593-4776-adfb-53d5772a646c None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:59.615447 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 227/451] 10.222.0.119 () {56 vars in 1185 bytes} [Thu Jul 14 15:35:59 2022] GET /identity/v3/groups/b4fc586369ae470cbdb2f810d6158486 => generated 227 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:59.621225 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232e9d1-3593-4776-adfb-53d5772a646c None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:59.641651 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb783c-6071-45c0-bc34-026c3ecc06ec None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:59.643641 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:59.667390 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:59.674822 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb943a71-135c-4156-80cd-b4fddf3183ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:59.675680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb943a71-135c-4156-80cd-b4fddf3183ce None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:59.675961 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb943a71-135c-4156-80cd-b4fddf3183ce None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:59.676279 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb943a71-135c-4156-80cd-b4fddf3183ce None admin] PATH_INFO: `/v3/projects/a12def5ec62e451d99b7e6dd6faef1ba` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:59.677990 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb943a71-135c-4156-80cd-b4fddf3183ce None admin] RBAC: Authorizing `identity:get_project(project_id=a12def5ec62e451d99b7e6dd6faef1ba)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:59.679557 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb943a71-135c-4156-80cd-b4fddf3183ce None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:59.681279 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 225/452] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:35:59 2022] GET /identity/v3/projects/a12def5ec62e451d99b7e6dd6faef1ba => generated 345 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:59.687048 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb943a71-135c-4156-80cd-b4fddf3183ce None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:59.726434 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232e9d1-3593-4776-adfb-53d5772a646c None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:59.761169 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a82324-e6c3-45ea-a3d7-eddb9c9cb1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:59.761832 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a82324-e6c3-45ea-a3d7-eddb9c9cb1c9 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:59.762122 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a82324-e6c3-45ea-a3d7-eddb9c9cb1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:59.762400 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a82324-e6c3-45ea-a3d7-eddb9c9cb1c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:59.763231 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a82324-e6c3-45ea-a3d7-eddb9c9cb1c9 None admin] RBAC: Adding query filter params (group.id=b4fc586369ae470cbdb2f810d6158486, role.id=71b77f014251450eac200e62300144ab, scope.project.id=af3a7f407f014d858258455b61892383) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:59.763545 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a82324-e6c3-45ea-a3d7-eddb9c9cb1c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:59.765149 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a82324-e6c3-45ea-a3d7-eddb9c9cb1c9 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:59.771617 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 228/453] 10.222.0.119 () {56 vars in 1381 bytes} [Thu Jul 14 15:35:59 2022] GET /identity/v3/role_assignments?group.id=b4fc586369ae470cbdb2f810d6158486&scope.project.id=af3a7f407f014d858258455b61892383&role.id=71b77f014251450eac200e62300144ab => generated 613 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:59.793055 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb943a71-135c-4156-80cd-b4fddf3183ce None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:59.830857 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d6b96-914d-43fa-85c9-49ca6dc45a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:59.831733 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d6b96-914d-43fa-85c9-49ca6dc45a4c None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:59.832018 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d6b96-914d-43fa-85c9-49ca6dc45a4c None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:59.832323 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d6b96-914d-43fa-85c9-49ca6dc45a4c None admin] PATH_INFO: `/v3/groups/40e773591d5048ec8cbf414185684c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:59.833538 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d6b96-914d-43fa-85c9-49ca6dc45a4c None admin] RBAC: Authorizing `identity:get_group(group_id=40e773591d5048ec8cbf414185684c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:59.835588 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d6b96-914d-43fa-85c9-49ca6dc45a4c None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:59.837339 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 226/454] 10.222.0.119 () {56 vars in 1185 bytes} [Thu Jul 14 15:35:59 2022] GET /identity/v3/groups/40e773591d5048ec8cbf414185684c7c => generated 230 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:35:59.843603 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a82324-e6c3-45ea-a3d7-eddb9c9cb1c9 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:59.929287 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:59.958363 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a82324-e6c3-45ea-a3d7-eddb9c9cb1c9 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:59.983404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95da5d8-cac1-4dca-ae26-c17cab415332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:59.984072 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95da5d8-cac1-4dca-ae26-c17cab415332 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:59.984476 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95da5d8-cac1-4dca-ae26-c17cab415332 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:59.984760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95da5d8-cac1-4dca-ae26-c17cab415332 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:59.985605 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95da5d8-cac1-4dca-ae26-c17cab415332 None admin] RBAC: Adding query filter params (group.id=40e773591d5048ec8cbf414185684c7c, role.id=07aaf007cde043318319928d151bdc75, scope.project.id=a12def5ec62e451d99b7e6dd6faef1ba) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:35:59.985921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95da5d8-cac1-4dca-ae26-c17cab415332 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:59.987369 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95da5d8-cac1-4dca-ae26-c17cab415332 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:59.994614 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 229/455] 10.222.0.119 () {56 vars in 1381 bytes} [Thu Jul 14 15:35:59 2022] GET /identity/v3/role_assignments?group.id=40e773591d5048ec8cbf414185684c7c&scope.project.id=a12def5ec62e451d99b7e6dd6faef1ba&role.id=07aaf007cde043318319928d151bdc75 => generated 613 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:02.394027 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e3473-378b-4c9f-a53f-49a78e25632b None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:02.394573 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e3473-378b-4c9f-a53f-49a78e25632b None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:02.394573 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e3473-378b-4c9f-a53f-49a78e25632b None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:02.396252 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 227/456] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:02.401845 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d27a2b-4328-48d6-aac8-a5ee638bdb81 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:02.402265 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d27a2b-4328-48d6-aac8-a5ee638bdb81 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:02.402435 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d27a2b-4328-48d6-aac8-a5ee638bdb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:02.429300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-b9d27a2b-4328-48d6-aac8-a5ee638bdb81 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:02.430497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b9d27a2b-4328-48d6-aac8-a5ee638bdb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:02.525413 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 230/457] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:36:02.569743 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e3473-378b-4c9f-a53f-49a78e25632b None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:02.657213 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:02.699129 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230e5d7-c767-42af-9890-583ffa10015c None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:02.699758 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230e5d7-c767-42af-9890-583ffa10015c None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:02.700072 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e3473-378b-4c9f-a53f-49a78e25632b None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:02.700371 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230e5d7-c767-42af-9890-583ffa10015c None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:02.701888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 231/458] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:02.719808 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bb3f8-58b0-4577-a41c-b51a1e12fc58 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:02.720126 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bb3f8-58b0-4577-a41c-b51a1e12fc58 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:02.720413 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bb3f8-58b0-4577-a41c-b51a1e12fc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:02.739477 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301372ca-f6f8-4f87-a467-85e4f0b3e4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:02.740870 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301372ca-f6f8-4f87-a467-85e4f0b3e4a6 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:02.741646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301372ca-f6f8-4f87-a467-85e4f0b3e4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:02.741931 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301372ca-f6f8-4f87-a467-85e4f0b3e4a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:02.752584 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301372ca-f6f8-4f87-a467-85e4f0b3e4a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:02.754264 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301372ca-f6f8-4f87-a467-85e4f0b3e4a6 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:02.761128 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-c66bb3f8-58b0-4577-a41c-b51a1e12fc58 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:02.762450 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-c66bb3f8-58b0-4577-a41c-b51a1e12fc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:02.776839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-301372ca-f6f8-4f87-a467-85e4f0b3e4a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:02.776839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:02.776839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:02.776839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:02.776839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:02.776839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:02.776839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:02.776839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:02.776839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:02.776839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:02.776839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:02.776839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:02.776839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:02.776839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:02.776839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:02.777887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:02.777887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:02.777887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:02.777887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:02.777887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:02.777887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:02.777887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:02.777887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:02.777887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:02.777887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:02.777887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:02.777887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:02.777887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:02.777887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:02.777887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:02.777887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:02.777887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:02.778719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:02.778719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:02.778719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:02.778719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:02.781069 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 228/459] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:02.786862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301372ca-f6f8-4f87-a467-85e4f0b3e4a6 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:02.865235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 232/460] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:36:02.866986 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98bd42-c357-462b-a783-b335de308bec None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:02.867499 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98bd42-c357-462b-a783-b335de308bec None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:02.867956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98bd42-c357-462b-a783-b335de308bec None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:02.869728 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 233/461] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:02.874583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03ed2b-33da-4fa4-8e88-8ab2f4de4a85 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:02.879738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03ed2b-33da-4fa4-8e88-8ab2f4de4a85 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:02.880240 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03ed2b-33da-4fa4-8e88-8ab2f4de4a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:02.895590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:02.906647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-6d03ed2b-33da-4fa4-8e88-8ab2f4de4a85 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:02.908309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-6d03ed2b-33da-4fa4-8e88-8ab2f4de4a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:02.923356 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301372ca-f6f8-4f87-a467-85e4f0b3e4a6 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:02.941531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:02.965703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa774b-603f-4cb4-b1ed-581e2ca617f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:02.966847 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa774b-603f-4cb4-b1ed-581e2ca617f5 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:02.967304 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa774b-603f-4cb4-b1ed-581e2ca617f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:02.967711 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa774b-603f-4cb4-b1ed-581e2ca617f5 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:02.968628 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa774b-603f-4cb4-b1ed-581e2ca617f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:02.969151 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa774b-603f-4cb4-b1ed-581e2ca617f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:02.970756 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa774b-603f-4cb4-b1ed-581e2ca617f5 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:02.988972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 229/462] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:02.990286 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa774b-603f-4cb4-b1ed-581e2ca617f5 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:03.011931 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 234/463] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:36:03.012932 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03ed2b-33da-4fa4-8e88-8ab2f4de4a85 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:03.111174 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa774b-603f-4cb4-b1ed-581e2ca617f5 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:03.144720 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03ed2b-33da-4fa4-8e88-8ab2f4de4a85 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:03.150351 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b340e-807a-4651-af6d-833a541add1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:03.151575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b340e-807a-4651-af6d-833a541add1f None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:03.152126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b340e-807a-4651-af6d-833a541add1f None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:03.152623 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b340e-807a-4651-af6d-833a541add1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:03.165696 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b340e-807a-4651-af6d-833a541add1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:03.166350 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b340e-807a-4651-af6d-833a541add1f None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:03.185783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ef01c-aee1-4a7b-9ae3-a2679390703f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:03.186463 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ef01c-aee1-4a7b-9ae3-a2679390703f None admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:03.186753 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ef01c-aee1-4a7b-9ae3-a2679390703f None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:03.187035 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ef01c-aee1-4a7b-9ae3-a2679390703f None admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:03.187464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-e57b340e-807a-4651-af6d-833a541add1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:03.187464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:03.187464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:03.187464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:03.187464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:03.187464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:03.187464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:03.187464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:03.187464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:03.187464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:03.187464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:03.187464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:03.187464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:03.187464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:03.187464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:03.188333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:03.188333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:03.188333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:03.188333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:03.188333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:03.188333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:03.188333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:03.188333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:03.188333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:03.188333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:03.188333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:03.188333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:03.188333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:03.188333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:03.188333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:03.188333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:03.188333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:03.189182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:03.189182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:03.189182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:03.189182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:03.189395 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ef01c-aee1-4a7b-9ae3-a2679390703f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:03.189395 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ef01c-aee1-4a7b-9ae3-a2679390703f None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:03.191751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 230/464] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:03.192852 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b340e-807a-4651-af6d-833a541add1f None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:03.203000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:03.226611 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:03.299914 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b340e-807a-4651-af6d-833a541add1f None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:03.316804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 235/465] 10.222.0.119 () {60 vars in 1137 bytes} [Thu Jul 14 15:36:03 2022] POST /identity/v3/users => generated 247 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:03.316804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ef01c-aee1-4a7b-9ae3-a2679390703f None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:03.377882 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b512f23-cf93-4e73-b903-44c6bac3fd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:03.378748 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b512f23-cf93-4e73-b903-44c6bac3fd96 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:03.379045 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b512f23-cf93-4e73-b903-44c6bac3fd96 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:03.379331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b512f23-cf93-4e73-b903-44c6bac3fd96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:03.393407 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b512f23-cf93-4e73-b903-44c6bac3fd96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:03.395094 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b512f23-cf93-4e73-b903-44c6bac3fd96 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:03.416609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-9b512f23-cf93-4e73-b903-44c6bac3fd96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:03.416609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:03.416609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:03.416609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:03.416609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:03.416609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:03.416609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:03.416609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:03.416609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:03.416609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:03.416609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:03.416609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:03.416609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:03.416609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:03.416609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:03.417533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:03.417533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:03.417533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:03.417533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:03.417533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:03.417533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:03.417533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:03.417533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:03.417533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:03.417533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:03.417533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:03.417533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:03.417533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:03.417533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:03.417533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:03.417533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:03.417533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:03.418359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:03.418359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:03.418359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:03.418359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:03.418359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 231/466] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:03.419115 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b13610-eb39-4938-8ad6-a72ce5dafec0 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:03.419322 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b13610-eb39-4938-8ad6-a72ce5dafec0 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:03.419603 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b13610-eb39-4938-8ad6-a72ce5dafec0 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:03.421177 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 232/467] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:03.427134 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62062bc3-6415-486e-8d66-fb42c56bdbb3 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:03.427428 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62062bc3-6415-486e-8d66-fb42c56bdbb3 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:03.428476 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62062bc3-6415-486e-8d66-fb42c56bdbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:03.449348 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-62062bc3-6415-486e-8d66-fb42c56bdbb3 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:03.450922 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-62062bc3-6415-486e-8d66-fb42c56bdbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:03.466674 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ef01c-aee1-4a7b-9ae3-a2679390703f None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:03.513963 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abca07-56e9-491e-be21-087af26928d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:03.514782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abca07-56e9-491e-be21-087af26928d2 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:03.515107 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abca07-56e9-491e-be21-087af26928d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:03.516023 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abca07-56e9-491e-be21-087af26928d2 None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:03.516883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abca07-56e9-491e-be21-087af26928d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:03.517652 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abca07-56e9-491e-be21-087af26928d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:03.519456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abca07-56e9-491e-be21-087af26928d2 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:03.534620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 236/468] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:03.539550 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abca07-56e9-491e-be21-087af26928d2 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:03.539679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 233/469] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:36:03.540577 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62062bc3-6415-486e-8d66-fb42c56bdbb3 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:03.554534 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:03.628414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:03.657667 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62062bc3-6415-486e-8d66-fb42c56bdbb3 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:03.697266 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c289fe-80e8-45ef-932f-95d276f4d9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:03.697887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c289fe-80e8-45ef-932f-95d276f4d9a2 None admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:03.698155 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c289fe-80e8-45ef-932f-95d276f4d9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:03.698438 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c289fe-80e8-45ef-932f-95d276f4d9a2 None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:03.698995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abca07-56e9-491e-be21-087af26928d2 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:03.699169 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c289fe-80e8-45ef-932f-95d276f4d9a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:03.700685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c289fe-80e8-45ef-932f-95d276f4d9a2 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:03.738901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be9c9f-e668-46bb-8080-eb30eabaf8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:03.739990 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be9c9f-e668-46bb-8080-eb30eabaf8ee None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:03.740528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be9c9f-e668-46bb-8080-eb30eabaf8ee None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:03.741000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be9c9f-e668-46bb-8080-eb30eabaf8ee None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:03.742083 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be9c9f-e668-46bb-8080-eb30eabaf8ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:03.742604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be9c9f-e668-46bb-8080-eb30eabaf8ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:03.744239 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be9c9f-e668-46bb-8080-eb30eabaf8ee None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:03.756959 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 237/470] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:03.758168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be9c9f-e668-46bb-8080-eb30eabaf8ee None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:03.776940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 234/471] 10.222.0.119 () {60 vars in 1137 bytes} [Thu Jul 14 15:36:03 2022] POST /identity/v3/users => generated 249 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:36:03.778135 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c289fe-80e8-45ef-932f-95d276f4d9a2 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:03.874046 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:03.923708 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c289fe-80e8-45ef-932f-95d276f4d9a2 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:03.953990 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be9c9f-e668-46bb-8080-eb30eabaf8ee None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:03.972422 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54699e-4cd7-466e-ab15-f72ed806ab0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:03.972422 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54699e-4cd7-466e-ab15-f72ed806ab0b None admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:03.972678 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54699e-4cd7-466e-ab15-f72ed806ab0b None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:03.972925 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54699e-4cd7-466e-ab15-f72ed806ab0b None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:03.973498 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54699e-4cd7-466e-ab15-f72ed806ab0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:03.975256 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54699e-4cd7-466e-ab15-f72ed806ab0b None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:03.976526 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:04.007012 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57a1ae-7ad9-4947-8a4b-0fe8e6c293b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:04.008268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57a1ae-7ad9-4947-8a4b-0fe8e6c293b3 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:04.008812 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57a1ae-7ad9-4947-8a4b-0fe8e6c293b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:04.009288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57a1ae-7ad9-4947-8a4b-0fe8e6c293b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:04.021880 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57a1ae-7ad9-4947-8a4b-0fe8e6c293b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:04.023798 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57a1ae-7ad9-4947-8a4b-0fe8e6c293b3 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:04.043285 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-7c57a1ae-7ad9-4947-8a4b-0fe8e6c293b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:04.043285 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:04.043285 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:04.043285 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:04.043285 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:04.043285 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:04.043285 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:04.043285 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:04.043285 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:04.043285 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:04.043285 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:04.043285 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:04.043285 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:04.043285 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:04.043285 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:04.044301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:04.044301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:04.044301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:04.044301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:04.044301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:04.044301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:04.044301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:04.044301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:04.044301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:04.044301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:04.044301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:04.044301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:04.044301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:04.044301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:04.044301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:04.044301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:04.044301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:04.045137 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:04.045137 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:04.045137 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:04.045137 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:04.047196 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 238/472] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:04.054843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57a1ae-7ad9-4947-8a4b-0fe8e6c293b3 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:04.097823 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 235/473] 10.222.0.119 () {60 vars in 1137 bytes} [Thu Jul 14 15:36:03 2022] POST /identity/v3/users => generated 249 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:04.184418 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57a1ae-7ad9-4947-8a4b-0fe8e6c293b3 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:04.189621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c1bed-7fdd-4b8e-91fe-2b8f1e3f8e4f None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:04.190267 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c1bed-7fdd-4b8e-91fe-2b8f1e3f8e4f None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:04.190745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c1bed-7fdd-4b8e-91fe-2b8f1e3f8e4f None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:04.192638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 236/474] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:04 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:36:04.206132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd8420-eda3-49dd-93eb-6f17615191d5 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:04.206977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd8420-eda3-49dd-93eb-6f17615191d5 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:04.207998 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd8420-eda3-49dd-93eb-6f17615191d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:04.249529 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-d9bd8420-eda3-49dd-93eb-6f17615191d5 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:04.252162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-d9bd8420-eda3-49dd-93eb-6f17615191d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:04.264021 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d323a2-c146-419a-81ed-7900cb50a9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:04.273476 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d323a2-c146-419a-81ed-7900cb50a9e9 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:04.273790 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d323a2-c146-419a-81ed-7900cb50a9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:04.274061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d323a2-c146-419a-81ed-7900cb50a9e9 None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:04.275097 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d323a2-c146-419a-81ed-7900cb50a9e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:04.275223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d323a2-c146-419a-81ed-7900cb50a9e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:04.276655 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d323a2-c146-419a-81ed-7900cb50a9e9 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:04.294712 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 239/475] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:04.300351 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d323a2-c146-419a-81ed-7900cb50a9e9 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:04.333027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:04.361449 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 237/476] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:04 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:36:04.386994 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd8420-eda3-49dd-93eb-6f17615191d5 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:04.465459 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d323a2-c146-419a-81ed-7900cb50a9e9 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:04.468369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:04.503806 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92bf45-d9fc-4fa9-a4e7-06d17fb9554d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:04.504609 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92bf45-d9fc-4fa9-a4e7-06d17fb9554d None admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:04.504875 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92bf45-d9fc-4fa9-a4e7-06d17fb9554d None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:04.505159 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92bf45-d9fc-4fa9-a4e7-06d17fb9554d None admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:04.506451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92bf45-d9fc-4fa9-a4e7-06d17fb9554d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:04.510923 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92bf45-d9fc-4fa9-a4e7-06d17fb9554d None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:04.523836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd8420-eda3-49dd-93eb-6f17615191d5 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:04.561157 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188bb09-e925-4eea-9c58-4410014265f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:04.562211 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188bb09-e925-4eea-9c58-4410014265f6 None admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:04.562715 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188bb09-e925-4eea-9c58-4410014265f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:04.563193 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188bb09-e925-4eea-9c58-4410014265f6 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:04.564318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188bb09-e925-4eea-9c58-4410014265f6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:04.566019 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188bb09-e925-4eea-9c58-4410014265f6 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:04.590012 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 240/477] 10.222.0.119 () {60 vars in 1137 bytes} [Thu Jul 14 15:36:04 2022] POST /identity/v3/users => generated 250 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:04.611574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.sql.core [None req-0188bb09-e925-4eea-9c58-4410014265f6 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 15:36:04.611574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 14 15:36:04.611574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [parameters: {'id': 'abbccebe140d4c35abb4a9cf36c71bbc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 14 15:36:04.611574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86978) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 15:36:04.638340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-0188bb09-e925-4eea-9c58-4410014265f6 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 14 15:36:04.638340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:04.638340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 15:36:04.638340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 15:36:04.638340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 15:36:04.638340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 15:36:04.638340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 15:36:04.638340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 15:36:04.638340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 15:36:04.638340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application conn.query(q) Jul 14 15:36:04.638340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 15:36:04.638340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 15:36:04.638340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 15:36:04.638340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application result.read() Jul 14 15:36:04.638340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 15:36:04.639296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 15:36:04.639296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 15:36:04.639296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 15:36:04.639296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 15:36:04.639296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 15:36:04.639296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 15:36:04.639296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 15:36:04.639296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 15:36:04.639296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:04.639296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 15:36:04.639296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:04.639296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:04.639296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 15:36:04.639296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 15:36:04.639296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 14 15:36:04.639296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return ref.to_dict() Jul 14 15:36:04.639296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 15:36:04.639296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application next(self.gen) Jul 14 15:36:04.640229 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 15:36:04.640229 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application yield resource Jul 14 15:36:04.640229 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 15:36:04.640229 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application next(self.gen) Jul 14 15:36:04.640229 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 15:36:04.640229 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 15:36:04.640229 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 15:36:04.640229 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 15:36:04.640229 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 15:36:04.640229 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise self.value Jul 14 15:36:04.640229 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 15:36:04.640229 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 15:36:04.640229 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 15:36:04.640229 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application session.commit() Jul 14 15:36:04.640229 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 15:36:04.640229 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 15:36:04.640229 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 15:36:04.641123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 15:36:04.641123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 15:36:04.641123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self.session.flush() Jul 14 15:36:04.641123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 15:36:04.641123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 15:36:04.641123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 15:36:04.641123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 15:36:04.641123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 15:36:04.641123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application compat.raise_( Jul 14 15:36:04.641123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 15:36:04.641123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception Jul 14 15:36:04.641123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 15:36:04.641123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 15:36:04.641123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 15:36:04.641123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 15:36:04.641123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 15:36:04.641123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 15:36:04.641978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 15:36:04.641978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 15:36:04.641978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 15:36:04.641978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 15:36:04.641978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 15:36:04.641978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 15:36:04.641978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 15:36:04.641978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 15:36:04.641978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 15:36:04.641978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 15:36:04.641978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 15:36:04.641978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 15:36:04.641978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 15:36:04.641978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 15:36:04.641978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 15:36:04.641978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception Jul 14 15:36:04.642810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 15:36:04.642810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 15:36:04.642810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 15:36:04.642810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 15:36:04.642810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 15:36:04.642810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 15:36:04.642810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 15:36:04.642810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application conn.query(q) Jul 14 15:36:04.642810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 15:36:04.642810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 15:36:04.642810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 15:36:04.642810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application result.read() Jul 14 15:36:04.642810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 15:36:04.642810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 15:36:04.642810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 15:36:04.642810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 15:36:04.645466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 15:36:04.645466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 15:36:04.645466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 15:36:04.645466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 15:36:04.645466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 15:36:04.645466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 14 15:36:04.645466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [parameters: {'id': 'abbccebe140d4c35abb4a9cf36c71bbc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 14 15:36:04.645466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 15:36:04.645466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:04.645466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:36:04.645466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:04.645466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:04.645466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:04.645466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:04.645466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:04.645466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:04.647683 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:04.647683 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:04.647683 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:04.647683 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:04.647683 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:04.647683 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:04.647683 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 14 15:36:04.647683 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 14 15:36:04.647683 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:04.647683 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:04.647683 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 14 15:36:04.647683 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 14 15:36:04.647683 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 15:36:04.647683 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 15:36:04.647683 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 14 15:36:04.647683 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:04.651301 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 238/478] 10.222.0.119 () {60 vars in 1136 bytes} [Thu Jul 14 15:36:04 2022] POST /identity/v3/roles => generated 144 bytes in 265 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:36:04.658552 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92bf45-d9fc-4fa9-a4e7-06d17fb9554d None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:04.766373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:04.788291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92bf45-d9fc-4fa9-a4e7-06d17fb9554d None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:04.834609 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d47db-820c-4777-9965-163e41aeea8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:04.835935 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d47db-820c-4777-9965-163e41aeea8e None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:04.836455 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d47db-820c-4777-9965-163e41aeea8e None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:04.836958 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d47db-820c-4777-9965-163e41aeea8e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:04.853864 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d47db-820c-4777-9965-163e41aeea8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:36:04.862601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-c37d47db-820c-4777-9965-163e41aeea8e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:36:04.862601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:04.862601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:04.862601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:04.862601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:04.862601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:04.862601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:04.862601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:04.862601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:04.862601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:04.862601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:04.862601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:04.862601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:36:04.862601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:36:04.862601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:36:04.862601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:36:04.863578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:36:04.863578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:36:04.863578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:36:04.863578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:36:04.863578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:04.863578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:04.863578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:04.863578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:04.863578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:04.863578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:04.863578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:04.863578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:04.863578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:04.863578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:04.863578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:04.863578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:04.864415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:04.864415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:04.864415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:04.864415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:04.864415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:36:04.864415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:36:04.864415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:36:04.864415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:36:04.864415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:36:04.864415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:36:04.864415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:36:04.864415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:04.867404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 241/479] 10.222.0.119 () {56 vars in 1119 bytes} [Thu Jul 14 15:36:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:04.873465 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188bb09-e925-4eea-9c58-4410014265f6 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:04.985649 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188bb09-e925-4eea-9c58-4410014265f6 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:05.004517 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:05.028447 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb492e0-2516-465e-8b1c-cca75fedbc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:05.028447 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb492e0-2516-465e-8b1c-cca75fedbc08 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:05.028447 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb492e0-2516-465e-8b1c-cca75fedbc08 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:05.028447 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb492e0-2516-465e-8b1c-cca75fedbc08 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:05.028827 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb492e0-2516-465e-8b1c-cca75fedbc08 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:05.028827 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb492e0-2516-465e-8b1c-cca75fedbc08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:05.029133 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb492e0-2516-465e-8b1c-cca75fedbc08 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:05.039154 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 239/480] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:04 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:05.683337 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6954f-bec2-4575-a503-2298a23dfd1f None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:05.683855 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6954f-bec2-4575-a503-2298a23dfd1f None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:05.683931 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6954f-bec2-4575-a503-2298a23dfd1f None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:05.685849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 242/481] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:05.691916 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa413f0-4afc-470e-a9c0-135a9cfb596d None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:05.692460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa413f0-4afc-470e-a9c0-135a9cfb596d None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:05.692533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa413f0-4afc-470e-a9c0-135a9cfb596d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:05.713095 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-caa413f0-4afc-470e-a9c0-135a9cfb596d None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:05.714299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-caa413f0-4afc-470e-a9c0-135a9cfb596d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:05.790193 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 240/482] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:36:05.826261 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6954f-bec2-4575-a503-2298a23dfd1f None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:05.960510 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6954f-bec2-4575-a503-2298a23dfd1f None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:06.009704 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4e4b6-ca65-43d4-bd7c-e6142041dd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:06.010880 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4e4b6-ca65-43d4-bd7c-e6142041dd27 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:06.011402 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4e4b6-ca65-43d4-bd7c-e6142041dd27 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:06.011882 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4e4b6-ca65-43d4-bd7c-e6142041dd27 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:06.020370 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:06.028408 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4e4b6-ca65-43d4-bd7c-e6142041dd27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:36:06.036376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-d4d4e4b6-ca65-43d4-bd7c-e6142041dd27 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:06.036376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:06.036376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:06.036376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:06.036376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:06.036376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:06.036376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:06.036376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:06.036376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:06.036376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:06.036376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:06.036376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:06.036376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:36:06.036376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:36:06.036376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:36:06.036376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:36:06.037859 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:36:06.037859 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:36:06.037859 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:36:06.037859 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:36:06.037859 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:06.037859 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:06.037859 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:06.037859 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:06.037859 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:06.037859 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:06.037859 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:06.037859 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:06.037859 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:06.037859 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:06.037859 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:06.037859 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:06.038629 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:06.038629 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:06.038629 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:06.038629 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:06.038629 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:36:06.038629 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:36:06.038629 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:36:06.038629 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:36:06.038629 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:36:06.038629 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:36:06.038629 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:06.038629 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:06.038629 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 243/483] 10.222.0.119 () {56 vars in 1107 bytes} [Thu Jul 14 15:36:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:36:06.045350 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa413f0-4afc-470e-a9c0-135a9cfb596d None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:06.182667 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa413f0-4afc-470e-a9c0-135a9cfb596d None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:06.196451 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:06.230759 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b5103-7f7c-474d-b735-01faaf0fd2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:06.231633 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b5103-7f7c-474d-b735-01faaf0fd2fc None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:06.231980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b5103-7f7c-474d-b735-01faaf0fd2fc None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:06.236457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b5103-7f7c-474d-b735-01faaf0fd2fc None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:06.237227 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b5103-7f7c-474d-b735-01faaf0fd2fc None admin] RBAC: Adding query filter params (name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:06.237545 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b5103-7f7c-474d-b735-01faaf0fd2fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:06.238934 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b5103-7f7c-474d-b735-01faaf0fd2fc None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:06.248273 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 241/484] 10.222.0.119 () {56 vars in 1108 bytes} [Thu Jul 14 15:36:06 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:06.254418 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4e4b6-ca65-43d4-bd7c-e6142041dd27 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:06.374939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4e4b6-ca65-43d4-bd7c-e6142041dd27 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:06.415259 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d27d5-1c43-4b37-bef6-967e4f96664a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:06.416074 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d27d5-1c43-4b37-bef6-967e4f96664a None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:06.416389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d27d5-1c43-4b37-bef6-967e4f96664a None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:06.416674 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d27d5-1c43-4b37-bef6-967e4f96664a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:06.432636 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d27d5-1c43-4b37-bef6-967e4f96664a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:06.434133 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d27d5-1c43-4b37-bef6-967e4f96664a None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:06.452338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-d51d27d5-1c43-4b37-bef6-967e4f96664a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:06.452338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:06.452338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:06.452338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:06.452338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:06.452338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:06.452338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:06.452338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:06.452338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:06.452338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:06.452338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:06.452338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:06.452338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:06.452338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:06.452338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:06.453200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:06.453200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:06.453200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:06.453200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:06.453200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:06.453200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:06.453200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:06.453200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:06.453200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:06.453200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:06.453200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:06.453200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:06.453200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:06.453200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:06.453200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:06.453200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:06.453200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:06.454024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:06.454024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:06.454024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:06.454024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:06.454024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 244/485] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:06.460033 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b5103-7f7c-474d-b735-01faaf0fd2fc None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:06.510880 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ae9f5-a915-4f2c-82fc-eb2fbe8dcaff None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:06.511287 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ae9f5-a915-4f2c-82fc-eb2fbe8dcaff None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:06.511483 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ae9f5-a915-4f2c-82fc-eb2fbe8dcaff None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:06.512906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 245/486] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:06.523761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5be74-6db8-4b39-ab0c-d24c99ea9e19 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:06.524042 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5be74-6db8-4b39-ab0c-d24c99ea9e19 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:06.524358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5be74-6db8-4b39-ab0c-d24c99ea9e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:06.546401 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-9cd5be74-6db8-4b39-ab0c-d24c99ea9e19 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:06.547619 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-9cd5be74-6db8-4b39-ab0c-d24c99ea9e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:06.627778 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:06.651506 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 246/487] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:36:06.657270 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b5103-7f7c-474d-b735-01faaf0fd2fc None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:06.678577 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5be74-6db8-4b39-ab0c-d24c99ea9e19 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:06.722836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006cee1-9283-4988-aa0f-a49fde1d959c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:06.723501 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006cee1-9283-4988-aa0f-a49fde1d959c None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:06.723788 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006cee1-9283-4988-aa0f-a49fde1d959c None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:06.724066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006cee1-9283-4988-aa0f-a49fde1d959c None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:06.726425 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006cee1-9283-4988-aa0f-a49fde1d959c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:06.726739 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006cee1-9283-4988-aa0f-a49fde1d959c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:06.728190 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006cee1-9283-4988-aa0f-a49fde1d959c None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:06.763795 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 242/488] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:06.781818 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006cee1-9283-4988-aa0f-a49fde1d959c None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:06.847361 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:06.851569 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5be74-6db8-4b39-ab0c-d24c99ea9e19 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:06.897873 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa7b5c-f3a9-41e3-baf3-bdac244d6b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:06.899219 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa7b5c-f3a9-41e3-baf3-bdac244d6b1d None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:06.900477 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa7b5c-f3a9-41e3-baf3-bdac244d6b1d None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:06.900948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa7b5c-f3a9-41e3-baf3-bdac244d6b1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:06.916467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa7b5c-f3a9-41e3-baf3-bdac244d6b1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:36:06.927708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-25fa7b5c-f3a9-41e3-baf3-bdac244d6b1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:06.927708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:06.927708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:06.927708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:06.927708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:06.927708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:06.927708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:06.927708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:06.927708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:06.927708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:06.927708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:06.927708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:06.927708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:36:06.927708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:36:06.927708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:36:06.927708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:36:06.928628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:36:06.928628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:36:06.928628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:36:06.928628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:36:06.928628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:06.928628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:06.928628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:06.928628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:06.928628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:06.928628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:06.928628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:06.928628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:06.928628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:06.928628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:06.928628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:06.928628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:06.929429 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:06.929429 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:06.929429 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:06.929429 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:06.929429 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:36:06.929429 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:36:06.929429 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:36:06.929429 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:36:06.929429 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:36:06.929429 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:36:06.929429 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:06.929429 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:06.932169 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 247/489] 10.222.0.119 () {56 vars in 1107 bytes} [Thu Jul 14 15:36:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:36:06.937745 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd3b52-d550-441f-b0fd-a9f827483ea3 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:06.938041 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd3b52-d550-441f-b0fd-a9f827483ea3 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:06.938325 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd3b52-d550-441f-b0fd-a9f827483ea3 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:06.939779 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 248/490] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:06.941087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd3b52-d550-441f-b0fd-a9f827483ea3 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:06.942687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006cee1-9283-4988-aa0f-a49fde1d959c None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:06.982054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c574be2-c037-42a5-a110-ac188864ad67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:06.982957 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c574be2-c037-42a5-a110-ac188864ad67 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:06.983258 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c574be2-c037-42a5-a110-ac188864ad67 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:06.983540 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c574be2-c037-42a5-a110-ac188864ad67 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:06.991972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c574be2-c037-42a5-a110-ac188864ad67 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:06.993494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c574be2-c037-42a5-a110-ac188864ad67 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:06.996120 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:07.010458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-5c574be2-c037-42a5-a110-ac188864ad67 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:36:07.010458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:07.010458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:07.010458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:07.010458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:07.010458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:07.010458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:07.010458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:07.010458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:07.010458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:07.010458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:07.010458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:07.010458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:36:07.010458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:36:07.010458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:36:07.010458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:36:07.011434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:07.011434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:07.011434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:07.011434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:07.011434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:07.011434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:07.011434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:07.011434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:07.011434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:07.011434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:07.011434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:07.011434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:07.011434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:07.011434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:07.011434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:07.011434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:07.011434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:07.011434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:07.012827 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:07.012827 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:07.012827 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:36:07.012827 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:36:07.012827 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:36:07.012827 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:36:07.012827 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:36:07.012827 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:36:07.012827 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:36:07.012827 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:07.012827 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 243/491] 10.222.0.119 () {56 vars in 1098 bytes} [Thu Jul 14 15:36:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:36:07.013495 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3b8aa-5e9d-4dda-a6ed-8b6167dfba85 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:07.013791 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3b8aa-5e9d-4dda-a6ed-8b6167dfba85 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:07.014078 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3b8aa-5e9d-4dda-a6ed-8b6167dfba85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:07.031863 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-eda3b8aa-5e9d-4dda-a6ed-8b6167dfba85 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:07.033203 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-eda3b8aa-5e9d-4dda-a6ed-8b6167dfba85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:07.063029 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd3b52-d550-441f-b0fd-a9f827483ea3 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:07.099977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b8992-0fb8-4937-8f5a-ead9d5682b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:07.100980 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b8992-0fb8-4937-8f5a-ead9d5682b8a None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:07.101413 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b8992-0fb8-4937-8f5a-ead9d5682b8a None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:07.101860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b8992-0fb8-4937-8f5a-ead9d5682b8a None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:07.102755 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b8992-0fb8-4937-8f5a-ead9d5682b8a None admin] RBAC: Adding query filter params (name=service) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:07.103208 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b8992-0fb8-4937-8f5a-ead9d5682b8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:07.104754 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b8992-0fb8-4937-8f5a-ead9d5682b8a None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:07.112190 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 244/492] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:36:07.112190 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3b8aa-5e9d-4dda-a6ed-8b6167dfba85 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:07.119153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 249/493] 10.222.0.119 () {56 vars in 1108 bytes} [Thu Jul 14 15:36:06 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:07.129243 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b8992-0fb8-4937-8f5a-ead9d5682b8a None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:07.132924 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:07.217874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3b8aa-5e9d-4dda-a6ed-8b6167dfba85 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:07.251717 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b8992-0fb8-4937-8f5a-ead9d5682b8a None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:07.253206 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463665ce-2667-4f59-a334-a48783f5507b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:07.253890 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463665ce-2667-4f59-a334-a48783f5507b None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:07.254180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463665ce-2667-4f59-a334-a48783f5507b None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:07.254461 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463665ce-2667-4f59-a334-a48783f5507b None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:07.255199 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:07.255327 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463665ce-2667-4f59-a334-a48783f5507b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:07.255620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463665ce-2667-4f59-a334-a48783f5507b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:07.257384 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463665ce-2667-4f59-a334-a48783f5507b None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:07.293565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eabf64-4532-4e5c-b734-3d721ebd5741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:07.294431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eabf64-4532-4e5c-b734-3d721ebd5741 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:07.294727 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eabf64-4532-4e5c-b734-3d721ebd5741 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:07.295007 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eabf64-4532-4e5c-b734-3d721ebd5741 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:07.305134 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 245/494] 10.222.0.119 () {56 vars in 1138 bytes} [Thu Jul 14 15:36:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:07.306248 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463665ce-2667-4f59-a334-a48783f5507b None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:07.309260 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eabf64-4532-4e5c-b734-3d721ebd5741 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:07.311960 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eabf64-4532-4e5c-b734-3d721ebd5741 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:07.338002 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-e2eabf64-4532-4e5c-b734-3d721ebd5741 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:07.338002 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:07.338002 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:07.338002 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:07.338002 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:07.338002 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:07.338002 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:07.338002 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:07.338002 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:07.338002 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:07.338002 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:07.338002 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:07.338002 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:07.338002 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:07.338002 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:07.339117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:07.339117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:07.339117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:07.339117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:07.339117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:07.339117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:07.339117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:07.339117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:07.339117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:07.339117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:07.339117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:07.339117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:07.339117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:07.339117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:07.339117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:07.339117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:07.339117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:07.340286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:07.340286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:07.340286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:07.340286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:07.344027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 250/495] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:07.346161 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eabf64-4532-4e5c-b734-3d721ebd5741 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:07.406016 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:07.431669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463665ce-2667-4f59-a334-a48783f5507b None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:07.453966 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eabf64-4532-4e5c-b734-3d721ebd5741 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:07.471163 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebe84e-087c-440d-aed7-9197eea56fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:07.472371 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebe84e-087c-440d-aed7-9197eea56fad None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:07.472910 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebe84e-087c-440d-aed7-9197eea56fad None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:07.473389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebe84e-087c-440d-aed7-9197eea56fad None admin] PATH_INFO: `/v3/roles/service` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:07.485310 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebe84e-087c-440d-aed7-9197eea56fad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:36:07.489915 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27bf4ae-3f31-467c-9a05-df02c189b7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:07.491434 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bf4ae-3f31-467c-9a05-df02c189b7fe None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:07.491727 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bf4ae-3f31-467c-9a05-df02c189b7fe None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:07.492009 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bf4ae-3f31-467c-9a05-df02c189b7fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:07.496773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-3eebe84e-087c-440d-aed7-9197eea56fad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:07.496773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:07.496773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:07.496773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:07.496773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:07.496773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:07.496773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:07.496773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:07.496773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:07.496773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:07.496773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:07.496773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:07.496773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:36:07.496773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:36:07.496773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:36:07.496773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:36:07.497687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:36:07.497687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:36:07.497687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:36:07.497687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:36:07.497687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:07.497687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:07.497687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:07.497687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:07.497687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:07.497687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:07.497687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:07.497687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:07.497687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:07.497687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:07.497687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:07.497687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:07.498494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:07.498494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:07.498494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:07.498494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:07.498494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:36:07.498494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:36:07.498494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:36:07.498494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:36:07.498494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:36:07.498494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:36:07.498494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:07.498494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:07.501318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 246/496] 10.222.0.119 () {56 vars in 1107 bytes} [Thu Jul 14 15:36:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:07.502346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebe84e-087c-440d-aed7-9197eea56fad None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:07.524485 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:07.569900 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27bf4ae-3f31-467c-9a05-df02c189b7fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:07.571406 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27bf4ae-3f31-467c-9a05-df02c189b7fe None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:07.613293 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebe84e-087c-440d-aed7-9197eea56fad None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:07.650986 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb04d6-bd2f-4793-bfd6-e07b6c2833c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:07.651662 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb04d6-bd2f-4793-bfd6-e07b6c2833c4 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:07.651955 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb04d6-bd2f-4793-bfd6-e07b6c2833c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:07.652295 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb04d6-bd2f-4793-bfd6-e07b6c2833c4 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:07.653039 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb04d6-bd2f-4793-bfd6-e07b6c2833c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:07.653356 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb04d6-bd2f-4793-bfd6-e07b6c2833c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:07.654761 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb04d6-bd2f-4793-bfd6-e07b6c2833c4 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:07.661861 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:07.668018 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 247/497] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:07.669342 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea1b33-f5c7-4493-a2a6-07bdbc9128bf None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:07.679630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea1b33-f5c7-4493-a2a6-07bdbc9128bf None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:07.679630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea1b33-f5c7-4493-a2a6-07bdbc9128bf None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:07.679630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 248/498] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:07.679630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea1b33-f5c7-4493-a2a6-07bdbc9128bf None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:07.694451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 251/499] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:36:07 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:07.695289 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27bf4ae-3f31-467c-9a05-df02c189b7fe None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:07.755328 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:07.776378 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea1b33-f5c7-4493-a2a6-07bdbc9128bf None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:07.794205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27bf4ae-3f31-467c-9a05-df02c189b7fe None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:07.811078 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc52cd2-45dd-4321-b823-c53006c1977e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:07.811742 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc52cd2-45dd-4321-b823-c53006c1977e None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:07.812025 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc52cd2-45dd-4321-b823-c53006c1977e None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:07.812330 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc52cd2-45dd-4321-b823-c53006c1977e None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:07.813144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc52cd2-45dd-4321-b823-c53006c1977e None admin] RBAC: Adding query filter params (name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:07.813450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc52cd2-45dd-4321-b823-c53006c1977e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:07.814817 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc52cd2-45dd-4321-b823-c53006c1977e None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:07.823219 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 249/500] 10.222.0.119 () {56 vars in 1108 bytes} [Thu Jul 14 15:36:07 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:07.824458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187193c8-9fdd-48fa-9775-fd5ed7e2c0de None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:07.824749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187193c8-9fdd-48fa-9775-fd5ed7e2c0de None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:07.825031 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187193c8-9fdd-48fa-9775-fd5ed7e2c0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:07.830860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625ad95-2928-410b-b6c9-053017bf98fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:07.831807 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625ad95-2928-410b-b6c9-053017bf98fa None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:07.832113 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625ad95-2928-410b-b6c9-053017bf98fa None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:07.832457 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625ad95-2928-410b-b6c9-053017bf98fa None admin] PATH_INFO: `/v3/users/glance` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:07.839728 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625ad95-2928-410b-b6c9-053017bf98fa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:07.841170 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-187193c8-9fdd-48fa-9775-fd5ed7e2c0de None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:07.841480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625ad95-2928-410b-b6c9-053017bf98fa None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:07.842364 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-187193c8-9fdd-48fa-9775-fd5ed7e2c0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:07.857266 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-b625ad95-2928-410b-b6c9-053017bf98fa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 15:36:07.857266 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:07.857266 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:07.857266 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:07.857266 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:07.857266 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:07.857266 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:07.857266 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:07.857266 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:07.857266 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:07.857266 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:07.857266 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:07.857266 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:36:07.857266 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:36:07.857266 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:36:07.857266 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:36:07.858679 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:07.858679 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:07.858679 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:07.858679 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:07.858679 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:07.858679 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:07.858679 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:07.858679 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:07.858679 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:07.858679 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:07.858679 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:07.858679 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:07.858679 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:07.858679 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:07.858679 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:07.858679 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:07.858679 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:07.858679 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:07.859590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:07.859590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:07.859590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:36:07.859590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:36:07.859590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:36:07.859590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:36:07.859590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:36:07.859590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:36:07.859590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 15:36:07.859590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:07.859590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 252/501] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:36:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:07.860175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b958f-4a20-4892-ad5d-c7110d2f4050 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:07.860175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b958f-4a20-4892-ad5d-c7110d2f4050 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:07.860293 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b958f-4a20-4892-ad5d-c7110d2f4050 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:07.861560 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 253/502] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:07 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:07.862104 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b958f-4a20-4892-ad5d-c7110d2f4050 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:07.905122 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:07.915938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 250/503] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:36:07.916794 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187193c8-9fdd-48fa-9775-fd5ed7e2c0de None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:07.979335 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b958f-4a20-4892-ad5d-c7110d2f4050 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:07.996268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:08.014975 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f2bac-4e96-4cb9-a9b7-30156bb04011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:08.015695 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f2bac-4e96-4cb9-a9b7-30156bb04011 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:08.015980 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f2bac-4e96-4cb9-a9b7-30156bb04011 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:08.016291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f2bac-4e96-4cb9-a9b7-30156bb04011 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:08.016690 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187193c8-9fdd-48fa-9775-fd5ed7e2c0de None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:08.026573 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f2bac-4e96-4cb9-a9b7-30156bb04011 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:08.028055 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f2bac-4e96-4cb9-a9b7-30156bb04011 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:08.046446 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-146f2bac-4e96-4cb9-a9b7-30156bb04011 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:08.046446 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:08.046446 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:08.046446 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:08.046446 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:08.046446 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:08.046446 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:08.046446 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:08.046446 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:08.046446 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:08.046446 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:08.046446 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:08.046446 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:08.046446 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:08.046446 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:08.047462 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:08.047462 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:08.047462 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:08.047462 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:08.047462 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:08.047462 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:08.047462 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:08.047462 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:08.047462 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:08.047462 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:08.047462 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:08.047462 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:08.047462 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:08.047462 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:08.047462 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:08.047462 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:08.047462 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:08.048357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:08.048357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:08.048357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:08.048357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:08.048357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 254/504] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:08.048643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f2bac-4e96-4cb9-a9b7-30156bb04011 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:08.056398 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60122a-de70-4566-b4bc-27d07382a600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:08.057207 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60122a-de70-4566-b4bc-27d07382a600 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:08.057496 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60122a-de70-4566-b4bc-27d07382a600 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:08.057775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60122a-de70-4566-b4bc-27d07382a600 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:08.068846 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60122a-de70-4566-b4bc-27d07382a600 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:08.070500 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60122a-de70-4566-b4bc-27d07382a600 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:08.088012 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-2f60122a-de70-4566-b4bc-27d07382a600 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:08.088012 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:08.088012 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:08.088012 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:08.088012 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:08.088012 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:08.088012 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:08.088012 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:08.088012 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:08.088012 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:08.088012 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:08.088012 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:08.088012 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:08.088012 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:08.088012 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:08.089051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:08.089051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:08.089051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:08.089051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:08.089051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:08.089051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:08.089051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:08.089051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:08.089051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:08.089051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:08.089051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:08.089051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:08.089051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:08.089051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:08.089051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:08.089051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:08.089051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:08.089900 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:08.089900 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:08.089900 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:08.089900 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:08.089900 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 251/505] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:08.090428 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5fded-d386-43e1-a765-fa00beb0ad38 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:08.090699 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5fded-d386-43e1-a765-fa00beb0ad38 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:08.091238 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5fded-d386-43e1-a765-fa00beb0ad38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:08.109319 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-27d5fded-d386-43e1-a765-fa00beb0ad38 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:08.110509 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-27d5fded-d386-43e1-a765-fa00beb0ad38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:08.146067 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:08.154122 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f2bac-4e96-4cb9-a9b7-30156bb04011 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:08.176535 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 252/506] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:08 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:36:08.177362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5fded-d386-43e1-a765-fa00beb0ad38 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:08.193689 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e0812-5816-4493-a444-d282a095dd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:08.194386 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e0812-5816-4493-a444-d282a095dd3f None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:08.194857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e0812-5816-4493-a444-d282a095dd3f None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:08.194962 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e0812-5816-4493-a444-d282a095dd3f None admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:08.195779 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e0812-5816-4493-a444-d282a095dd3f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:08.196116 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e0812-5816-4493-a444-d282a095dd3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:08.197546 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e0812-5816-4493-a444-d282a095dd3f None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:08.235786 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 255/507] 10.222.0.119 () {56 vars in 1142 bytes} [Thu Jul 14 15:36:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:08.236664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e0812-5816-4493-a444-d282a095dd3f None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:08.263413 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:08.280602 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5fded-d386-43e1-a765-fa00beb0ad38 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:08.316324 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fb34c-2f77-4594-9fa2-bce86e096973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:08.317121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fb34c-2f77-4594-9fa2-bce86e096973 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:08.317402 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fb34c-2f77-4594-9fa2-bce86e096973 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:08.317674 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fb34c-2f77-4594-9fa2-bce86e096973 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:08.327732 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7fb34c-2f77-4594-9fa2-bce86e096973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:36:08.335621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-7f7fb34c-2f77-4594-9fa2-bce86e096973 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:08.335621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:08.335621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:08.335621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:08.335621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:08.335621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:08.335621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:08.335621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:08.335621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:08.335621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:08.335621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:08.335621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:08.335621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:36:08.335621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:36:08.335621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:36:08.335621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:36:08.336710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:36:08.336710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:36:08.336710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:36:08.336710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:36:08.336710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:08.336710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:08.336710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:08.336710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:08.336710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:08.336710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:08.336710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:08.336710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:08.336710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:08.336710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:08.336710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:08.336710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:08.337638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:08.337638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:08.337638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:08.337638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:08.337638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:36:08.337638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:36:08.337638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:36:08.337638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:36:08.337638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:36:08.337638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:36:08.337638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:08.337638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:08.338363 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e0812-5816-4493-a444-d282a095dd3f None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:08.338445 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 253/508] 10.222.0.119 () {56 vars in 1107 bytes} [Thu Jul 14 15:36:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:08.338445 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fb34c-2f77-4594-9fa2-bce86e096973 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:08.368685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:08.373142 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681d8da-8f9f-4816-ae20-0f5d4621c0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:08.373885 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681d8da-8f9f-4816-ae20-0f5d4621c0fa None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:08.374167 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681d8da-8f9f-4816-ae20-0f5d4621c0fa None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:08.374442 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681d8da-8f9f-4816-ae20-0f5d4621c0fa None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:08.375241 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681d8da-8f9f-4816-ae20-0f5d4621c0fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:08.375546 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681d8da-8f9f-4816-ae20-0f5d4621c0fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:08.376964 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681d8da-8f9f-4816-ae20-0f5d4621c0fa None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:08.388922 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 256/509] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:08.389734 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681d8da-8f9f-4816-ae20-0f5d4621c0fa None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:08.438335 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fb34c-2f77-4594-9fa2-bce86e096973 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:08.472154 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55197693-6efa-4405-be90-edb484d6f5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:08.472824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55197693-6efa-4405-be90-edb484d6f5e4 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:08.473114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55197693-6efa-4405-be90-edb484d6f5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:08.473405 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55197693-6efa-4405-be90-edb484d6f5e4 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:08.474132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55197693-6efa-4405-be90-edb484d6f5e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:08.474485 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55197693-6efa-4405-be90-edb484d6f5e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:08.474635 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:08.475977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55197693-6efa-4405-be90-edb484d6f5e4 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:08.487522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 254/510] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:08.492635 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55197693-6efa-4405-be90-edb484d6f5e4 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:08.492751 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681d8da-8f9f-4816-ae20-0f5d4621c0fa None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:08.525922 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e817d-ee12-41a3-8941-33af25ee7f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:08.526729 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e817d-ee12-41a3-8941-33af25ee7f52 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:08.527020 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e817d-ee12-41a3-8941-33af25ee7f52 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:08.527303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e817d-ee12-41a3-8941-33af25ee7f52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:08.537958 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e817d-ee12-41a3-8941-33af25ee7f52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:08.539352 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e817d-ee12-41a3-8941-33af25ee7f52 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:08.556678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-fa6e817d-ee12-41a3-8941-33af25ee7f52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:08.556678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:08.556678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:08.556678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:08.556678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:08.556678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:08.556678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:08.556678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:08.556678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:08.556678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:08.556678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:08.556678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:08.556678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:08.556678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:08.556678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:08.557500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:08.557500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:08.557500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:08.557500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:08.557500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:08.557500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:08.557500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:08.557500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:08.557500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:08.557500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:08.557500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:08.557500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:08.557500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:08.557500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:08.557500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:08.557500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:08.557500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:08.558361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:08.558361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:08.558361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:08.558361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:08.558907 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 257/511] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:08.559830 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e817d-ee12-41a3-8941-33af25ee7f52 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:08.581303 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:08.591502 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55197693-6efa-4405-be90-edb484d6f5e4 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:08.626808 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dca865-09b0-4397-a540-dfec55d9d3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:08.627567 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dca865-09b0-4397-a540-dfec55d9d3dd None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:08.628048 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dca865-09b0-4397-a540-dfec55d9d3dd None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:08.628620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dca865-09b0-4397-a540-dfec55d9d3dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:08.667858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e817d-ee12-41a3-8941-33af25ee7f52 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:08.698048 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dca865-09b0-4397-a540-dfec55d9d3dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:08.699531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dca865-09b0-4397-a540-dfec55d9d3dd None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:08.701706 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b44b38-3287-412e-88d1-6aeea26e0d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:08.702437 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b44b38-3287-412e-88d1-6aeea26e0d95 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:08.702750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b44b38-3287-412e-88d1-6aeea26e0d95 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:08.703006 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b44b38-3287-412e-88d1-6aeea26e0d95 None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:08.703750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b44b38-3287-412e-88d1-6aeea26e0d95 None admin] RBAC: Adding query filter params (name=service) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:08.704057 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b44b38-3287-412e-88d1-6aeea26e0d95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:08.705431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b44b38-3287-412e-88d1-6aeea26e0d95 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:08.710412 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:08.714154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 258/512] 10.222.0.119 () {56 vars in 1108 bytes} [Thu Jul 14 15:36:08 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:08.714767 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b44b38-3287-412e-88d1-6aeea26e0d95 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:08.790624 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:08.800400 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 255/513] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:36:08 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:08.801231 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dca865-09b0-4397-a540-dfec55d9d3dd None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:08.817916 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b44b38-3287-412e-88d1-6aeea26e0d95 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:08.854208 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667169d-e1b8-44cc-9372-85ca219401da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:08.855006 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667169d-e1b8-44cc-9372-85ca219401da None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:08.855293 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667169d-e1b8-44cc-9372-85ca219401da None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:08.855574 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667169d-e1b8-44cc-9372-85ca219401da None admin] PATH_INFO: `/v3/projects/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:08.862203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667169d-e1b8-44cc-9372-85ca219401da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:08.863661 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667169d-e1b8-44cc-9372-85ca219401da None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:08.878627 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-9667169d-e1b8-44cc-9372-85ca219401da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:08.878627 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:08.878627 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:08.878627 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:08.878627 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:08.878627 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:08.878627 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:08.878627 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:08.878627 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:08.878627 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:08.878627 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:08.878627 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:08.878627 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:36:08.878627 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:36:08.878627 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:36:08.879514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:36:08.879514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:08.879514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:08.879514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:08.879514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:08.879514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:08.879514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:08.879514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:08.879514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:08.879514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:08.879514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:08.879514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:08.879514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:08.879514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:08.879514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:08.879514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:08.879514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:08.880720 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:36:08.880720 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:36:08.880720 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:36:08.880720 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:36:08.880720 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:36:08.880720 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:36:08.880720 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:08.880720 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:08.880720 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 259/514] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:08.880720 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667169d-e1b8-44cc-9372-85ca219401da None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:08.908899 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dca865-09b0-4397-a540-dfec55d9d3dd None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:08.944469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eade24-71f5-4f57-bf61-64c67c4b3d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:08.945282 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eade24-71f5-4f57-bf61-64c67c4b3d71 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:08.945575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eade24-71f5-4f57-bf61-64c67c4b3d71 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:08.945869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eade24-71f5-4f57-bf61-64c67c4b3d71 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:08.951941 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:08.954032 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eade24-71f5-4f57-bf61-64c67c4b3d71 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:08.955532 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eade24-71f5-4f57-bf61-64c67c4b3d71 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:08.970701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-60eade24-71f5-4f57-bf61-64c67c4b3d71 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 15:36:08.970701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:08.970701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:08.970701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:08.970701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:08.970701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:08.970701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:08.970701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:08.970701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:08.970701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:08.970701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:08.970701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:08.970701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:36:08.970701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:36:08.970701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:36:08.970701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:36:08.971701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:08.971701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:08.971701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:08.971701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:08.971701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:08.971701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:08.971701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:08.971701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:08.971701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:08.971701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:08.971701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:08.971701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:08.971701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:08.971701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:08.971701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:08.971701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:08.971701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:08.971701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:08.978620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:08.978620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:08.978620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:36:08.978620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:36:08.978620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:36:08.978620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:36:08.978620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:36:08.978620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:36:08.978620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 15:36:08.978620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:08.978620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 256/515] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:36:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:08.978620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eade24-71f5-4f57-bf61-64c67c4b3d71 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:09.006901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667169d-e1b8-44cc-9372-85ca219401da None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:09.032184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:09.041203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0e864-2ef8-43b0-9a5f-927e86c3c69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:09.041814 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0e864-2ef8-43b0-9a5f-927e86c3c69d None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:09.042104 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0e864-2ef8-43b0-9a5f-927e86c3c69d None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:09.042386 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0e864-2ef8-43b0-9a5f-927e86c3c69d None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:09.043112 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0e864-2ef8-43b0-9a5f-927e86c3c69d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:09.043460 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0e864-2ef8-43b0-9a5f-927e86c3c69d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:09.044890 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0e864-2ef8-43b0-9a5f-927e86c3c69d None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:09.057987 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 260/516] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:09.058789 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0e864-2ef8-43b0-9a5f-927e86c3c69d None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:09.079575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eade24-71f5-4f57-bf61-64c67c4b3d71 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:09.113591 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3475b-5e1e-40a4-8739-c80e6bfb0343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:09.114382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3475b-5e1e-40a4-8739-c80e6bfb0343 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:09.114664 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3475b-5e1e-40a4-8739-c80e6bfb0343 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:09.114942 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3475b-5e1e-40a4-8739-c80e6bfb0343 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:09.126036 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3475b-5e1e-40a4-8739-c80e6bfb0343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:09.127493 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3475b-5e1e-40a4-8739-c80e6bfb0343 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:09.144614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-00a3475b-5e1e-40a4-8739-c80e6bfb0343 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:09.144614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:09.144614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:09.144614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:09.144614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:09.144614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:09.144614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:09.144614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:09.144614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:09.144614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:09.144614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:09.144614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:09.144614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:09.144614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:09.144614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:09.145541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:09.145541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:09.145541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:09.145541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:09.145541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:09.145541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:09.145541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:09.145541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:09.145541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:09.145541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:09.145541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:09.145541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:09.145541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:09.145541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:09.145541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:09.145541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:09.145541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:09.151141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:09.151141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:09.151141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:09.151141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:09.151141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 257/517] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:09.151141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3475b-5e1e-40a4-8739-c80e6bfb0343 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:09.160896 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0e864-2ef8-43b0-9a5f-927e86c3c69d None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:09.181862 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:09.195713 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4198c32-044d-46c8-8781-a21fb5045287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:09.196534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4198c32-044d-46c8-8781-a21fb5045287 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:09.196826 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4198c32-044d-46c8-8781-a21fb5045287 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:09.197101 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4198c32-044d-46c8-8781-a21fb5045287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:09.206963 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4198c32-044d-46c8-8781-a21fb5045287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:09.208433 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4198c32-044d-46c8-8781-a21fb5045287 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:09.227306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-b4198c32-044d-46c8-8781-a21fb5045287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:09.227306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:09.227306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:09.227306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:09.227306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:09.227306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:09.227306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:09.227306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:09.227306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:09.227306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:09.227306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:09.227306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:09.227306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:09.227306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:09.227306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:09.228234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:09.228234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:09.228234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:09.228234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:09.228234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:09.228234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:09.228234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:09.228234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:09.228234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:09.228234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:09.228234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:09.228234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:09.228234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:09.228234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:09.228234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:09.228234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:09.228234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:09.229077 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:09.229077 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:09.229077 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:09.229077 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:09.229077 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 261/518] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:09.229338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4198c32-044d-46c8-8781-a21fb5045287 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:09.248504 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3475b-5e1e-40a4-8739-c80e6bfb0343 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:09.250762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:09.288399 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65bd61-b391-4377-83e7-329d021792a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:09.289078 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65bd61-b391-4377-83e7-329d021792a9 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:09.289362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65bd61-b391-4377-83e7-329d021792a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:09.289643 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65bd61-b391-4377-83e7-329d021792a9 None admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:09.290449 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65bd61-b391-4377-83e7-329d021792a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:09.290768 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65bd61-b391-4377-83e7-329d021792a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:09.292892 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65bd61-b391-4377-83e7-329d021792a9 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:09.311814 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 258/519] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:36:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:09.312686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65bd61-b391-4377-83e7-329d021792a9 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:09.339759 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4198c32-044d-46c8-8781-a21fb5045287 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:09.373185 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11305b-3a6e-4634-b376-1d1287a5c04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:09.373767 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11305b-3a6e-4634-b376-1d1287a5c04f None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:09.374050 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11305b-3a6e-4634-b376-1d1287a5c04f None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:09.374323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11305b-3a6e-4634-b376-1d1287a5c04f None admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:09.375152 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11305b-3a6e-4634-b376-1d1287a5c04f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:09.375468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11305b-3a6e-4634-b376-1d1287a5c04f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:09.376910 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11305b-3a6e-4634-b376-1d1287a5c04f None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:09.398641 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 262/520] 10.222.0.119 () {56 vars in 1142 bytes} [Thu Jul 14 15:36:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:09.399455 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11305b-3a6e-4634-b376-1d1287a5c04f None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:09.422021 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65bd61-b391-4377-83e7-329d021792a9 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:09.429783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:09.458604 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee64a0-5ca5-42e4-9817-7403c77b3bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:09.459305 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee64a0-5ca5-42e4-9817-7403c77b3bad None admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:09.459581 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee64a0-5ca5-42e4-9817-7403c77b3bad None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:09.459862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee64a0-5ca5-42e4-9817-7403c77b3bad None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:09.460603 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee64a0-5ca5-42e4-9817-7403c77b3bad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:09.462091 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee64a0-5ca5-42e4-9817-7403c77b3bad None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:09.502948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11305b-3a6e-4634-b376-1d1287a5c04f None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:09.537027 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 259/521] 10.222.0.119 () {60 vars in 1137 bytes} [Thu Jul 14 15:36:09 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:09.537952 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee64a0-5ca5-42e4-9817-7403c77b3bad None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:09.538060 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c7bbe-c5e7-4f96-92c8-cc7f1ca96a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:09.538753 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c7bbe-c5e7-4f96-92c8-cc7f1ca96a0d None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:09.539040 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c7bbe-c5e7-4f96-92c8-cc7f1ca96a0d None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:09.539320 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c7bbe-c5e7-4f96-92c8-cc7f1ca96a0d None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:09.540131 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c7bbe-c5e7-4f96-92c8-cc7f1ca96a0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:09.540452 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c7bbe-c5e7-4f96-92c8-cc7f1ca96a0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:09.541911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c7bbe-c5e7-4f96-92c8-cc7f1ca96a0d None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:09.570185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:09.570366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 263/522] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:09.570366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c7bbe-c5e7-4f96-92c8-cc7f1ca96a0d None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:09.665152 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee64a0-5ca5-42e4-9817-7403c77b3bad None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:09.675413 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:09.686151 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c7bbe-c5e7-4f96-92c8-cc7f1ca96a0d None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:09.706319 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01845e-63dd-474f-b40e-876ffc948290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:09.706730 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01845e-63dd-474f-b40e-876ffc948290 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:09.707627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01845e-63dd-474f-b40e-876ffc948290 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:09.707627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01845e-63dd-474f-b40e-876ffc948290 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:09.708081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01845e-63dd-474f-b40e-876ffc948290 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:09.708428 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01845e-63dd-474f-b40e-876ffc948290 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:09.709960 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01845e-63dd-474f-b40e-876ffc948290 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:09.724009 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 260/523] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:09.725218 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01845e-63dd-474f-b40e-876ffc948290 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:09.729719 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f5cbd-a295-4c17-90ed-489ff3c310dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:09.730656 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f5cbd-a295-4c17-90ed-489ff3c310dc None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:09.730761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f5cbd-a295-4c17-90ed-489ff3c310dc None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:09.730971 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f5cbd-a295-4c17-90ed-489ff3c310dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:09.731813 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f5cbd-a295-4c17-90ed-489ff3c310dc None admin] RBAC: Adding query filter params (role.id=92c47f3813b04366b3019ba2a56337eb, scope.project.id=07652ced88cf4f069d1765176be5130b, user.id=a1e4c833a4684561ab52eda5734a7766) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:09.732189 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f5cbd-a295-4c17-90ed-489ff3c310dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:09.733643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f5cbd-a295-4c17-90ed-489ff3c310dc None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:09.740608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 264/524] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:36:09 2022] GET /identity/v3/role_assignments?user.id=a1e4c833a4684561ab52eda5734a7766&scope.project.id=07652ced88cf4f069d1765176be5130b&role.id=92c47f3813b04366b3019ba2a56337eb => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:09.741544 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f5cbd-a295-4c17-90ed-489ff3c310dc None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:09.840857 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:09.864153 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01845e-63dd-474f-b40e-876ffc948290 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:09.886151 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f5cbd-a295-4c17-90ed-489ff3c310dc None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:09.907664 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37763bcc-302c-46a1-8e0d-e94f1e4345d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:09.908781 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37763bcc-302c-46a1-8e0d-e94f1e4345d7 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:09.910000 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37763bcc-302c-46a1-8e0d-e94f1e4345d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:09.910000 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37763bcc-302c-46a1-8e0d-e94f1e4345d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:09.934228 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d3458-e21c-4f43-92f6-d06bdd58a4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:09.935048 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d3458-e21c-4f43-92f6-d06bdd58a4b6 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:09.935420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d3458-e21c-4f43-92f6-d06bdd58a4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:09.935717 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d3458-e21c-4f43-92f6-d06bdd58a4b6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:09.943975 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d3458-e21c-4f43-92f6-d06bdd58a4b6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:09.945462 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d3458-e21c-4f43-92f6-d06bdd58a4b6 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:09.964616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-498d3458-e21c-4f43-92f6-d06bdd58a4b6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 15:36:09.964616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:09.964616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:09.964616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:09.964616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:09.964616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:09.964616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:09.964616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:09.964616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:09.964616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:09.964616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:09.964616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:09.964616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:36:09.964616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:36:09.964616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:36:09.964616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:36:09.965578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:09.965578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:09.965578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:09.965578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:09.965578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:09.965578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:09.965578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:09.965578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:09.965578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:09.965578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:09.965578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:09.965578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:09.965578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:09.965578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:09.965578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:09.965578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:09.965578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:09.965578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:09.966751 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:09.966751 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:09.966751 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:36:09.966751 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:36:09.966751 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:36:09.966751 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:36:09.966751 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:36:09.966751 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:36:09.966751 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 15:36:09.966751 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:09.970660 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 265/525] 10.222.0.119 () {56 vars in 1107 bytes} [Thu Jul 14 15:36:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:09.971501 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d3458-e21c-4f43-92f6-d06bdd58a4b6 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:09.991270 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:10.012373 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37763bcc-302c-46a1-8e0d-e94f1e4345d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:10.015183 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37763bcc-302c-46a1-8e0d-e94f1e4345d7 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:10.090838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d3458-e21c-4f43-92f6-d06bdd58a4b6 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:10.131504 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:10.133777 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f04767-d1ed-4eec-9294-e16d3470554d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:10.134622 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f04767-d1ed-4eec-9294-e16d3470554d None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:10.134867 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f04767-d1ed-4eec-9294-e16d3470554d None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:10.135161 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f04767-d1ed-4eec-9294-e16d3470554d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:10.142572 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f04767-d1ed-4eec-9294-e16d3470554d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:10.147963 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f04767-d1ed-4eec-9294-e16d3470554d None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:10.156822 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 261/526] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:36:09 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:10.157786 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37763bcc-302c-46a1-8e0d-e94f1e4345d7 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:10.159484 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-52f04767-d1ed-4eec-9294-e16d3470554d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:10.159484 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:10.159484 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:10.159484 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:10.159484 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:10.159484 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:10.159484 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:10.159484 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:10.159484 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:10.159484 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:10.159484 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:10.159484 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:10.159484 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:36:10.159484 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:36:10.159484 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:36:10.160358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:36:10.160358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:10.160358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:10.160358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:10.160358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:10.160358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:10.160358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:10.160358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:10.160358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:10.160358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:10.160358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:10.160358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:10.160358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:10.160358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:10.160358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:10.160358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:10.160358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:10.161189 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:36:10.161189 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:36:10.161189 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:36:10.161189 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:36:10.161189 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:36:10.161189 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:36:10.161189 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:10.161189 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:10.161189 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 266/527] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:10.161987 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f04767-d1ed-4eec-9294-e16d3470554d None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:10.250306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:10.279901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f04767-d1ed-4eec-9294-e16d3470554d None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:10.302555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37763bcc-302c-46a1-8e0d-e94f1e4345d7 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:10.326600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b00c28-60db-40d9-b000-cc8dbd81cff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:10.327693 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b00c28-60db-40d9-b000-cc8dbd81cff6 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:10.330697 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b00c28-60db-40d9-b000-cc8dbd81cff6 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:10.331055 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b00c28-60db-40d9-b000-cc8dbd81cff6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:10.346004 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b00c28-60db-40d9-b000-cc8dbd81cff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:10.346449 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd42ed-541f-4952-9bf4-474661f4e4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:10.347328 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd42ed-541f-4952-9bf4-474661f4e4ac None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:10.347676 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b00c28-60db-40d9-b000-cc8dbd81cff6 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:10.348016 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd42ed-541f-4952-9bf4-474661f4e4ac None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:10.348504 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd42ed-541f-4952-9bf4-474661f4e4ac None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:10.350142 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd42ed-541f-4952-9bf4-474661f4e4ac None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:10.351369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd42ed-541f-4952-9bf4-474661f4e4ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:10.353021 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd42ed-541f-4952-9bf4-474661f4e4ac None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:10.367697 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-b3b00c28-60db-40d9-b000-cc8dbd81cff6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:10.367697 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:10.367697 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:10.367697 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:10.367697 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:10.367697 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:10.367697 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:10.367697 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:10.367697 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:10.367697 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:10.367697 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:10.367697 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:10.367697 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:10.367697 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:10.367697 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:10.368754 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:10.368754 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:10.368754 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:10.368754 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:10.368754 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:10.368754 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:10.368754 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:10.368754 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:10.368754 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:10.368754 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:10.368754 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:10.368754 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:10.368754 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:10.368754 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:10.368754 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:10.368754 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:10.368754 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:10.369613 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:10.369613 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:10.369613 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:10.369613 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:10.371530 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 267/528] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:10.372531 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b00c28-60db-40d9-b000-cc8dbd81cff6 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:10.377862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 262/529] 10.222.0.119 () {56 vars in 1144 bytes} [Thu Jul 14 15:36:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:10.378849 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd42ed-541f-4952-9bf4-474661f4e4ac None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:10.430812 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:10.502437 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd42ed-541f-4952-9bf4-474661f4e4ac None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:10.502915 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b00c28-60db-40d9-b000-cc8dbd81cff6 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:10.538994 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:10.546741 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713920d-2671-4754-b277-f741ab2667eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:10.554360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713920d-2671-4754-b277-f741ab2667eb None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:10.554360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713920d-2671-4754-b277-f741ab2667eb None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:10.554360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713920d-2671-4754-b277-f741ab2667eb None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:10.554580 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac30c18-eac3-41b9-b0c0-48952f423ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:10.554665 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713920d-2671-4754-b277-f741ab2667eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:10.554778 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac30c18-eac3-41b9-b0c0-48952f423ad0 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:10.554900 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713920d-2671-4754-b277-f741ab2667eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:10.554987 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac30c18-eac3-41b9-b0c0-48952f423ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:10.554987 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac30c18-eac3-41b9-b0c0-48952f423ad0 None admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:10.554987 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac30c18-eac3-41b9-b0c0-48952f423ad0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:10.555176 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713920d-2671-4754-b277-f741ab2667eb None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:10.555245 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac30c18-eac3-41b9-b0c0-48952f423ad0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:10.555245 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac30c18-eac3-41b9-b0c0-48952f423ad0 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:10.568783 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 263/530] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:10.569972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713920d-2671-4754-b277-f741ab2667eb None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:10.578911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 268/531] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:36:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:10.578911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac30c18-eac3-41b9-b0c0-48952f423ad0 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:10.688856 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac30c18-eac3-41b9-b0c0-48952f423ad0 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:10.699338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:10.704973 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713920d-2671-4754-b277-f741ab2667eb None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:10.729506 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476ea58-93bc-41d4-87a8-207e6c6f51e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:10.730485 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476ea58-93bc-41d4-87a8-207e6c6f51e3 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:10.730930 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476ea58-93bc-41d4-87a8-207e6c6f51e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:10.731306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476ea58-93bc-41d4-87a8-207e6c6f51e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:10.740625 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476ea58-93bc-41d4-87a8-207e6c6f51e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:10.742610 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476ea58-93bc-41d4-87a8-207e6c6f51e3 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:10.746155 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4c2b5-7cb4-4071-9d6b-a628b46aff6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:10.746987 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4c2b5-7cb4-4071-9d6b-a628b46aff6b None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:10.747510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4c2b5-7cb4-4071-9d6b-a628b46aff6b None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:10.747932 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4c2b5-7cb4-4071-9d6b-a628b46aff6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:10.758780 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-e476ea58-93bc-41d4-87a8-207e6c6f51e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:10.758780 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:10.758780 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:10.758780 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:10.758780 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:10.758780 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:10.758780 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:10.758780 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:10.758780 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:10.758780 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:10.758780 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:10.758780 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:10.758780 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:36:10.758780 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:36:10.758780 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:36:10.760579 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:36:10.760579 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:10.760579 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:10.760579 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:10.760579 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:10.760579 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:10.760579 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:10.760579 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:10.760579 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:10.760579 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:10.760579 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:10.760579 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:10.760579 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:10.760579 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:10.760579 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:10.760579 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:10.760579 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:10.761430 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:36:10.761430 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:36:10.761430 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:36:10.761430 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:36:10.761430 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:36:10.761430 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:36:10.761430 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:10.761430 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:10.762761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 269/532] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:10.763920 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476ea58-93bc-41d4-87a8-207e6c6f51e3 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:10.818034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:10.822714 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4c2b5-7cb4-4071-9d6b-a628b46aff6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:10.824257 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4c2b5-7cb4-4071-9d6b-a628b46aff6b None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:10.880022 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476ea58-93bc-41d4-87a8-207e6c6f51e3 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:10.922508 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0763a2-b422-42f2-aa59-9a78ebc0b329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:10.923979 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:10.925527 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0763a2-b422-42f2-aa59-9a78ebc0b329 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:10.926040 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0763a2-b422-42f2-aa59-9a78ebc0b329 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:10.926515 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0763a2-b422-42f2-aa59-9a78ebc0b329 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:10.928067 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0763a2-b422-42f2-aa59-9a78ebc0b329 None admin] RBAC: Adding query filter params (role.id=92c47f3813b04366b3019ba2a56337eb, scope.project.id=07652ced88cf4f069d1765176be5130b, user.id=40b236c66c184d3ca40c2069dc316664) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:10.928609 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0763a2-b422-42f2-aa59-9a78ebc0b329 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:10.930971 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0763a2-b422-42f2-aa59-9a78ebc0b329 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:10.933469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 264/533] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:36:10 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:10.934403 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4c2b5-7cb4-4071-9d6b-a628b46aff6b None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:10.952277 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 270/534] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:36:10 2022] GET /identity/v3/role_assignments?user.id=40b236c66c184d3ca40c2069dc316664&scope.project.id=07652ced88cf4f069d1765176be5130b&role.id=92c47f3813b04366b3019ba2a56337eb => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:10.952277 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0763a2-b422-42f2-aa59-9a78ebc0b329 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:11.070493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0763a2-b422-42f2-aa59-9a78ebc0b329 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:11.083123 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:11.101100 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4c2b5-7cb4-4071-9d6b-a628b46aff6b None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:11.118340 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b975893-59f0-4a9a-afc5-de3a61b5fd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:11.119967 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b975893-59f0-4a9a-afc5-de3a61b5fd95 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:11.120798 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b975893-59f0-4a9a-afc5-de3a61b5fd95 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:11.122525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b975893-59f0-4a9a-afc5-de3a61b5fd95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:11.149955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b975893-59f0-4a9a-afc5-de3a61b5fd95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:11.153038 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b975893-59f0-4a9a-afc5-de3a61b5fd95 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:11.175276 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05cca8-0b66-42f6-ab15-513bfb95c806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:11.176347 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05cca8-0b66-42f6-ab15-513bfb95c806 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:11.180671 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05cca8-0b66-42f6-ab15-513bfb95c806 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:11.181233 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05cca8-0b66-42f6-ab15-513bfb95c806 None admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:11.182393 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc05cca8-0b66-42f6-ab15-513bfb95c806 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:11.182928 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc05cca8-0b66-42f6-ab15-513bfb95c806 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:11.184725 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc05cca8-0b66-42f6-ab15-513bfb95c806 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:11.191886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-8b975893-59f0-4a9a-afc5-de3a61b5fd95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:11.191886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:11.191886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:11.191886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:11.191886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:11.191886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:11.191886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:11.191886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:11.191886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:11.191886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:11.191886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:11.191886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:11.191886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:11.191886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:11.191886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:11.192939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:11.192939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:11.192939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:11.192939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:11.192939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:11.192939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:11.192939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:11.192939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:11.192939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:11.192939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:11.192939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:11.192939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:11.192939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:11.192939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:11.192939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:11.192939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:11.192939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:11.194388 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:11.194388 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:11.194388 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:11.194388 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:11.202257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 271/535] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:11.209723 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b975893-59f0-4a9a-afc5-de3a61b5fd95 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:11.211320 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 265/536] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:36:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:11.216938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05cca8-0b66-42f6-ab15-513bfb95c806 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:11.288339 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:11.356033 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05cca8-0b66-42f6-ab15-513bfb95c806 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:11.368598 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b975893-59f0-4a9a-afc5-de3a61b5fd95 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:11.412142 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2537aa-7c90-4995-a222-f95c65039ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:11.412681 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662e084-6d20-4ff8-9138-bce2a66af844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:11.412904 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2537aa-7c90-4995-a222-f95c65039ad9 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:11.413199 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2537aa-7c90-4995-a222-f95c65039ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:11.413481 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2537aa-7c90-4995-a222-f95c65039ad9 None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:11.414192 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662e084-6d20-4ff8-9138-bce2a66af844 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:11.414296 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2537aa-7c90-4995-a222-f95c65039ad9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:11.414567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2537aa-7c90-4995-a222-f95c65039ad9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:11.414979 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662e084-6d20-4ff8-9138-bce2a66af844 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:11.415461 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662e084-6d20-4ff8-9138-bce2a66af844 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:11.415941 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2537aa-7c90-4995-a222-f95c65039ad9 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:11.416721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662e084-6d20-4ff8-9138-bce2a66af844 None admin] RBAC: Adding query filter params (role.id=92c47f3813b04366b3019ba2a56337eb, scope.project.id=07652ced88cf4f069d1765176be5130b, user.id=d96e2cb043e64d04b3f7628a3419a064) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:11.417251 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662e084-6d20-4ff8-9138-bce2a66af844 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:11.418916 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662e084-6d20-4ff8-9138-bce2a66af844 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:11.425671 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 266/537] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:36:11 2022] GET /identity/v3/role_assignments?user.id=d96e2cb043e64d04b3f7628a3419a064&scope.project.id=07652ced88cf4f069d1765176be5130b&role.id=92c47f3813b04366b3019ba2a56337eb => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:11.440223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 272/538] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:11.442070 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662e084-6d20-4ff8-9138-bce2a66af844 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:11.607603 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662e084-6d20-4ff8-9138-bce2a66af844 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:11.642312 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:11.663087 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5b65c-28ad-4533-b052-a184d0903615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:11.664007 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5b65c-28ad-4533-b052-a184d0903615 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:11.664488 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5b65c-28ad-4533-b052-a184d0903615 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:11.664990 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5b65c-28ad-4533-b052-a184d0903615 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:11.685197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5b65c-28ad-4533-b052-a184d0903615 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:11.686882 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5b65c-28ad-4533-b052-a184d0903615 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:11.699208 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e9174-8d52-4da0-b73b-b584248ec112 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:11.699539 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e9174-8d52-4da0-b73b-b584248ec112 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:11.699787 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e9174-8d52-4da0-b73b-b584248ec112 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:11.704197 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 273/539] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:11.704726 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-46c5b65c-28ad-4533-b052-a184d0903615 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:11.704726 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:11.704726 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:11.704726 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:11.704726 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:11.704726 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:11.704726 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:11.704726 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:11.704726 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:11.704726 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:11.704726 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:11.704726 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:11.704726 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:36:11.704726 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:36:11.704726 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:36:11.705531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:36:11.705531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:11.705531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:11.705531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:11.705531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:11.705531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:11.705531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:11.705531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:11.705531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:11.705531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:11.705531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:11.705531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:11.705531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:11.705531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:11.705531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:11.705531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:11.705531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:11.706383 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:36:11.706383 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:36:11.706383 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:36:11.706383 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:36:11.706383 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:36:11.706383 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:36:11.706383 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:11.706383 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:11.706867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 267/540] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:11.713816 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28148d21-3e53-475d-ac28-7e69c0265d5c None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:11.713982 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5b65c-28ad-4533-b052-a184d0903615 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:11.714168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28148d21-3e53-475d-ac28-7e69c0265d5c None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:11.714549 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28148d21-3e53-475d-ac28-7e69c0265d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:11.739867 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-28148d21-3e53-475d-ac28-7e69c0265d5c None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:11.742410 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-28148d21-3e53-475d-ac28-7e69c0265d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:11.777660 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:11.868947 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5b65c-28ad-4533-b052-a184d0903615 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:11.878877 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 274/541] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:11 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:36:11.907006 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15364973-8c2d-4973-b635-dfc76f817590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:11.907669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15364973-8c2d-4973-b635-dfc76f817590 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:11.907958 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15364973-8c2d-4973-b635-dfc76f817590 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:11.908268 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15364973-8c2d-4973-b635-dfc76f817590 None admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:11.909142 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15364973-8c2d-4973-b635-dfc76f817590 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:11.909455 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15364973-8c2d-4973-b635-dfc76f817590 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:11.910895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15364973-8c2d-4973-b635-dfc76f817590 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:11.917077 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28148d21-3e53-475d-ac28-7e69c0265d5c None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:11.924181 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 268/542] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:36:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:11.929803 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15364973-8c2d-4973-b635-dfc76f817590 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:11.997466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:12.062397 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28148d21-3e53-475d-ac28-7e69c0265d5c None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:12.077739 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15364973-8c2d-4973-b635-dfc76f817590 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:12.113712 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476deab-4c08-45a9-9a26-e2be14f64823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:12.115279 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476deab-4c08-45a9-9a26-e2be14f64823 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:12.116133 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476deab-4c08-45a9-9a26-e2be14f64823 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:12.116411 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476deab-4c08-45a9-9a26-e2be14f64823 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:12.122553 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7cbb5-e6aa-42be-a2d5-1af7863bc7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:12.123305 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7cbb5-e6aa-42be-a2d5-1af7863bc7f3 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:12.123667 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7cbb5-e6aa-42be-a2d5-1af7863bc7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:12.124048 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7cbb5-e6aa-42be-a2d5-1af7863bc7f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:12.124988 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7cbb5-e6aa-42be-a2d5-1af7863bc7f3 None admin] RBAC: Adding query filter params (role.id=92c47f3813b04366b3019ba2a56337eb, scope.project.id=07652ced88cf4f069d1765176be5130b, user.id=70559c2ce32043dd9a902837ab444622) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:12.125375 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7cbb5-e6aa-42be-a2d5-1af7863bc7f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:12.126879 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7cbb5-e6aa-42be-a2d5-1af7863bc7f3 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:12.128934 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476deab-4c08-45a9-9a26-e2be14f64823 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:36:12.138294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-7476deab-4c08-45a9-9a26-e2be14f64823 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:12.138294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:12.138294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:12.138294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:12.138294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:12.138294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:12.138294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:12.138294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:12.138294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:12.138294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:12.138294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:12.138294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:12.138294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:36:12.138294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:36:12.138294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:36:12.138294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:36:12.140492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:36:12.140492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:36:12.140492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:36:12.140492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:36:12.140492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:12.140492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:12.140492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:12.140492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:12.140492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:12.140492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:12.140492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:12.140492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:12.140492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:12.140492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:12.140492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:12.140492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:12.142409 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:12.142409 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:12.142409 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:12.142409 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:12.142409 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:36:12.142409 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:36:12.142409 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:36:12.142409 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:36:12.142409 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:36:12.142409 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:36:12.142409 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:12.142409 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:12.142409 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 275/544] 10.222.0.119 () {56 vars in 1107 bytes} [Thu Jul 14 15:36:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:36:12.143952 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 269/544] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:36:11 2022] GET /identity/v3/role_assignments?user.id=70559c2ce32043dd9a902837ab444622&scope.project.id=07652ced88cf4f069d1765176be5130b&role.id=92c47f3813b04366b3019ba2a56337eb => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:12.144120 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b283d17-5894-419d-8151-413b367a2a1a None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:12.144120 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b283d17-5894-419d-8151-413b367a2a1a None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:12.144120 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b283d17-5894-419d-8151-413b367a2a1a None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:12.144120 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 276/545] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:12.152197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7cbb5-e6aa-42be-a2d5-1af7863bc7f3 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:12.152420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c79e5a-48aa-48c9-afa4-2094a71cc07c None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:12.152420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c79e5a-48aa-48c9-afa4-2094a71cc07c None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:12.152420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c79e5a-48aa-48c9-afa4-2094a71cc07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:12.172493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-15c79e5a-48aa-48c9-afa4-2094a71cc07c None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:12.173999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-15c79e5a-48aa-48c9-afa4-2094a71cc07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:12.185138 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:12.257936 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 277/546] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:36:12.289581 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c79e5a-48aa-48c9-afa4-2094a71cc07c None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:12.411368 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7cbb5-e6aa-42be-a2d5-1af7863bc7f3 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:12.420185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:12.423672 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c79e5a-48aa-48c9-afa4-2094a71cc07c None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:12.478924 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f87b5-5cce-408e-8179-ece600a54ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:12.479612 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f87b5-5cce-408e-8179-ece600a54ce8 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:12.479897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f87b5-5cce-408e-8179-ece600a54ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:12.480198 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f87b5-5cce-408e-8179-ece600a54ce8 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:12.480959 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f87b5-5cce-408e-8179-ece600a54ce8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:12.481268 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f87b5-5cce-408e-8179-ece600a54ce8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:12.482740 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f87b5-5cce-408e-8179-ece600a54ce8 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:12.493464 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6614606-eb07-4831-8328-7f5e32288f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:12.494265 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6614606-eb07-4831-8328-7f5e32288f22 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:12.494548 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6614606-eb07-4831-8328-7f5e32288f22 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:12.494822 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6614606-eb07-4831-8328-7f5e32288f22 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:12.506807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 270/547] 10.222.0.119 () {56 vars in 1108 bytes} [Thu Jul 14 15:36:12 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:12.509833 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f87b5-5cce-408e-8179-ece600a54ce8 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:12.518090 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6614606-eb07-4831-8328-7f5e32288f22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:36:12.526455 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-e6614606-eb07-4831-8328-7f5e32288f22 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:12.526455 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:12.526455 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:12.526455 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:12.526455 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:12.526455 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:12.526455 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:12.526455 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:12.526455 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:12.526455 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:12.526455 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:12.526455 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:12.526455 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:36:12.526455 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:36:12.526455 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:36:12.526455 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:36:12.527336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:36:12.527336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:36:12.527336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:36:12.527336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:36:12.527336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:12.527336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:12.527336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:12.527336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:12.527336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:12.527336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:12.527336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:12.527336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:12.527336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:12.527336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:12.527336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:12.527336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:12.528142 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:12.528142 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:12.528142 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:12.528142 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:12.528142 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:36:12.528142 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:36:12.528142 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:36:12.528142 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:36:12.528142 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:36:12.528142 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:36:12.528142 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:12.528142 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:12.533012 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 278/548] 10.222.0.119 () {56 vars in 1107 bytes} [Thu Jul 14 15:36:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:36:12.538237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6614606-eb07-4831-8328-7f5e32288f22 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:12.544280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:12.700314 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f87b5-5cce-408e-8179-ece600a54ce8 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:12.734373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6614606-eb07-4831-8328-7f5e32288f22 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:12.757689 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed3f2c-3445-4968-8a7b-a95a2073be14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:12.758501 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed3f2c-3445-4968-8a7b-a95a2073be14 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:12.762925 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed3f2c-3445-4968-8a7b-a95a2073be14 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:12.762925 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed3f2c-3445-4968-8a7b-a95a2073be14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:12.784015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed3f2c-3445-4968-8a7b-a95a2073be14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:12.785552 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed3f2c-3445-4968-8a7b-a95a2073be14 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:12.825015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-17ed3f2c-3445-4968-8a7b-a95a2073be14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:12.825015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:12.825015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:12.825015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:12.825015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:12.825015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:12.825015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:12.825015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:12.825015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:12.825015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:12.825015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:12.825015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:12.825015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:12.825015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:12.825015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:12.826114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:12.826114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:12.826114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:12.826114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:12.826114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:12.826114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:12.826114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:12.826114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:12.826114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:12.826114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:12.826114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:12.826114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:12.826114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:12.826114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:12.826114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:12.826114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:12.826114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:12.826958 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:12.826958 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:12.826958 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:12.826958 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:12.826958 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 271/549] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:12.829287 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8935a-2989-444d-a5d5-782e97a03021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:12.829287 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8935a-2989-444d-a5d5-782e97a03021 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:12.829287 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8935a-2989-444d-a5d5-782e97a03021 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:12.829559 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8935a-2989-444d-a5d5-782e97a03021 None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:12.830278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8935a-2989-444d-a5d5-782e97a03021 None admin] RBAC: Adding query filter params (name=service) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:12.830590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8935a-2989-444d-a5d5-782e97a03021 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:12.832021 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8935a-2989-444d-a5d5-782e97a03021 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:12.840491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed3f2c-3445-4968-8a7b-a95a2073be14 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:12.855565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 279/550] 10.222.0.119 () {56 vars in 1108 bytes} [Thu Jul 14 15:36:12 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:12.861960 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8935a-2989-444d-a5d5-782e97a03021 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:12.880248 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:12.979392 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:13.007241 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed3f2c-3445-4968-8a7b-a95a2073be14 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:13.039744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8935a-2989-444d-a5d5-782e97a03021 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:13.057399 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2c557-6061-457f-86e2-0ddd89c594a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:13.058408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2c557-6061-457f-86e2-0ddd89c594a8 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:13.058896 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2c557-6061-457f-86e2-0ddd89c594a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:13.059373 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2c557-6061-457f-86e2-0ddd89c594a8 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:13.060482 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2c557-6061-457f-86e2-0ddd89c594a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:13.061082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2c557-6061-457f-86e2-0ddd89c594a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:13.062672 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2c557-6061-457f-86e2-0ddd89c594a8 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:13.084450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 272/551] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:13.089512 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2c557-6061-457f-86e2-0ddd89c594a8 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:13.095446 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b654f-5980-4f68-bb03-a8fa0f59ae44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:13.097635 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b654f-5980-4f68-bb03-a8fa0f59ae44 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:13.098134 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b654f-5980-4f68-bb03-a8fa0f59ae44 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:13.098626 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b654f-5980-4f68-bb03-a8fa0f59ae44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:13.126682 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b654f-5980-4f68-bb03-a8fa0f59ae44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:13.128572 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b654f-5980-4f68-bb03-a8fa0f59ae44 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:13.178637 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-147b654f-5980-4f68-bb03-a8fa0f59ae44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:13.178637 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:13.178637 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:13.178637 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:13.178637 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:13.178637 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:13.178637 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:13.178637 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:13.178637 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:13.178637 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:13.178637 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:13.178637 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:13.178637 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:13.178637 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:13.178637 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:13.179614 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:13.179614 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:13.179614 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:13.179614 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:13.179614 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:13.179614 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:13.179614 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:13.179614 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:13.179614 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:13.179614 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:13.179614 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:13.179614 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:13.179614 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:13.179614 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:13.179614 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:13.179614 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:13.179614 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:13.180531 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:13.180531 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:13.180531 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:13.180531 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:13.186224 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 280/552] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:36:13.191823 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b654f-5980-4f68-bb03-a8fa0f59ae44 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:13.263853 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:13.299720 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2c557-6061-457f-86e2-0ddd89c594a8 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:13.356866 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70f128-3587-4b67-900f-f7ca79e3f0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:13.357689 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70f128-3587-4b67-900f-f7ca79e3f0d2 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:13.357979 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70f128-3587-4b67-900f-f7ca79e3f0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:13.358261 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70f128-3587-4b67-900f-f7ca79e3f0d2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:13.367007 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b654f-5980-4f68-bb03-a8fa0f59ae44 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:13.373241 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70f128-3587-4b67-900f-f7ca79e3f0d2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:13.374732 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70f128-3587-4b67-900f-f7ca79e3f0d2 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:13.384661 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:13.405435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-ce70f128-3587-4b67-900f-f7ca79e3f0d2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:36:13.405435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:13.405435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:13.405435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:13.405435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:13.405435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:13.405435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:13.405435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:13.405435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:13.405435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:13.405435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:13.405435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:13.405435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:36:13.405435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:36:13.405435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:36:13.405435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:36:13.406442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:13.406442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:13.406442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:13.406442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:13.406442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:13.406442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:13.406442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:13.406442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:13.406442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:13.406442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:13.406442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:13.406442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:13.406442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:13.406442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:13.406442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:13.406442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:13.406442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:13.406442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:13.407344 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:13.407344 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:13.407344 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:36:13.407344 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:36:13.407344 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:36:13.407344 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:36:13.407344 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:36:13.407344 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:36:13.407344 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:36:13.407344 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:13.407344 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 273/553] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:36:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:13.412754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70f128-3587-4b67-900f-f7ca79e3f0d2 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:13.416492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66703dd6-efb9-4f38-bb77-c71dec6b5eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:13.417294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66703dd6-efb9-4f38-bb77-c71dec6b5eda None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:13.417581 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66703dd6-efb9-4f38-bb77-c71dec6b5eda None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:13.417860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66703dd6-efb9-4f38-bb77-c71dec6b5eda None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:13.418589 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66703dd6-efb9-4f38-bb77-c71dec6b5eda None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:13.418896 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66703dd6-efb9-4f38-bb77-c71dec6b5eda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:13.420404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66703dd6-efb9-4f38-bb77-c71dec6b5eda None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:13.442272 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 281/554] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:13.448658 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66703dd6-efb9-4f38-bb77-c71dec6b5eda None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:13.575572 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66703dd6-efb9-4f38-bb77-c71dec6b5eda None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:13.604663 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70f128-3587-4b67-900f-f7ca79e3f0d2 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:13.613195 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ef8ae-241f-43d5-8e81-7f6fcf879028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:13.614824 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ef8ae-241f-43d5-8e81-7f6fcf879028 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:13.615567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ef8ae-241f-43d5-8e81-7f6fcf879028 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:13.616209 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ef8ae-241f-43d5-8e81-7f6fcf879028 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:13.624841 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ef8ae-241f-43d5-8e81-7f6fcf879028 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:13.626476 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ef8ae-241f-43d5-8e81-7f6fcf879028 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:13.643051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a948f9d-60a8-40ba-aa01-dcb75336d4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:13.643740 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a948f9d-60a8-40ba-aa01-dcb75336d4fe None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:13.644028 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a948f9d-60a8-40ba-aa01-dcb75336d4fe None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:13.644342 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a948f9d-60a8-40ba-aa01-dcb75336d4fe None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:13.645208 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a948f9d-60a8-40ba-aa01-dcb75336d4fe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:13.645516 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a948f9d-60a8-40ba-aa01-dcb75336d4fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:13.647560 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-c07ef8ae-241f-43d5-8e81-7f6fcf879028 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:36:13.647560 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:13.647560 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:13.647560 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:13.647560 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:13.647560 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:13.647560 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:13.647560 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:13.647560 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:13.647560 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:13.647560 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:13.647560 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:13.647560 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:36:13.647560 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:36:13.647560 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:36:13.647560 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:36:13.648495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:13.648495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:13.648495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:13.648495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:13.648495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:13.648495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:13.648495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:13.648495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:13.648495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:13.648495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:13.648495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:13.648495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:13.648495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:13.648495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:13.648495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:13.648495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:13.648495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:13.648495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:13.649850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:13.649850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:13.649850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:36:13.649850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:36:13.649850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:36:13.649850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:36:13.649850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:36:13.649850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:36:13.649850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:36:13.649850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:13.650368 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a948f9d-60a8-40ba-aa01-dcb75336d4fe None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:13.652434 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 282/555] 10.222.0.119 () {56 vars in 1098 bytes} [Thu Jul 14 15:36:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:36:13.653867 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952fd6e-4407-4364-9a03-e632f94ec0e1 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:13.654350 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952fd6e-4407-4364-9a03-e632f94ec0e1 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:13.654815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952fd6e-4407-4364-9a03-e632f94ec0e1 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:13.656508 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 283/556] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:13.660449 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952fd6e-4407-4364-9a03-e632f94ec0e1 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:13.668169 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:13.681049 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 274/557] 10.222.0.119 () {56 vars in 1140 bytes} [Thu Jul 14 15:36:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:13.682622 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a2a0f-1d06-4c9c-8aa8-f610e2f27310 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:13.682929 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a2a0f-1d06-4c9c-8aa8-f610e2f27310 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:13.683213 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a2a0f-1d06-4c9c-8aa8-f610e2f27310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:13.701932 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-bc9a2a0f-1d06-4c9c-8aa8-f610e2f27310 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:13.703917 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-bc9a2a0f-1d06-4c9c-8aa8-f610e2f27310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:13.708642 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:13.792244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 275/558] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:36:13.793148 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a2a0f-1d06-4c9c-8aa8-f610e2f27310 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:13.795011 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952fd6e-4407-4364-9a03-e632f94ec0e1 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:13.836442 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc5cb6-0064-4965-a288-95477a994793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:13.837719 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc5cb6-0064-4965-a288-95477a994793 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:13.838632 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc5cb6-0064-4965-a288-95477a994793 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:13.839214 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc5cb6-0064-4965-a288-95477a994793 None admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:13.840366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc5cb6-0064-4965-a288-95477a994793 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:13.841360 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc5cb6-0064-4965-a288-95477a994793 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:13.843630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc5cb6-0064-4965-a288-95477a994793 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:13.870650 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 284/559] 10.222.0.119 () {56 vars in 1138 bytes} [Thu Jul 14 15:36:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:13.871661 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc5cb6-0064-4965-a288-95477a994793 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:13.939164 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a2a0f-1d06-4c9c-8aa8-f610e2f27310 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:13.976680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:13.984774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:13.988277 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af144114-fa3c-4f41-a962-20ec9afc1091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:13.989234 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af144114-fa3c-4f41-a962-20ec9afc1091 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:13.989783 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af144114-fa3c-4f41-a962-20ec9afc1091 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:13.990068 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af144114-fa3c-4f41-a962-20ec9afc1091 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:13.992062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc5cb6-0064-4965-a288-95477a994793 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:14.028632 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff9a9b-1117-40d8-8912-7f655dc9e890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:14.029430 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff9a9b-1117-40d8-8912-7f655dc9e890 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:14.029712 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff9a9b-1117-40d8-8912-7f655dc9e890 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:14.029986 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff9a9b-1117-40d8-8912-7f655dc9e890 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:14.041119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff9a9b-1117-40d8-8912-7f655dc9e890 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:36:14.050374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-e3ff9a9b-1117-40d8-8912-7f655dc9e890 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:14.050374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:14.050374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:14.050374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:14.050374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:14.050374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:14.050374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:14.050374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:14.050374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:14.050374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:14.050374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:14.050374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:14.050374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:36:14.050374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:36:14.050374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:36:14.050374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:36:14.051301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:36:14.051301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:36:14.051301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:36:14.051301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:36:14.051301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:14.051301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:14.051301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:14.051301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:14.051301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:14.051301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:14.051301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:14.051301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:14.051301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:14.051301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:14.051301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:14.051301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:14.052156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:14.052156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:14.052156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:14.052156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:14.052156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:36:14.052156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:36:14.052156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:36:14.052156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:36:14.052156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:36:14.052156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:36:14.052156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:14.052156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:14.052156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 285/560] 10.222.0.119 () {56 vars in 1107 bytes} [Thu Jul 14 15:36:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:14.052868 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff9a9b-1117-40d8-8912-7f655dc9e890 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:14.069426 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af144114-fa3c-4f41-a962-20ec9afc1091 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:14.070895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af144114-fa3c-4f41-a962-20ec9afc1091 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:14.165077 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff9a9b-1117-40d8-8912-7f655dc9e890 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:14.179929 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 276/561] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:36:13 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:14.179929 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf305bb-21f4-4921-89db-72736bd6bb86 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:14.179929 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf305bb-21f4-4921-89db-72736bd6bb86 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:14.179929 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf305bb-21f4-4921-89db-72736bd6bb86 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:14.179929 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 277/562] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:14.179929 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf305bb-21f4-4921-89db-72736bd6bb86 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:14.209781 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fb049-8a77-48a4-a90c-c4df6eb13b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:14.210617 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fb049-8a77-48a4-a90c-c4df6eb13b1e None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:14.210901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fb049-8a77-48a4-a90c-c4df6eb13b1e None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:14.211208 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fb049-8a77-48a4-a90c-c4df6eb13b1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:14.214205 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:14.222374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fb049-8a77-48a4-a90c-c4df6eb13b1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:14.227284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fb049-8a77-48a4-a90c-c4df6eb13b1e None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:14.242099 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-231fb049-8a77-48a4-a90c-c4df6eb13b1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:14.242099 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:14.242099 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:14.242099 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:14.242099 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:14.242099 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:14.242099 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:14.242099 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:14.242099 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:14.242099 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:14.242099 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:14.242099 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:14.242099 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:14.242099 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:14.242099 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:14.243033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:14.243033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:14.243033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:14.243033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:14.243033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:14.243033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:14.243033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:14.243033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:14.243033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:14.243033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:14.243033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:14.243033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:14.243033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:14.243033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:14.243033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:14.243033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:14.243033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:14.243913 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:14.243913 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:14.243913 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:14.243913 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:14.243913 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 286/563] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:14.244215 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fb049-8a77-48a4-a90c-c4df6eb13b1e None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:14.255001 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:14.298340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf305bb-21f4-4921-89db-72736bd6bb86 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:14.338212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade2c7d-63be-439f-828f-3e0485544d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:14.338896 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade2c7d-63be-439f-828f-3e0485544d45 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:14.339182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade2c7d-63be-439f-828f-3e0485544d45 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:14.339890 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade2c7d-63be-439f-828f-3e0485544d45 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:14.340692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade2c7d-63be-439f-828f-3e0485544d45 None admin] RBAC: Adding query filter params (name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:14.341007 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade2c7d-63be-439f-828f-3e0485544d45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:14.342626 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade2c7d-63be-439f-828f-3e0485544d45 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:14.351207 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 278/564] 10.222.0.119 () {56 vars in 1108 bytes} [Thu Jul 14 15:36:14 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:14.352492 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ee1e3-f54d-4b31-9ce4-478af592f0e2 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:14.352782 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ee1e3-f54d-4b31-9ce4-478af592f0e2 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:14.352913 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fb049-8a77-48a4-a90c-c4df6eb13b1e None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:14.353057 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ee1e3-f54d-4b31-9ce4-478af592f0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:14.371396 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-a20ee1e3-f54d-4b31-9ce4-478af592f0e2 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:14.372946 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-a20ee1e3-f54d-4b31-9ce4-478af592f0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:14.390871 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3214654-b4ce-4bbc-9ff8-f8d6bb176566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:14.391665 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3214654-b4ce-4bbc-9ff8-f8d6bb176566 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:14.391947 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3214654-b4ce-4bbc-9ff8-f8d6bb176566 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:14.392256 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3214654-b4ce-4bbc-9ff8-f8d6bb176566 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:14.403822 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3214654-b4ce-4bbc-9ff8-f8d6bb176566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:14.405317 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3214654-b4ce-4bbc-9ff8-f8d6bb176566 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:14.422999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-b3214654-b4ce-4bbc-9ff8-f8d6bb176566 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:14.422999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:14.422999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:14.422999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:14.422999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:14.422999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:14.422999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:14.422999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:14.422999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:14.422999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:14.422999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:14.422999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:14.422999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:14.422999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:14.422999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:14.424092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:14.424092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:14.424092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:14.424092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:14.424092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:14.424092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:14.424092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:14.424092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:14.424092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:14.424092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:14.424092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:14.424092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:14.424092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:14.424092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:14.424092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:14.424092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:14.424092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:14.425038 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:14.425038 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:14.425038 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:14.425038 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:14.425038 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 287/565] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:14.425038 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3214654-b4ce-4bbc-9ff8-f8d6bb176566 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:14.450720 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 279/566] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:36:14.451844 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ee1e3-f54d-4b31-9ce4-478af592f0e2 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:14.474631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:14.505928 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:14.549870 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3214654-b4ce-4bbc-9ff8-f8d6bb176566 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:14.554573 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ee1e3-f54d-4b31-9ce4-478af592f0e2 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:14.582740 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18025b92-1ab2-4730-b0da-138f33f5aebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:14.583409 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18025b92-1ab2-4730-b0da-138f33f5aebd None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:14.583698 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18025b92-1ab2-4730-b0da-138f33f5aebd None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:14.584589 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18025b92-1ab2-4730-b0da-138f33f5aebd None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:14.585487 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18025b92-1ab2-4730-b0da-138f33f5aebd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:14.585796 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18025b92-1ab2-4730-b0da-138f33f5aebd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:14.587228 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18025b92-1ab2-4730-b0da-138f33f5aebd None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:14.587975 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283dfc5-90d9-450b-a1d8-d06467be35e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:14.588796 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283dfc5-90d9-450b-a1d8-d06467be35e1 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:14.589076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283dfc5-90d9-450b-a1d8-d06467be35e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:14.589354 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283dfc5-90d9-450b-a1d8-d06467be35e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:14.601089 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283dfc5-90d9-450b-a1d8-d06467be35e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:14.602538 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283dfc5-90d9-450b-a1d8-d06467be35e1 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:14.602948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 288/567] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:14.603770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18025b92-1ab2-4730-b0da-138f33f5aebd None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:14.623487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-0283dfc5-90d9-450b-a1d8-d06467be35e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:14.623487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:14.623487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:14.623487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:14.623487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:14.623487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:14.623487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:14.623487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:14.623487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:14.623487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:14.623487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:14.623487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:14.623487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:14.623487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:14.623487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:14.624631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:14.624631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:14.624631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:14.624631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:14.624631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:14.624631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:14.624631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:14.624631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:14.624631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:14.624631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:14.624631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:14.624631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:14.624631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:14.624631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:14.624631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:14.624631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:14.624631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:14.625586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:14.625586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:14.625586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:14.625586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:14.625586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 280/568] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:14.625947 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df927403-8f6e-4d54-8c0e-69a96147f2a0 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:14.626182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df927403-8f6e-4d54-8c0e-69a96147f2a0 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:14.626464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df927403-8f6e-4d54-8c0e-69a96147f2a0 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:14.627824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 281/569] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:14 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:14.628433 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df927403-8f6e-4d54-8c0e-69a96147f2a0 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:14.702141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:14.708332 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18025b92-1ab2-4730-b0da-138f33f5aebd None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:14.727806 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:14.733889 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df927403-8f6e-4d54-8c0e-69a96147f2a0 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:14.749196 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290c204-203c-4f05-b8b3-b4934b3fc4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:14.749919 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290c204-203c-4f05-b8b3-b4934b3fc4fc None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:14.750554 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290c204-203c-4f05-b8b3-b4934b3fc4fc None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:14.751040 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290c204-203c-4f05-b8b3-b4934b3fc4fc None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:14.751918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290c204-203c-4f05-b8b3-b4934b3fc4fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:14.752525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290c204-203c-4f05-b8b3-b4934b3fc4fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:14.753902 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290c204-203c-4f05-b8b3-b4934b3fc4fc None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:14.765599 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 289/570] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:14.766565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290c204-203c-4f05-b8b3-b4934b3fc4fc None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:14.769556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f427dc-de60-4eb9-afd3-6c64fce5a8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:14.770370 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f427dc-de60-4eb9-afd3-6c64fce5a8df None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:14.770656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f427dc-de60-4eb9-afd3-6c64fce5a8df None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:14.770932 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f427dc-de60-4eb9-afd3-6c64fce5a8df None admin] PATH_INFO: `/v3/roles/service` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:14.782018 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f427dc-de60-4eb9-afd3-6c64fce5a8df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:36:14.790549 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-b9f427dc-de60-4eb9-afd3-6c64fce5a8df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:14.790549 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:14.790549 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:14.790549 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:14.790549 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:14.790549 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:14.790549 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:14.790549 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:14.790549 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:14.790549 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:14.790549 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:14.790549 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:14.790549 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:36:14.790549 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:36:14.790549 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:36:14.790549 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:36:14.791656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:36:14.791656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:36:14.791656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:36:14.791656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:36:14.791656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:14.791656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:14.791656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:14.791656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:14.791656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:14.791656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:14.791656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:14.791656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:14.791656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:14.791656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:14.791656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:14.791656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:14.792718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:14.792718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:14.792718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:14.792718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:14.792718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:36:14.792718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:36:14.792718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:36:14.792718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:36:14.792718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:36:14.792718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:36:14.792718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:14.792718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:14.792718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 282/571] 10.222.0.119 () {56 vars in 1107 bytes} [Thu Jul 14 15:36:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:14.792718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f427dc-de60-4eb9-afd3-6c64fce5a8df None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:14.869756 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290c204-203c-4f05-b8b3-b4934b3fc4fc None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:14.893524 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f427dc-de60-4eb9-afd3-6c64fce5a8df None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:14.903226 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6937f5d-5e8b-4b3e-8d78-b5e295d351d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:14.904021 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6937f5d-5e8b-4b3e-8d78-b5e295d351d0 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:14.904411 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6937f5d-5e8b-4b3e-8d78-b5e295d351d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:14.904690 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6937f5d-5e8b-4b3e-8d78-b5e295d351d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:14.911403 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6937f5d-5e8b-4b3e-8d78-b5e295d351d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:14.913481 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6937f5d-5e8b-4b3e-8d78-b5e295d351d0 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:14.922361 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:14.927164 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6a704-3d0c-45d1-8157-1a742e554f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:14.927762 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-b6937f5d-5e8b-4b3e-8d78-b5e295d351d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:14.927762 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:14.927762 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:14.927762 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:14.927762 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:14.927762 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:14.927762 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:14.927762 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:14.927762 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:14.927762 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:14.927762 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:14.927762 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:14.927762 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:36:14.927762 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:36:14.927762 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:36:14.929326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:36:14.929326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:14.929326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:14.929326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:14.929326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:14.929326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:14.929326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:14.929326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:14.929326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:14.929326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:14.929326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:14.929326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:14.929326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:14.929326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:14.929326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:14.929326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:14.929326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:14.930191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:36:14.930191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:36:14.930191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:36:14.930191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:36:14.930191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:36:14.930191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:36:14.930191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:14.930191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:14.930984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6a704-3d0c-45d1-8157-1a742e554f2f None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:14.930984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6a704-3d0c-45d1-8157-1a742e554f2f None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:14.930984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6a704-3d0c-45d1-8157-1a742e554f2f None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:14.931174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 290/572] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:14.931244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6a704-3d0c-45d1-8157-1a742e554f2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:14.931244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6a704-3d0c-45d1-8157-1a742e554f2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:14.931382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15cd86-0e37-45fe-940d-d707ce76b55c None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:14.931382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15cd86-0e37-45fe-940d-d707ce76b55c None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:14.931382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15cd86-0e37-45fe-940d-d707ce76b55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:14.931677 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6a704-3d0c-45d1-8157-1a742e554f2f None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:14.944770 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 283/573] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:14.945005 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6a704-3d0c-45d1-8157-1a742e554f2f None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:14.950527 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-9e15cd86-0e37-45fe-940d-d707ce76b55c None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:14.951724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-9e15cd86-0e37-45fe-940d-d707ce76b55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:14.981844 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:15.025917 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 291/574] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:36:15.027119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15cd86-0e37-45fe-940d-d707ce76b55c None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:15.062541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6a704-3d0c-45d1-8157-1a742e554f2f None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:15.096628 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535ad9e-1892-4c92-bbd6-87135297103d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:15.097416 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535ad9e-1892-4c92-bbd6-87135297103d None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:15.097701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535ad9e-1892-4c92-bbd6-87135297103d None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:15.098217 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535ad9e-1892-4c92-bbd6-87135297103d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:15.105425 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535ad9e-1892-4c92-bbd6-87135297103d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:15.107020 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535ad9e-1892-4c92-bbd6-87135297103d None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:15.121208 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-6535ad9e-1892-4c92-bbd6-87135297103d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:15.121208 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:15.121208 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:15.121208 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:15.121208 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:15.121208 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:15.121208 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:15.121208 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:15.121208 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:15.121208 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:15.121208 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:15.121208 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:15.121208 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:36:15.121208 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:36:15.121208 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:36:15.122283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:36:15.122283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:15.122283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:15.122283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:15.122283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:15.122283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:15.122283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:15.122283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:15.122283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:15.122283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:15.122283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:15.122283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:15.122283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:15.122283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:15.122283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:15.122283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:15.122283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:15.123199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:36:15.123199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:36:15.123199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:36:15.123199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:36:15.123199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:36:15.123199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:36:15.123199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:15.123199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:15.123199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 284/575] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:15.123199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535ad9e-1892-4c92-bbd6-87135297103d None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:15.139421 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15cd86-0e37-45fe-940d-d707ce76b55c None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:15.173536 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba49cb-77cc-4e74-919e-2c750ffe6034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:15.174206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba49cb-77cc-4e74-919e-2c750ffe6034 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:15.174492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba49cb-77cc-4e74-919e-2c750ffe6034 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:15.174767 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba49cb-77cc-4e74-919e-2c750ffe6034 None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:15.175519 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba49cb-77cc-4e74-919e-2c750ffe6034 None admin] RBAC: Adding query filter params (name=service) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:15.175644 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:15.175827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba49cb-77cc-4e74-919e-2c750ffe6034 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:15.177680 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba49cb-77cc-4e74-919e-2c750ffe6034 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:15.186314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 292/576] 10.222.0.119 () {56 vars in 1108 bytes} [Thu Jul 14 15:36:15 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:15.187098 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba49cb-77cc-4e74-919e-2c750ffe6034 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:15.218957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:15.223460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535ad9e-1892-4c92-bbd6-87135297103d None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:15.257107 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4631e2e-06a2-42f6-b297-159ac9fe4e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:15.257691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4631e2e-06a2-42f6-b297-159ac9fe4e80 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:15.257975 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4631e2e-06a2-42f6-b297-159ac9fe4e80 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:15.258252 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4631e2e-06a2-42f6-b297-159ac9fe4e80 None admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:15.259038 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4631e2e-06a2-42f6-b297-159ac9fe4e80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:15.259350 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4631e2e-06a2-42f6-b297-159ac9fe4e80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:15.260807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4631e2e-06a2-42f6-b297-159ac9fe4e80 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:15.273537 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 285/577] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:36:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:15.274167 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4631e2e-06a2-42f6-b297-159ac9fe4e80 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:15.294792 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba49cb-77cc-4e74-919e-2c750ffe6034 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:15.327729 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a95671-1383-48ad-8657-2d18c0a2a95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:15.328768 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a95671-1383-48ad-8657-2d18c0a2a95b None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:15.329261 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a95671-1383-48ad-8657-2d18c0a2a95b None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:15.329549 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a95671-1383-48ad-8657-2d18c0a2a95b None admin] PATH_INFO: `/v3/users/glance` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:15.337929 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a95671-1383-48ad-8657-2d18c0a2a95b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:15.339368 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a95671-1383-48ad-8657-2d18c0a2a95b None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:15.354163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-19a95671-1383-48ad-8657-2d18c0a2a95b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 15:36:15.354163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:15.354163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:15.354163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:15.354163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:15.354163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:15.354163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:15.354163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:15.354163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:15.354163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:15.354163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:15.354163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:15.354163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:36:15.354163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:36:15.354163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:36:15.354163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:36:15.355278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:15.355278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:15.355278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:15.355278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:15.355278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:15.355278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:15.355278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:15.355278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:15.355278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:15.355278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:15.355278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:15.355278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:15.355278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:15.355278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:15.355278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:15.355278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:15.355278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:15.355278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:15.356316 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:15.356316 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:15.356316 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:36:15.356316 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:36:15.356316 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:36:15.356316 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:36:15.356316 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:36:15.356316 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:36:15.356316 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 15:36:15.356316 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:15.356316 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 293/578] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:36:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:15.356900 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a95671-1383-48ad-8657-2d18c0a2a95b None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:15.375857 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4631e2e-06a2-42f6-b297-159ac9fe4e80 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:15.388788 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:15.410219 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3234237-a26b-402f-a843-69ef795ff4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:15.411014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3234237-a26b-402f-a843-69ef795ff4f8 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:15.411298 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3234237-a26b-402f-a843-69ef795ff4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:15.411680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3234237-a26b-402f-a843-69ef795ff4f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:15.422591 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3234237-a26b-402f-a843-69ef795ff4f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:36:15.430369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-d3234237-a26b-402f-a843-69ef795ff4f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:15.430369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:15.430369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:15.430369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:15.430369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:15.430369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:15.430369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:15.430369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:15.430369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:15.430369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:15.430369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:15.430369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:15.430369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:36:15.430369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:36:15.430369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:36:15.430369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:36:15.431470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:36:15.431470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:36:15.431470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:36:15.431470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:36:15.431470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:15.431470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:15.431470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:15.431470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:15.431470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:15.431470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:15.431470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:15.431470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:15.431470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:15.431470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:15.431470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:15.431470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:15.432359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:15.432359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:15.432359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:15.432359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:15.432359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:36:15.432359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:36:15.432359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:36:15.432359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:36:15.432359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:36:15.432359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:36:15.432359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:15.432359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:15.432359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 286/579] 10.222.0.119 () {56 vars in 1107 bytes} [Thu Jul 14 15:36:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:15.432359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3234237-a26b-402f-a843-69ef795ff4f8 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:15.452575 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:15.462506 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a95671-1383-48ad-8657-2d18c0a2a95b None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:15.496315 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c126a30-d09d-4837-855a-d8a1731f059b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:15.496978 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c126a30-d09d-4837-855a-d8a1731f059b None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:15.497264 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c126a30-d09d-4837-855a-d8a1731f059b None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:15.497545 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c126a30-d09d-4837-855a-d8a1731f059b None admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:15.498326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c126a30-d09d-4837-855a-d8a1731f059b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:15.498638 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c126a30-d09d-4837-855a-d8a1731f059b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:15.500054 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c126a30-d09d-4837-855a-d8a1731f059b None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:15.517246 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 294/580] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:36:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:15.518279 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c126a30-d09d-4837-855a-d8a1731f059b None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:15.540650 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3234237-a26b-402f-a843-69ef795ff4f8 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:15.574212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350e25f-20bc-4332-8c9d-9aef9700fbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:15.574998 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350e25f-20bc-4332-8c9d-9aef9700fbaf None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:15.575282 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350e25f-20bc-4332-8c9d-9aef9700fbaf None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:15.575558 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350e25f-20bc-4332-8c9d-9aef9700fbaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:15.585811 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350e25f-20bc-4332-8c9d-9aef9700fbaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:15.587259 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350e25f-20bc-4332-8c9d-9aef9700fbaf None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:15.604837 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-f350e25f-20bc-4332-8c9d-9aef9700fbaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:15.604837 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:15.604837 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:15.604837 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:15.604837 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:15.604837 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:15.604837 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:15.604837 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:15.604837 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:15.604837 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:15.604837 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:15.604837 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:15.604837 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:15.604837 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:15.604837 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:15.605891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:15.605891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:15.605891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:15.605891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:15.605891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:15.605891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:15.605891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:15.605891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:15.605891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:15.605891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:15.605891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:15.605891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:15.605891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:15.605891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:15.605891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:15.605891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:15.605891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:15.611621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:15.611621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:15.611621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:15.611621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:15.611621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 287/581] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:15.611621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350e25f-20bc-4332-8c9d-9aef9700fbaf None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:15.619134 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c126a30-d09d-4837-855a-d8a1731f059b None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:15.632476 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:15.655419 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e1de3-c761-427e-b6ac-2297b74ad33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:15.656340 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e1de3-c761-427e-b6ac-2297b74ad33e None admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:15.656631 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e1de3-c761-427e-b6ac-2297b74ad33e None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:15.656912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e1de3-c761-427e-b6ac-2297b74ad33e None admin] PATH_INFO: `/v3/projects/07652ced88cf4f069d1765176be5130b/users/a1e4c833a4684561ab52eda5734a7766/roles/92c47f3813b04366b3019ba2a56337eb` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:15.671714 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e1de3-c761-427e-b6ac-2297b74ad33e None admin] RBAC: Authorizing `identity:create_grant(project_id=07652ced88cf4f069d1765176be5130b, user_id=a1e4c833a4684561ab52eda5734a7766, role_id=92c47f3813b04366b3019ba2a56337eb)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:15.673194 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e1de3-c761-427e-b6ac-2297b74ad33e None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:15.706366 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350e25f-20bc-4332-8c9d-9aef9700fbaf None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:15.730095 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:15.734228 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 295/582] 10.222.0.119 () {58 vars in 1444 bytes} [Thu Jul 14 15:36:15 2022] PUT /identity/v3/projects/07652ced88cf4f069d1765176be5130b/users/a1e4c833a4684561ab52eda5734a7766/roles/92c47f3813b04366b3019ba2a56337eb => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:36:15.741396 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ab287-45c1-4007-b1af-6d92ddf08e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:15.742104 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ab287-45c1-4007-b1af-6d92ddf08e90 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:15.742392 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ab287-45c1-4007-b1af-6d92ddf08e90 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:15.742677 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ab287-45c1-4007-b1af-6d92ddf08e90 None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:15.743554 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ab287-45c1-4007-b1af-6d92ddf08e90 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:15.743873 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ab287-45c1-4007-b1af-6d92ddf08e90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:15.745413 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ab287-45c1-4007-b1af-6d92ddf08e90 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:15.749135 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e1de3-c761-427e-b6ac-2297b74ad33e None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:15.769740 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 288/583] 10.222.0.119 () {56 vars in 1142 bytes} [Thu Jul 14 15:36:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:15.770593 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ab287-45c1-4007-b1af-6d92ddf08e90 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:15.875752 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:15.889305 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e1de3-c761-427e-b6ac-2297b74ad33e None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:15.901008 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ab287-45c1-4007-b1af-6d92ddf08e90 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:15.937658 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0db6e3-8be4-4c47-91a9-a175b4ce1b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:15.938341 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0db6e3-8be4-4c47-91a9-a175b4ce1b18 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:15.938628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0db6e3-8be4-4c47-91a9-a175b4ce1b18 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:15.938729 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ddf10-3528-4a02-83d6-9f9f01b31861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:15.938918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0db6e3-8be4-4c47-91a9-a175b4ce1b18 None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:15.939386 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ddf10-3528-4a02-83d6-9f9f01b31861 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:15.939651 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0db6e3-8be4-4c47-91a9-a175b4ce1b18 None admin] RBAC: Adding query filter params (name=service) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:15.939762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ddf10-3528-4a02-83d6-9f9f01b31861 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:15.939943 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ddf10-3528-4a02-83d6-9f9f01b31861 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:15.940038 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0db6e3-8be4-4c47-91a9-a175b4ce1b18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:15.940810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ddf10-3528-4a02-83d6-9f9f01b31861 None admin] RBAC: Adding query filter params (role.id=92c47f3813b04366b3019ba2a56337eb, scope.project.id=07652ced88cf4f069d1765176be5130b, user.id=28a5c169576e432c8174a562ae358e8b) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:15.941129 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ddf10-3528-4a02-83d6-9f9f01b31861 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:15.941357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0db6e3-8be4-4c47-91a9-a175b4ce1b18 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:15.942683 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ddf10-3528-4a02-83d6-9f9f01b31861 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:15.949020 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 289/584] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:36:15 2022] GET /identity/v3/role_assignments?user.id=28a5c169576e432c8174a562ae358e8b&scope.project.id=07652ced88cf4f069d1765176be5130b&role.id=92c47f3813b04366b3019ba2a56337eb => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:15.949820 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ddf10-3528-4a02-83d6-9f9f01b31861 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:15.960964 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 296/585] 10.222.0.119 () {56 vars in 1108 bytes} [Thu Jul 14 15:36:15 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:15.962777 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0db6e3-8be4-4c47-91a9-a175b4ce1b18 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:16.047846 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:16.077964 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ddf10-3528-4a02-83d6-9f9f01b31861 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:16.114062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0db6e3-8be4-4c47-91a9-a175b4ce1b18 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:16.133897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1b0a9-ad9f-4b3d-965b-30d8d5373e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:16.135634 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1b0a9-ad9f-4b3d-965b-30d8d5373e2c None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:16.136075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1b0a9-ad9f-4b3d-965b-30d8d5373e2c None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:16.136530 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1b0a9-ad9f-4b3d-965b-30d8d5373e2c None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:16.137414 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1b0a9-ad9f-4b3d-965b-30d8d5373e2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:16.137881 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1b0a9-ad9f-4b3d-965b-30d8d5373e2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:16.139283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1b0a9-ad9f-4b3d-965b-30d8d5373e2c None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:16.159017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 290/586] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:16.159017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1b0a9-ad9f-4b3d-965b-30d8d5373e2c None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:16.165141 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784cb0ed-985e-4e52-8003-2eb8949c8f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:16.166196 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cb0ed-985e-4e52-8003-2eb8949c8f67 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:16.166682 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cb0ed-985e-4e52-8003-2eb8949c8f67 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:16.167195 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cb0ed-985e-4e52-8003-2eb8949c8f67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:16.170350 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:16.179317 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784cb0ed-985e-4e52-8003-2eb8949c8f67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:16.181427 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784cb0ed-985e-4e52-8003-2eb8949c8f67 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:16.200538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-784cb0ed-985e-4e52-8003-2eb8949c8f67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:16.200538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:16.200538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:16.200538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:16.200538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:16.200538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:16.200538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:16.200538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:16.200538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:16.200538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:16.200538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:16.200538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:16.200538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:16.200538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:16.200538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:16.201647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:16.201647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:16.201647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:16.201647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:16.201647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:16.201647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:16.201647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:16.201647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:16.201647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:16.201647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:16.201647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:16.201647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:16.201647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:16.201647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:16.201647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:16.201647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:16.201647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:16.202750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:16.202750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:16.202750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:16.202750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:16.204853 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 297/587] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:16.205930 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784cb0ed-985e-4e52-8003-2eb8949c8f67 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:16.293405 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1b0a9-ad9f-4b3d-965b-30d8d5373e2c None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:16.316792 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784cb0ed-985e-4e52-8003-2eb8949c8f67 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:16.333334 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:16.339790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42178c0d-16d0-42a7-9768-ea4e1e6b5e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:16.341647 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42178c0d-16d0-42a7-9768-ea4e1e6b5e44 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:16.342397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42178c0d-16d0-42a7-9768-ea4e1e6b5e44 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:16.345615 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42178c0d-16d0-42a7-9768-ea4e1e6b5e44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:16.359223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42178c0d-16d0-42a7-9768-ea4e1e6b5e44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:16.360729 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42178c0d-16d0-42a7-9768-ea4e1e6b5e44 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:16.362328 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c0264-dd2a-44e1-b72d-259962723085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:16.363647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c0264-dd2a-44e1-b72d-259962723085 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:16.364623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c0264-dd2a-44e1-b72d-259962723085 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:16.365112 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c0264-dd2a-44e1-b72d-259962723085 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:16.375636 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c0264-dd2a-44e1-b72d-259962723085 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:16.377403 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c0264-dd2a-44e1-b72d-259962723085 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:16.380564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-42178c0d-16d0-42a7-9768-ea4e1e6b5e44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:16.380564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:16.380564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:16.380564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:16.380564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:16.380564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:16.380564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:16.380564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:16.380564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:16.380564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:16.380564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:16.380564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:16.380564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:16.380564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:16.380564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:16.381762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:16.381762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:16.381762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:16.381762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:16.381762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:16.381762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:16.381762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:16.381762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:16.381762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:16.381762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:16.381762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:16.381762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:16.381762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:16.381762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:16.381762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:16.381762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:16.381762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:16.382644 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:16.382644 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:16.382644 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:16.382644 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:16.386462 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 291/588] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:16.387339 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42178c0d-16d0-42a7-9768-ea4e1e6b5e44 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:16.398062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-fd7c0264-dd2a-44e1-b72d-259962723085 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 15:36:16.398062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:16.398062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:16.398062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:16.398062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:16.398062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:16.398062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:16.398062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:16.398062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:16.398062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:16.398062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:16.398062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:16.398062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:36:16.398062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:36:16.398062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:36:16.398062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:36:16.399005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:16.399005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:16.399005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:16.399005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:16.399005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:16.399005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:16.399005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:16.399005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:16.399005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:16.399005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:16.399005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:16.399005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:16.399005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:16.399005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:16.399005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:16.399005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:16.399005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:16.399005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:16.400052 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:16.400052 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:16.400052 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:36:16.400052 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:36:16.400052 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:36:16.400052 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:36:16.400052 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:36:16.400052 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:36:16.400052 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 15:36:16.400052 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:16.401643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 298/589] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:36:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:16.402188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c0264-dd2a-44e1-b72d-259962723085 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:16.480027 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:16.528175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c0264-dd2a-44e1-b72d-259962723085 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:16.535824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42178c0d-16d0-42a7-9768-ea4e1e6b5e44 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:16.562969 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffa107-4bc8-49b9-8cc1-26b8de12f16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:16.563671 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffa107-4bc8-49b9-8cc1-26b8de12f16b None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:16.563965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffa107-4bc8-49b9-8cc1-26b8de12f16b None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:16.564277 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffa107-4bc8-49b9-8cc1-26b8de12f16b None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:16.565000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faffa107-4bc8-49b9-8cc1-26b8de12f16b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:16.565305 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faffa107-4bc8-49b9-8cc1-26b8de12f16b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:16.566668 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faffa107-4bc8-49b9-8cc1-26b8de12f16b None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:16.573245 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1274fe-3074-48c9-8aef-2612b66409c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:16.573853 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1274fe-3074-48c9-8aef-2612b66409c5 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:16.574255 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1274fe-3074-48c9-8aef-2612b66409c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:16.574546 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1274fe-3074-48c9-8aef-2612b66409c5 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:16.575276 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1274fe-3074-48c9-8aef-2612b66409c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:16.575590 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1274fe-3074-48c9-8aef-2612b66409c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:16.577126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1274fe-3074-48c9-8aef-2612b66409c5 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:16.583785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 299/590] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:16.585394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffa107-4bc8-49b9-8cc1-26b8de12f16b None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:16.590765 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 292/591] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:16.591764 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1274fe-3074-48c9-8aef-2612b66409c5 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:16.624442 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:16.693808 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffa107-4bc8-49b9-8cc1-26b8de12f16b None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:16.702059 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1274fe-3074-48c9-8aef-2612b66409c5 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:16.723233 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:16.731401 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f564ea4-2d0d-482f-8913-79a0202e1f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:16.732147 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f564ea4-2d0d-482f-8913-79a0202e1f47 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:16.734635 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f564ea4-2d0d-482f-8913-79a0202e1f47 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:16.734635 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f564ea4-2d0d-482f-8913-79a0202e1f47 None admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:16.734635 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f564ea4-2d0d-482f-8913-79a0202e1f47 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:16.734635 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f564ea4-2d0d-482f-8913-79a0202e1f47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:16.735454 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f564ea4-2d0d-482f-8913-79a0202e1f47 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:16.743030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c05569-1cce-467c-a4de-5782c20a5d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:16.743840 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c05569-1cce-467c-a4de-5782c20a5d7e None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:16.744153 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c05569-1cce-467c-a4de-5782c20a5d7e None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:16.744473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c05569-1cce-467c-a4de-5782c20a5d7e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:16.753257 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c05569-1cce-467c-a4de-5782c20a5d7e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:16.754571 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 300/592] 10.222.0.119 () {56 vars in 1142 bytes} [Thu Jul 14 15:36:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:16.754796 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c05569-1cce-467c-a4de-5782c20a5d7e None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:16.755396 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f564ea4-2d0d-482f-8913-79a0202e1f47 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:16.772334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-c8c05569-1cce-467c-a4de-5782c20a5d7e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 15:36:16.772334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:16.772334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:16.772334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:16.772334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:16.772334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:16.772334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:16.772334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:16.772334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:16.772334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:16.772334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:16.772334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:16.772334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:36:16.772334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:36:16.772334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:36:16.772334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:36:16.773522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:16.773522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:16.773522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:16.773522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:16.773522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:16.773522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:16.773522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:16.773522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:16.773522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:16.773522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:16.773522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:16.773522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:16.773522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:16.773522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:16.773522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:16.773522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:16.773522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:16.773522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:16.774629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:16.774629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:16.774629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:36:16.774629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:36:16.774629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:36:16.774629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:36:16.774629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:36:16.774629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:36:16.774629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 15:36:16.774629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:16.774629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 293/593] 10.222.0.119 () {56 vars in 1107 bytes} [Thu Jul 14 15:36:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:16.775219 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c05569-1cce-467c-a4de-5782c20a5d7e None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:16.856092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:16.864783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f564ea4-2d0d-482f-8913-79a0202e1f47 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:16.885960 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c05569-1cce-467c-a4de-5782c20a5d7e None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:16.901140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a722c-825e-4b37-a18c-8c4b79fb9164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:16.901970 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a722c-825e-4b37-a18c-8c4b79fb9164 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:16.902254 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a722c-825e-4b37-a18c-8c4b79fb9164 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:16.902528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a722c-825e-4b37-a18c-8c4b79fb9164 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:16.910394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a722c-825e-4b37-a18c-8c4b79fb9164 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:16.911877 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a722c-825e-4b37-a18c-8c4b79fb9164 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:16.927452 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-4e9a722c-825e-4b37-a18c-8c4b79fb9164 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:16.927452 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:16.927452 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:16.927452 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:16.927452 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:16.927452 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:16.927452 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:16.927452 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:16.927452 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:16.927452 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:16.927452 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:16.927452 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:16.927452 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:36:16.927452 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:36:16.927452 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:36:16.928576 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:36:16.928576 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:16.928576 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:16.928576 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:16.928576 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:16.928576 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:16.928576 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:16.928576 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:16.928576 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:16.928576 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:16.928576 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:16.928576 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:16.928576 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:16.928576 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:16.928576 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:16.928576 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:16.928576 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:16.929471 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:36:16.929471 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:36:16.929471 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:36:16.929471 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:36:16.929471 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:36:16.929471 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:36:16.929471 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:16.929471 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:16.930524 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29332968-bfcf-4664-82b2-20d6bfc85a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:16.931529 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29332968-bfcf-4664-82b2-20d6bfc85a65 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:16.932007 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29332968-bfcf-4664-82b2-20d6bfc85a65 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:16.932496 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29332968-bfcf-4664-82b2-20d6bfc85a65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:16.934056 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 301/594] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:16.935019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a722c-825e-4b37-a18c-8c4b79fb9164 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:16.944610 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29332968-bfcf-4664-82b2-20d6bfc85a65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:16.946398 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29332968-bfcf-4664-82b2-20d6bfc85a65 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:16.966838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-29332968-bfcf-4664-82b2-20d6bfc85a65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:16.966838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:16.966838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:16.966838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:16.966838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:16.966838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:16.966838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:16.966838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:16.966838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:16.966838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:16.966838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:16.966838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:16.966838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:16.966838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:16.966838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:16.967754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:16.967754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:16.967754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:16.967754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:16.967754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:16.967754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:16.967754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:16.967754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:16.967754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:16.967754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:16.967754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:16.967754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:16.967754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:16.967754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:16.967754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:16.967754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:16.967754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:16.968954 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:16.968954 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:16.968954 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:16.968954 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:16.970921 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 294/595] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:16.971997 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29332968-bfcf-4664-82b2-20d6bfc85a65 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:17.032408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:17.041626 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a722c-825e-4b37-a18c-8c4b79fb9164 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:17.083371 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed1024-b049-49bc-b744-f2f968093c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:17.084358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed1024-b049-49bc-b744-f2f968093c47 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:17.084644 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed1024-b049-49bc-b744-f2f968093c47 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:17.084919 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed1024-b049-49bc-b744-f2f968093c47 None admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:17.085755 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed1024-b049-49bc-b744-f2f968093c47 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:17.086062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed1024-b049-49bc-b744-f2f968093c47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:17.087618 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed1024-b049-49bc-b744-f2f968093c47 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:17.101284 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29332968-bfcf-4664-82b2-20d6bfc85a65 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:17.107215 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 302/596] 10.222.0.119 () {56 vars in 1144 bytes} [Thu Jul 14 15:36:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:17.107972 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed1024-b049-49bc-b744-f2f968093c47 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:17.128208 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:17.140609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9ab4b-747c-45d1-b8d0-3405be9290ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:17.141417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9ab4b-747c-45d1-b8d0-3405be9290ca None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:17.141830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9ab4b-747c-45d1-b8d0-3405be9290ca None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:17.142208 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9ab4b-747c-45d1-b8d0-3405be9290ca None admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:17.143107 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9ab4b-747c-45d1-b8d0-3405be9290ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:17.143524 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9ab4b-747c-45d1-b8d0-3405be9290ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:17.145087 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9ab4b-747c-45d1-b8d0-3405be9290ca None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:17.157487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 295/597] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:36:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:17.158503 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9ab4b-747c-45d1-b8d0-3405be9290ca None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:17.234784 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed1024-b049-49bc-b744-f2f968093c47 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:17.253685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:17.264485 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9ab4b-747c-45d1-b8d0-3405be9290ca None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:17.273805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed098c26-b622-4236-a408-014cbefa64f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:17.274591 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed098c26-b622-4236-a408-014cbefa64f5 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:17.274881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed098c26-b622-4236-a408-014cbefa64f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:17.275156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed098c26-b622-4236-a408-014cbefa64f5 None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:17.275874 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed098c26-b622-4236-a408-014cbefa64f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:17.276239 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed098c26-b622-4236-a408-014cbefa64f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:17.277608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed098c26-b622-4236-a408-014cbefa64f5 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:17.291521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 303/598] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:17.292534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed098c26-b622-4236-a408-014cbefa64f5 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:17.300379 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcb9aa-9f2b-47d9-b3c7-203220d4a639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:17.301183 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcb9aa-9f2b-47d9-b3c7-203220d4a639 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:17.301470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcb9aa-9f2b-47d9-b3c7-203220d4a639 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:17.301748 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcb9aa-9f2b-47d9-b3c7-203220d4a639 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:17.313315 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bcb9aa-9f2b-47d9-b3c7-203220d4a639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:17.314790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bcb9aa-9f2b-47d9-b3c7-203220d4a639 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:17.332892 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-a8bcb9aa-9f2b-47d9-b3c7-203220d4a639 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:17.332892 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:17.332892 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:17.332892 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:17.332892 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:17.332892 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:17.332892 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:17.332892 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:17.332892 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:17.332892 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:17.332892 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:17.332892 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:17.332892 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:17.332892 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:17.332892 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:17.335096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:17.335096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:17.335096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:17.335096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:17.335096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:17.335096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:17.335096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:17.335096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:17.335096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:17.335096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:17.335096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:17.335096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:17.335096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:17.335096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:17.335096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:17.335096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:17.335096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:17.337238 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:17.337238 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:17.337238 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:17.337238 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:17.337238 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 296/599] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:17.337238 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcb9aa-9f2b-47d9-b3c7-203220d4a639 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:17.374513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:17.408462 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed098c26-b622-4236-a408-014cbefa64f5 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:17.440413 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcb9aa-9f2b-47d9-b3c7-203220d4a639 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:17.447191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa93fb-b9dd-41e3-8856-54f05bec9e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:17.448507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa93fb-b9dd-41e3-8856-54f05bec9e5f None admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:17.448938 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa93fb-b9dd-41e3-8856-54f05bec9e5f None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:17.449357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa93fb-b9dd-41e3-8856-54f05bec9e5f None admin] PATH_INFO: `/v3/projects/07652ced88cf4f069d1765176be5130b/users/40b236c66c184d3ca40c2069dc316664/roles/92c47f3813b04366b3019ba2a56337eb` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:17.468040 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa93fb-b9dd-41e3-8856-54f05bec9e5f None admin] RBAC: Authorizing `identity:create_grant(project_id=07652ced88cf4f069d1765176be5130b, user_id=40b236c66c184d3ca40c2069dc316664, role_id=92c47f3813b04366b3019ba2a56337eb)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:17.471761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa93fb-b9dd-41e3-8856-54f05bec9e5f None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:17.479140 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e10bd4-8eee-4bab-ba46-c4595824764b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:17.484182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e10bd4-8eee-4bab-ba46-c4595824764b None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:17.484182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e10bd4-8eee-4bab-ba46-c4595824764b None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:17.484182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e10bd4-8eee-4bab-ba46-c4595824764b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:17.490758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e10bd4-8eee-4bab-ba46-c4595824764b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:17.492258 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e10bd4-8eee-4bab-ba46-c4595824764b None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:17.511182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-c4e10bd4-8eee-4bab-ba46-c4595824764b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:17.511182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:17.511182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:17.511182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:17.511182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:17.511182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:17.511182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:17.511182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:17.511182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:17.511182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:17.511182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:17.511182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:17.511182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:36:17.511182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:36:17.511182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:36:17.517470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:36:17.517470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:17.517470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:17.517470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:17.517470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:17.517470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:17.517470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:17.517470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:17.517470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:17.517470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:17.517470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:17.517470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:17.517470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:17.517470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:17.517470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:17.517470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:17.517470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:17.522432 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:36:17.522432 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:36:17.522432 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:36:17.522432 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:36:17.522432 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:36:17.522432 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:36:17.522432 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:17.522432 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:17.522432 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 297/600] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:17.522432 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e10bd4-8eee-4bab-ba46-c4595824764b None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:17.522432 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:17.568341 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 304/601] 10.222.0.119 () {58 vars in 1444 bytes} [Thu Jul 14 15:36:17 2022] PUT /identity/v3/projects/07652ced88cf4f069d1765176be5130b/users/40b236c66c184d3ca40c2069dc316664/roles/92c47f3813b04366b3019ba2a56337eb => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:36:17.569469 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa93fb-b9dd-41e3-8856-54f05bec9e5f None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:17.647282 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e10bd4-8eee-4bab-ba46-c4595824764b None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:17.693259 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6be22-6929-4a9f-906a-4c676e101242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:17.694402 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6be22-6929-4a9f-906a-4c676e101242 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:17.694912 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6be22-6929-4a9f-906a-4c676e101242 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:17.695396 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6be22-6929-4a9f-906a-4c676e101242 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:17.696381 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6be22-6929-4a9f-906a-4c676e101242 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:17.696963 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6be22-6929-4a9f-906a-4c676e101242 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:17.698670 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6be22-6929-4a9f-906a-4c676e101242 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:17.714222 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 298/602] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:17.721493 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6be22-6929-4a9f-906a-4c676e101242 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:17.768684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa93fb-b9dd-41e3-8856-54f05bec9e5f None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:17.806428 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:17.830199 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1378e-3096-4687-83fc-edb9dd42f1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:17.830892 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1378e-3096-4687-83fc-edb9dd42f1e9 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:17.831223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1378e-3096-4687-83fc-edb9dd42f1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:17.831502 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1378e-3096-4687-83fc-edb9dd42f1e9 None admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:17.832344 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1378e-3096-4687-83fc-edb9dd42f1e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:17.832687 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1378e-3096-4687-83fc-edb9dd42f1e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:17.834870 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1378e-3096-4687-83fc-edb9dd42f1e9 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:17.851373 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:17.854377 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 305/603] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:36:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:17.859808 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1378e-3096-4687-83fc-edb9dd42f1e9 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:17.900410 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6be22-6929-4a9f-906a-4c676e101242 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:17.944869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b212a0a-25ae-4685-aeb0-4d730cb6fba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:17.946070 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b212a0a-25ae-4685-aeb0-4d730cb6fba1 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:17.946554 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b212a0a-25ae-4685-aeb0-4d730cb6fba1 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:17.947041 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b212a0a-25ae-4685-aeb0-4d730cb6fba1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:17.956557 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b212a0a-25ae-4685-aeb0-4d730cb6fba1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:17.958739 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b212a0a-25ae-4685-aeb0-4d730cb6fba1 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:17.973215 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1378e-3096-4687-83fc-edb9dd42f1e9 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:17.979132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-1b212a0a-25ae-4685-aeb0-4d730cb6fba1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:17.979132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:17.979132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:17.979132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:17.979132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:17.979132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:17.979132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:17.979132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:17.979132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:17.979132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:17.979132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:17.979132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:17.979132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:36:17.979132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:36:17.979132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:36:17.980017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:36:17.980017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:17.980017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:17.980017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:17.980017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:17.980017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:17.980017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:17.980017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:17.980017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:17.980017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:17.980017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:17.980017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:17.980017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:17.980017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:17.980017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:17.980017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:17.980017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:17.980940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:36:17.980940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:36:17.980940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:36:17.980940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:36:17.980940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:36:17.980940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:36:17.980940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:17.980940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:17.985188 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 299/604] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:17.992773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b212a0a-25ae-4685-aeb0-4d730cb6fba1 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:18.033178 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c4e61-22b1-41ef-b586-7469d3a2b434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:18.034627 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c4e61-22b1-41ef-b586-7469d3a2b434 None admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:18.035394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c4e61-22b1-41ef-b586-7469d3a2b434 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:18.036147 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c4e61-22b1-41ef-b586-7469d3a2b434 None admin] PATH_INFO: `/v3/projects/07652ced88cf4f069d1765176be5130b/users/d96e2cb043e64d04b3f7628a3419a064/roles/92c47f3813b04366b3019ba2a56337eb` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:18.057916 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c4e61-22b1-41ef-b586-7469d3a2b434 None admin] RBAC: Authorizing `identity:create_grant(project_id=07652ced88cf4f069d1765176be5130b, user_id=d96e2cb043e64d04b3f7628a3419a064, role_id=92c47f3813b04366b3019ba2a56337eb)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:18.059120 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c4e61-22b1-41ef-b586-7469d3a2b434 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:18.140681 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b212a0a-25ae-4685-aeb0-4d730cb6fba1 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:18.153850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 306/605] 10.222.0.119 () {58 vars in 1444 bytes} [Thu Jul 14 15:36:17 2022] PUT /identity/v3/projects/07652ced88cf4f069d1765176be5130b/users/d96e2cb043e64d04b3f7628a3419a064/roles/92c47f3813b04366b3019ba2a56337eb => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:36:18.155296 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805d874-7827-4d77-8011-39f0028839e0 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:18.155642 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805d874-7827-4d77-8011-39f0028839e0 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:18.155931 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805d874-7827-4d77-8011-39f0028839e0 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:18.164653 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 307/606] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:18.169095 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99845dc-3bfc-4ac2-9f0f-f0f0356d9a21 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:18.169095 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99845dc-3bfc-4ac2-9f0f-f0f0356d9a21 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:18.169095 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99845dc-3bfc-4ac2-9f0f-f0f0356d9a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:18.183942 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:18.199714 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44322b20-a74d-41ee-89e0-c5bc58f5b763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:18.200271 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-f99845dc-3bfc-4ac2-9f0f-f0f0356d9a21 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:18.200544 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44322b20-a74d-41ee-89e0-c5bc58f5b763 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:18.200897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44322b20-a74d-41ee-89e0-c5bc58f5b763 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:18.201174 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44322b20-a74d-41ee-89e0-c5bc58f5b763 None admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:18.201526 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-f99845dc-3bfc-4ac2-9f0f-f0f0356d9a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:18.202038 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44322b20-a74d-41ee-89e0-c5bc58f5b763 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:18.202358 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44322b20-a74d-41ee-89e0-c5bc58f5b763 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:18.204226 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44322b20-a74d-41ee-89e0-c5bc58f5b763 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:18.226507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 300/607] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:36:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:18.228152 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc9487-7fa7-43e5-a9e8-5a023d030b00 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:18.228460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc9487-7fa7-43e5-a9e8-5a023d030b00 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:18.229411 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc9487-7fa7-43e5-a9e8-5a023d030b00 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:18.231566 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 301/608] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:18 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:18.236144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc9487-7fa7-43e5-a9e8-5a023d030b00 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:18.238563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:18.305324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 308/609] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:36:18.307147 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b6a47-5941-4e17-a0df-f2e8ac3f129b None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:18.307624 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b6a47-5941-4e17-a0df-f2e8ac3f129b None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:18.308243 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b6a47-5941-4e17-a0df-f2e8ac3f129b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:18.326276 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-6f2b6a47-5941-4e17-a0df-f2e8ac3f129b None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:18.327721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-6f2b6a47-5941-4e17-a0df-f2e8ac3f129b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:18.387618 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc9487-7fa7-43e5-a9e8-5a023d030b00 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:18.405582 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 309/610] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:36:18.406774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b6a47-5941-4e17-a0df-f2e8ac3f129b None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:18.446528 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee4e88-7e33-4ec9-ae5f-fc96b9be6d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:18.447927 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee4e88-7e33-4ec9-ae5f-fc96b9be6d94 None admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:18.448262 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee4e88-7e33-4ec9-ae5f-fc96b9be6d94 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:18.448597 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee4e88-7e33-4ec9-ae5f-fc96b9be6d94 None admin] PATH_INFO: `/v3/projects/07652ced88cf4f069d1765176be5130b/users/70559c2ce32043dd9a902837ab444622/roles/92c47f3813b04366b3019ba2a56337eb` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:18.472348 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee4e88-7e33-4ec9-ae5f-fc96b9be6d94 None admin] RBAC: Authorizing `identity:create_grant(project_id=07652ced88cf4f069d1765176be5130b, user_id=70559c2ce32043dd9a902837ab444622, role_id=92c47f3813b04366b3019ba2a56337eb)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:18.473824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee4e88-7e33-4ec9-ae5f-fc96b9be6d94 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:18.527415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:18.537184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b6a47-5941-4e17-a0df-f2e8ac3f129b None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:18.557370 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 302/611] 10.222.0.119 () {58 vars in 1444 bytes} [Thu Jul 14 15:36:18 2022] PUT /identity/v3/projects/07652ced88cf4f069d1765176be5130b/users/70559c2ce32043dd9a902837ab444622/roles/92c47f3813b04366b3019ba2a56337eb => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:36:18.564325 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee4e88-7e33-4ec9-ae5f-fc96b9be6d94 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:18.614072 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84efb4-f62a-4ce3-b378-23533584a882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:18.614897 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84efb4-f62a-4ce3-b378-23533584a882 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:18.615184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84efb4-f62a-4ce3-b378-23533584a882 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:18.615676 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84efb4-f62a-4ce3-b378-23533584a882 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:18.625047 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:18.644079 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84efb4-f62a-4ce3-b378-23533584a882 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:36:18.653404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-7e84efb4-f62a-4ce3-b378-23533584a882 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:18.653404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:18.653404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:18.653404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:18.653404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:18.653404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:18.653404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:18.653404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:18.653404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:18.653404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:18.653404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:18.653404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:18.653404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:36:18.653404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:36:18.653404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:36:18.653404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:36:18.654394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:36:18.654394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:36:18.654394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:36:18.654394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:36:18.654394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:18.654394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:18.654394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:18.654394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:18.654394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:18.654394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:18.654394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:18.654394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:18.654394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:18.654394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:18.654394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:18.654394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:18.655233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:18.655233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:18.655233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:18.655233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:18.655233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:36:18.655233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:36:18.655233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:36:18.655233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:36:18.655233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:36:18.655233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:36:18.655233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:18.655233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:18.660003 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 310/612] 10.222.0.119 () {56 vars in 1107 bytes} [Thu Jul 14 15:36:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:18.665303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84efb4-f62a-4ce3-b378-23533584a882 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:18.766286 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee4e88-7e33-4ec9-ae5f-fc96b9be6d94 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:18.814271 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a291f4-5949-4a89-adb2-fe2d2d3cc607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:18.815455 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a291f4-5949-4a89-adb2-fe2d2d3cc607 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:18.815944 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a291f4-5949-4a89-adb2-fe2d2d3cc607 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:18.816444 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a291f4-5949-4a89-adb2-fe2d2d3cc607 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:18.831610 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a291f4-5949-4a89-adb2-fe2d2d3cc607 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:36:18.831962 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84efb4-f62a-4ce3-b378-23533584a882 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:18.842856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-c2a291f4-5949-4a89-adb2-fe2d2d3cc607 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:18.842856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:18.842856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:18.842856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:18.842856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:18.842856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:18.842856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:18.842856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:18.842856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:18.842856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:18.842856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:18.842856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:18.842856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:36:18.842856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:36:18.842856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:36:18.842856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:36:18.843807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:36:18.843807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:36:18.843807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:36:18.843807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:36:18.843807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:18.843807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:18.843807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:18.843807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:18.843807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:18.843807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:18.843807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:18.843807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:18.843807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:18.843807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:18.843807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:18.843807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:18.844680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:18.844680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:18.844680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:18.844680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:18.844680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:36:18.844680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:36:18.844680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:36:18.844680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:36:18.844680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:36:18.844680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:36:18.844680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:18.844680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:18.846057 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 303/613] 10.222.0.119 () {56 vars in 1107 bytes} [Thu Jul 14 15:36:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:18.853109 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a291f4-5949-4a89-adb2-fe2d2d3cc607 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:18.884902 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1717ca1-ff50-4658-9b71-a31421fed6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:18.885853 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1717ca1-ff50-4658-9b71-a31421fed6ee None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:18.886144 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1717ca1-ff50-4658-9b71-a31421fed6ee None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:18.886420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1717ca1-ff50-4658-9b71-a31421fed6ee None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:18.887239 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1717ca1-ff50-4658-9b71-a31421fed6ee None admin] RBAC: Adding query filter params (name=service) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:18.887548 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1717ca1-ff50-4658-9b71-a31421fed6ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:18.889912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1717ca1-ff50-4658-9b71-a31421fed6ee None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:18.902386 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 311/614] 10.222.0.119 () {56 vars in 1108 bytes} [Thu Jul 14 15:36:18 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:18.913681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1717ca1-ff50-4658-9b71-a31421fed6ee None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:18.950308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:18.972210 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:18.983452 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a291f4-5949-4a89-adb2-fe2d2d3cc607 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:19.025440 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573d1f8-fa42-43b4-8233-973f5f99c06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:19.026509 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573d1f8-fa42-43b4-8233-973f5f99c06e None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:19.027002 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573d1f8-fa42-43b4-8233-973f5f99c06e None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:19.027482 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573d1f8-fa42-43b4-8233-973f5f99c06e None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:19.028479 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573d1f8-fa42-43b4-8233-973f5f99c06e None admin] RBAC: Adding query filter params (name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:19.028995 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573d1f8-fa42-43b4-8233-973f5f99c06e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:19.030689 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573d1f8-fa42-43b4-8233-973f5f99c06e None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:19.044691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 304/615] 10.222.0.119 () {56 vars in 1108 bytes} [Thu Jul 14 15:36:18 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:19.053677 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573d1f8-fa42-43b4-8233-973f5f99c06e None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:19.089877 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1717ca1-ff50-4658-9b71-a31421fed6ee None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:19.139117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb633b9-f251-4870-9daf-b3a737bdb21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:19.139920 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb633b9-f251-4870-9daf-b3a737bdb21a None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:19.140225 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb633b9-f251-4870-9daf-b3a737bdb21a None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:19.140515 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb633b9-f251-4870-9daf-b3a737bdb21a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:19.160265 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb633b9-f251-4870-9daf-b3a737bdb21a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:19.161739 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb633b9-f251-4870-9daf-b3a737bdb21a None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:19.191436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-8eb633b9-f251-4870-9daf-b3a737bdb21a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:19.191436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:19.191436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:19.191436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:19.191436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:19.191436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:19.191436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:19.191436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:19.191436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:19.191436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:19.191436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:19.191436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:19.191436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:19.191436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:19.191436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:19.192374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:19.192374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:19.192374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:19.192374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:19.192374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:19.192374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:19.192374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:19.192374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:19.192374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:19.192374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:19.192374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:19.192374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:19.192374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:19.192374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:19.192374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:19.192374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:19.192374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:19.193257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:19.193257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:19.193257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:19.193257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:19.194635 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 312/616] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:19.203907 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb633b9-f251-4870-9daf-b3a737bdb21a None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:19.242680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573d1f8-fa42-43b4-8233-973f5f99c06e None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:19.285158 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee460b-8bf5-485a-8d74-9f3c62a94b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:19.292282 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee460b-8bf5-485a-8d74-9f3c62a94b0a None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:19.292620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee460b-8bf5-485a-8d74-9f3c62a94b0a None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:19.292909 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee460b-8bf5-485a-8d74-9f3c62a94b0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:19.312570 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee460b-8bf5-485a-8d74-9f3c62a94b0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:19.314527 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee460b-8bf5-485a-8d74-9f3c62a94b0a None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:19.316954 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:19.342450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-feee460b-8bf5-485a-8d74-9f3c62a94b0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:19.342450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:19.342450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:19.342450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:19.342450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:19.342450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:19.342450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:19.342450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:19.342450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:19.342450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:19.342450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:19.342450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:19.342450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:19.342450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:19.342450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:19.343435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:19.343435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:19.343435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:19.343435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:19.343435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:19.343435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:19.343435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:19.343435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:19.343435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:19.343435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:19.343435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:19.343435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:19.343435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:19.343435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:19.343435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:19.343435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:19.343435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:19.344378 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:19.344378 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:19.344378 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:19.344378 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:19.346407 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 305/617] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:19.353696 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee460b-8bf5-485a-8d74-9f3c62a94b0a None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:19.368146 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb633b9-f251-4870-9daf-b3a737bdb21a None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:19.368847 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:19.404982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9c661-7296-4d67-beee-f04ddeb00af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:19.405657 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9c661-7296-4d67-beee-f04ddeb00af9 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:19.405941 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9c661-7296-4d67-beee-f04ddeb00af9 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:19.406495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9c661-7296-4d67-beee-f04ddeb00af9 None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:19.406951 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9c661-7296-4d67-beee-f04ddeb00af9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:19.410744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9c661-7296-4d67-beee-f04ddeb00af9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:19.410744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9c661-7296-4d67-beee-f04ddeb00af9 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:19.424400 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 313/618] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:19.433184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9c661-7296-4d67-beee-f04ddeb00af9 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:19.517024 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee460b-8bf5-485a-8d74-9f3c62a94b0a None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:19.556409 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182bb568-2bde-4f0e-8d6b-6ca172eb3c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:19.557508 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bb568-2bde-4f0e-8d6b-6ca172eb3c23 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:19.557950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bb568-2bde-4f0e-8d6b-6ca172eb3c23 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:19.558395 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bb568-2bde-4f0e-8d6b-6ca172eb3c23 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:19.559276 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182bb568-2bde-4f0e-8d6b-6ca172eb3c23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:19.559745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182bb568-2bde-4f0e-8d6b-6ca172eb3c23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:19.561326 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182bb568-2bde-4f0e-8d6b-6ca172eb3c23 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:19.574418 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 306/619] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:19.579972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182bb568-2bde-4f0e-8d6b-6ca172eb3c23 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:19.662317 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:19.685483 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9c661-7296-4d67-beee-f04ddeb00af9 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:19.693008 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182bb568-2bde-4f0e-8d6b-6ca172eb3c23 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:19.731249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8f546-6aea-46da-a0c1-f2cf107a9123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:19.732449 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8f546-6aea-46da-a0c1-f2cf107a9123 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:19.733413 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8f546-6aea-46da-a0c1-f2cf107a9123 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:19.733887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8f546-6aea-46da-a0c1-f2cf107a9123 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:19.742951 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb8f546-6aea-46da-a0c1-f2cf107a9123 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:19.744678 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb8f546-6aea-46da-a0c1-f2cf107a9123 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:19.762097 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-ffb8f546-6aea-46da-a0c1-f2cf107a9123 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:36:19.762097 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:19.762097 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:19.762097 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:19.762097 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:19.762097 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:19.762097 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:19.762097 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:19.762097 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:19.762097 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:19.762097 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:19.762097 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:19.762097 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:36:19.762097 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:36:19.762097 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:36:19.762097 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:36:19.763044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:19.763044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:19.763044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:19.763044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:19.763044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:19.763044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:19.763044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:19.763044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:19.763044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:19.763044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:19.763044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:19.763044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:19.763044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:19.763044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:19.763044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:19.763044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:19.763044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:19.763044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:19.764081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:19.764081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:19.764081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:36:19.764081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:36:19.764081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:36:19.764081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:36:19.764081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:36:19.764081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:36:19.764081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:36:19.764081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:19.767081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 307/620] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:36:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:36:19.771249 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:19.773683 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8f546-6aea-46da-a0c1-f2cf107a9123 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:19.795422 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9233e-c2d3-4dfd-ae7e-a698169c04dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:19.796641 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9233e-c2d3-4dfd-ae7e-a698169c04dd None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:19.797175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9233e-c2d3-4dfd-ae7e-a698169c04dd None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:19.797724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9233e-c2d3-4dfd-ae7e-a698169c04dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:19.813395 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9233e-c2d3-4dfd-ae7e-a698169c04dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:19.814863 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9233e-c2d3-4dfd-ae7e-a698169c04dd None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:19.837467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-e1b9233e-c2d3-4dfd-ae7e-a698169c04dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:36:19.837467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:19.837467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:19.837467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:19.837467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:19.837467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:19.837467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:19.837467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:19.837467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:19.837467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:19.837467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:19.837467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:19.837467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:36:19.837467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:36:19.837467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:36:19.837467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:36:19.838454 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:19.838454 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:19.838454 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:19.838454 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:19.838454 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:19.838454 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:19.838454 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:19.838454 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:19.838454 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:19.838454 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:19.838454 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:19.838454 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:19.838454 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:19.838454 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:19.838454 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:19.838454 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:19.838454 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:19.838454 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:19.839385 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:19.839385 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:19.839385 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:36:19.839385 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:36:19.839385 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:36:19.839385 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:36:19.839385 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:36:19.839385 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:36:19.839385 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:36:19.839385 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:19.848779 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 314/621] 10.222.0.119 () {56 vars in 1098 bytes} [Thu Jul 14 15:36:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:19.851185 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9233e-c2d3-4dfd-ae7e-a698169c04dd None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:19.938294 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8f546-6aea-46da-a0c1-f2cf107a9123 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:19.995780 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:20.013462 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533441d-39cb-4929-9e0f-b268fa8b7d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:20.014300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533441d-39cb-4929-9e0f-b268fa8b7d0b None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:20.014806 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533441d-39cb-4929-9e0f-b268fa8b7d0b None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:20.015299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533441d-39cb-4929-9e0f-b268fa8b7d0b None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:20.016394 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533441d-39cb-4929-9e0f-b268fa8b7d0b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:20.016945 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533441d-39cb-4929-9e0f-b268fa8b7d0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:20.018627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533441d-39cb-4929-9e0f-b268fa8b7d0b None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:20.042238 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9233e-c2d3-4dfd-ae7e-a698169c04dd None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:20.043359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 308/622] 10.222.0.119 () {56 vars in 1140 bytes} [Thu Jul 14 15:36:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:20.045099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895936a6-c9e1-4869-af5d-255fe18983d5 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:20.045626 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895936a6-c9e1-4869-af5d-255fe18983d5 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:20.046121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895936a6-c9e1-4869-af5d-255fe18983d5 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:20.047952 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 309/623] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:20.048908 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895936a6-c9e1-4869-af5d-255fe18983d5 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:20.089704 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14e4dc-7b0c-49fa-bcc8-c69dabfce28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:20.090378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14e4dc-7b0c-49fa-bcc8-c69dabfce28a None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:20.090662 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14e4dc-7b0c-49fa-bcc8-c69dabfce28a None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:20.090940 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14e4dc-7b0c-49fa-bcc8-c69dabfce28a None admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:20.092038 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14e4dc-7b0c-49fa-bcc8-c69dabfce28a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:20.092445 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14e4dc-7b0c-49fa-bcc8-c69dabfce28a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:20.094715 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14e4dc-7b0c-49fa-bcc8-c69dabfce28a None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:20.119563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 315/624] 10.222.0.119 () {56 vars in 1138 bytes} [Thu Jul 14 15:36:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:20.119563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5c8ba-6b12-4036-8a44-db57fb15dbad None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:20.119563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5c8ba-6b12-4036-8a44-db57fb15dbad None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:20.119563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5c8ba-6b12-4036-8a44-db57fb15dbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:20.134205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-14b5c8ba-6b12-4036-8a44-db57fb15dbad None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:20.135539 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-14b5c8ba-6b12-4036-8a44-db57fb15dbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:20.174874 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:20.183070 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895936a6-c9e1-4869-af5d-255fe18983d5 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:20.211931 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 316/625] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:36:20.212918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5c8ba-6b12-4036-8a44-db57fb15dbad None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:20.228727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bcb0f0-0008-455e-be15-4cf92c784036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:20.229538 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcb0f0-0008-455e-be15-4cf92c784036 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:20.229829 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcb0f0-0008-455e-be15-4cf92c784036 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:20.230139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcb0f0-0008-455e-be15-4cf92c784036 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:20.242712 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bcb0f0-0008-455e-be15-4cf92c784036 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:20.244748 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bcb0f0-0008-455e-be15-4cf92c784036 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:20.265833 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-08bcb0f0-0008-455e-be15-4cf92c784036 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:20.265833 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:20.265833 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:20.265833 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:20.265833 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:20.265833 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:20.265833 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:20.265833 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:20.265833 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:20.265833 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:20.265833 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:20.265833 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:20.265833 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:20.265833 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:20.265833 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:20.266791 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:20.266791 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:20.266791 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:20.266791 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:20.266791 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:20.266791 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:20.266791 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:20.266791 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:20.266791 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:20.266791 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:20.266791 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:20.266791 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:20.266791 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:20.266791 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:20.266791 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:20.266791 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:20.266791 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:20.267741 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:20.267741 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:20.267741 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:20.267741 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:20.271839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 310/626] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:20.272838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bcb0f0-0008-455e-be15-4cf92c784036 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:20.310682 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:20.350523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5c8ba-6b12-4036-8a44-db57fb15dbad None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:20.388302 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767a644-cf17-4a49-ac98-4c2169e3e27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:20.388791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767a644-cf17-4a49-ac98-4c2169e3e27b None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:20.389076 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767a644-cf17-4a49-ac98-4c2169e3e27b None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:20.389437 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767a644-cf17-4a49-ac98-4c2169e3e27b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:20.393659 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bcb0f0-0008-455e-be15-4cf92c784036 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:20.437689 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:20.438151 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1b8a2-7a02-4c30-ba14-3ac0d30359e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:20.439257 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1b8a2-7a02-4c30-ba14-3ac0d30359e9 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:20.439257 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1b8a2-7a02-4c30-ba14-3ac0d30359e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:20.439515 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1b8a2-7a02-4c30-ba14-3ac0d30359e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:20.450460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd1b8a2-7a02-4c30-ba14-3ac0d30359e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:36:20.458362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-5bd1b8a2-7a02-4c30-ba14-3ac0d30359e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:20.458362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:20.458362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:20.458362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:20.458362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:20.458362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:20.458362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:20.458362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:20.458362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:20.458362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:20.458362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:20.458362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:20.458362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:36:20.458362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:36:20.458362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:36:20.458362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:36:20.460014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:36:20.460014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:36:20.460014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:36:20.460014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:36:20.460014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:20.460014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:20.460014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:20.460014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:20.460014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:20.460014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:20.460014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:20.460014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:20.460014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:20.460014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:20.460014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:20.460014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:20.460981 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:20.460981 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:20.460981 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:20.460981 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:20.460981 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:36:20.460981 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:36:20.460981 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:36:20.460981 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:36:20.460981 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:36:20.460981 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:36:20.460981 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:20.460981 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:20.465213 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 311/627] 10.222.0.119 () {56 vars in 1107 bytes} [Thu Jul 14 15:36:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:20.466075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1b8a2-7a02-4c30-ba14-3ac0d30359e9 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:20.474376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767a644-cf17-4a49-ac98-4c2169e3e27b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:20.477600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767a644-cf17-4a49-ac98-4c2169e3e27b None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:20.572812 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:20.579026 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1b8a2-7a02-4c30-ba14-3ac0d30359e9 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:20.616556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635475d-313f-4e70-9d68-4a90894d3ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:20.617225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635475d-313f-4e70-9d68-4a90894d3ba6 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:20.617508 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635475d-313f-4e70-9d68-4a90894d3ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:20.617789 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635475d-313f-4e70-9d68-4a90894d3ba6 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:20.618515 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635475d-313f-4e70-9d68-4a90894d3ba6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:20.618902 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635475d-313f-4e70-9d68-4a90894d3ba6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:20.620208 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635475d-313f-4e70-9d68-4a90894d3ba6 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:20.624240 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 317/628] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:36:20 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:20.625299 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767a644-cf17-4a49-ac98-4c2169e3e27b None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:20.633276 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 312/629] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:20.637801 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cec569-07e2-4359-9577-5ecd2faf4f62 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:20.638097 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cec569-07e2-4359-9577-5ecd2faf4f62 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:20.638843 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cec569-07e2-4359-9577-5ecd2faf4f62 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:20.640547 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 313/630] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:20.644064 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cec569-07e2-4359-9577-5ecd2faf4f62 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:20.715912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:20.752008 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767a644-cf17-4a49-ac98-4c2169e3e27b None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:20.759698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cec569-07e2-4359-9577-5ecd2faf4f62 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:20.797123 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a3674-9eab-4b41-b481-79744db5c4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:20.797803 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a3674-9eab-4b41-b481-79744db5c4bf None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:20.798092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a3674-9eab-4b41-b481-79744db5c4bf None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:20.798371 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a3674-9eab-4b41-b481-79744db5c4bf None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:20.799547 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a3674-9eab-4b41-b481-79744db5c4bf None admin] RBAC: Adding query filter params (name=service) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:20.800054 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a3674-9eab-4b41-b481-79744db5c4bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:20.802343 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a3674-9eab-4b41-b481-79744db5c4bf None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:20.811683 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7db5ef-df07-46ed-bf40-1d48d9558ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:20.811851 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 318/631] 10.222.0.119 () {56 vars in 1108 bytes} [Thu Jul 14 15:36:20 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:20.816605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7db5ef-df07-46ed-bf40-1d48d9558ac4 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:20.816757 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a3674-9eab-4b41-b481-79744db5c4bf None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:20.816859 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7db5ef-df07-46ed-bf40-1d48d9558ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:20.816859 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7db5ef-df07-46ed-bf40-1d48d9558ac4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:20.830935 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7db5ef-df07-46ed-bf40-1d48d9558ac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:20.833181 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7db5ef-df07-46ed-bf40-1d48d9558ac4 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:20.854757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-4f7db5ef-df07-46ed-bf40-1d48d9558ac4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:20.854757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:20.854757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:20.854757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:20.854757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:20.854757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:20.854757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:20.854757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:20.854757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:20.854757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:20.854757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:20.854757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:20.854757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:20.854757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:20.854757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:20.855692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:20.855692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:20.855692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:20.855692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:20.855692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:20.855692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:20.855692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:20.855692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:20.855692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:20.855692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:20.855692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:20.855692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:20.855692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:20.855692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:20.855692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:20.855692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:20.855692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:20.857510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:20.857510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:20.857510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:20.857510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:20.857510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 314/632] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:20.857510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7f343-a43e-40c9-8fbc-1908c49c1f0c None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:20.857510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7f343-a43e-40c9-8fbc-1908c49c1f0c None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:20.857918 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7f343-a43e-40c9-8fbc-1908c49c1f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:20.875635 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-24c7f343-a43e-40c9-8fbc-1908c49c1f0c None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:20.876959 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-24c7f343-a43e-40c9-8fbc-1908c49c1f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:20.879111 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:20.948812 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a3674-9eab-4b41-b481-79744db5c4bf None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:20.950659 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 315/633] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:36:20.951381 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7f343-a43e-40c9-8fbc-1908c49c1f0c None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:20.997011 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38262a47-518b-468c-bcdc-c3465431bbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:20.997816 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38262a47-518b-468c-bcdc-c3465431bbce None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:20.998135 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38262a47-518b-468c-bcdc-c3465431bbce None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:20.998414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38262a47-518b-468c-bcdc-c3465431bbce None admin] PATH_INFO: `/v3/projects/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:21.002801 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:21.009555 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38262a47-518b-468c-bcdc-c3465431bbce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:21.010959 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38262a47-518b-468c-bcdc-c3465431bbce None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:21.029973 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-38262a47-518b-468c-bcdc-c3465431bbce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:21.029973 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:21.029973 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:21.029973 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:21.029973 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:21.029973 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:21.029973 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:21.029973 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:21.029973 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:21.029973 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:21.029973 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:21.029973 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:21.029973 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:36:21.029973 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:36:21.029973 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:36:21.031042 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:36:21.031042 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:21.031042 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:21.031042 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:21.031042 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:21.031042 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:21.031042 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:21.031042 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:21.031042 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:21.031042 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:21.031042 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:21.031042 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:21.031042 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:21.031042 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:21.031042 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:21.031042 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:21.031042 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:21.031957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:36:21.031957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:36:21.031957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:36:21.031957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:36:21.031957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:36:21.031957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:36:21.031957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:21.031957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:21.031957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 319/634] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:21.031957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38262a47-518b-468c-bcdc-c3465431bbce None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:21.057773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7f343-a43e-40c9-8fbc-1908c49c1f0c None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:21.093190 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50074380-606d-4b83-b39b-3b7679adc38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:21.094234 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50074380-606d-4b83-b39b-3b7679adc38c None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:21.094536 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50074380-606d-4b83-b39b-3b7679adc38c None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:21.094812 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50074380-606d-4b83-b39b-3b7679adc38c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:21.103794 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:21.107760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50074380-606d-4b83-b39b-3b7679adc38c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:21.109270 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50074380-606d-4b83-b39b-3b7679adc38c None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:21.127460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-50074380-606d-4b83-b39b-3b7679adc38c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:21.127460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:21.127460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:21.127460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:21.127460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:21.127460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:21.127460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:21.127460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:21.127460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:21.127460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:21.127460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:21.127460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:21.127460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:21.127460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:21.127460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:21.128589 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:21.128589 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:21.128589 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:21.128589 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:21.128589 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:21.128589 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:21.128589 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:21.128589 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:21.128589 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:21.128589 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:21.128589 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:21.128589 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:21.128589 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:21.128589 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:21.128589 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:21.128589 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:21.128589 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:21.129477 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:21.129477 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:21.129477 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:21.129477 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:21.129477 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 316/635] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:21.129477 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50074380-606d-4b83-b39b-3b7679adc38c None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:21.145963 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38262a47-518b-468c-bcdc-c3465431bbce None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:21.186316 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93b5a3-44a1-4852-889d-02138dd46d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:21.187075 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93b5a3-44a1-4852-889d-02138dd46d5a None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:21.187364 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93b5a3-44a1-4852-889d-02138dd46d5a None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:21.187641 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93b5a3-44a1-4852-889d-02138dd46d5a None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:21.188394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93b5a3-44a1-4852-889d-02138dd46d5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:21.188712 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93b5a3-44a1-4852-889d-02138dd46d5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:21.190071 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93b5a3-44a1-4852-889d-02138dd46d5a None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:21.202000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 320/636] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:21.203248 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936f783-cf6b-453e-83e4-60a2af0079b9 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:21.203536 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936f783-cf6b-453e-83e4-60a2af0079b9 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:21.203814 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936f783-cf6b-453e-83e4-60a2af0079b9 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:21.205056 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 321/637] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:21.205735 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936f783-cf6b-453e-83e4-60a2af0079b9 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:21.242396 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50074380-606d-4b83-b39b-3b7679adc38c None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:21.267145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:21.279413 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ced426-fe00-4fd9-be31-0699b5688082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:21.280254 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ced426-fe00-4fd9-be31-0699b5688082 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:21.280545 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ced426-fe00-4fd9-be31-0699b5688082 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:21.280830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ced426-fe00-4fd9-be31-0699b5688082 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:21.291464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ced426-fe00-4fd9-be31-0699b5688082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:36:21.299431 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-b7ced426-fe00-4fd9-be31-0699b5688082 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:21.299431 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:21.299431 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:21.299431 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:21.299431 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:21.299431 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:21.299431 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:21.299431 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:21.299431 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:21.299431 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:21.299431 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:21.299431 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:21.299431 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:36:21.299431 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:36:21.299431 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:36:21.299431 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:36:21.300473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:36:21.300473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:36:21.300473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:36:21.300473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:36:21.300473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:21.300473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:21.300473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:21.300473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:21.300473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:21.300473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:21.300473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:21.300473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:21.300473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:21.300473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:21.300473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:21.300473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:21.301419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:21.301419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:21.301419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:21.301419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:21.301419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:36:21.301419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:36:21.301419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:36:21.301419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:36:21.301419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:36:21.301419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:36:21.301419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:21.301419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:21.301419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 317/638] 10.222.0.119 () {56 vars in 1107 bytes} [Thu Jul 14 15:36:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:21.302122 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ced426-fe00-4fd9-be31-0699b5688082 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:21.317219 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936f783-cf6b-453e-83e4-60a2af0079b9 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:21.354337 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e9148-ab63-414d-8cf7-d66ffda744a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:21.355311 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:21.355826 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e9148-ab63-414d-8cf7-d66ffda744a4 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:21.356138 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e9148-ab63-414d-8cf7-d66ffda744a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:21.356426 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e9148-ab63-414d-8cf7-d66ffda744a4 None admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:21.357329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e9148-ab63-414d-8cf7-d66ffda744a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:21.357640 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e9148-ab63-414d-8cf7-d66ffda744a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:21.359067 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e9148-ab63-414d-8cf7-d66ffda744a4 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:21.371909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 322/639] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:36:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:21.372992 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e9148-ab63-414d-8cf7-d66ffda744a4 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:21.407488 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ced426-fe00-4fd9-be31-0699b5688082 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:21.440698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3600926-d3bb-426e-a891-2350b53551ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:21.441365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3600926-d3bb-426e-a891-2350b53551ba None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:21.441655 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3600926-d3bb-426e-a891-2350b53551ba None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:21.441938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3600926-d3bb-426e-a891-2350b53551ba None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:21.442664 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3600926-d3bb-426e-a891-2350b53551ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:21.442975 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3600926-d3bb-426e-a891-2350b53551ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:21.445203 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3600926-d3bb-426e-a891-2350b53551ba None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:21.457166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 318/640] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:21.458379 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730be6e-a53c-4889-bed6-a2b07356ea83 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:21.458672 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730be6e-a53c-4889-bed6-a2b07356ea83 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:21.458955 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730be6e-a53c-4889-bed6-a2b07356ea83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:21.476703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-0730be6e-a53c-4889-bed6-a2b07356ea83 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:21.478606 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-0730be6e-a53c-4889-bed6-a2b07356ea83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:21.484991 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e9148-ab63-414d-8cf7-d66ffda744a4 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:21.499680 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:21.522214 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc7b26-1ee5-4c17-9bfe-94839be7554d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:21.523133 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc7b26-1ee5-4c17-9bfe-94839be7554d None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:21.523426 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc7b26-1ee5-4c17-9bfe-94839be7554d None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:21.523712 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc7b26-1ee5-4c17-9bfe-94839be7554d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:21.531315 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc7b26-1ee5-4c17-9bfe-94839be7554d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:21.533182 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc7b26-1ee5-4c17-9bfe-94839be7554d None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:21.555914 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 319/641] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:36:21.556688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-54fc7b26-1ee5-4c17-9bfe-94839be7554d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:21.556688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:21.556688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:21.556688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:21.556688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:21.556688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:21.556688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:21.556688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:21.556688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:21.556688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:21.556688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:21.556688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:21.556688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:36:21.556688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:36:21.556688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:36:21.557805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:36:21.557805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:21.557805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:21.557805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:21.557805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:21.557805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:21.557805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:21.557805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:21.557805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:21.557805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:21.557805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:21.557805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:21.557805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:21.557805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:21.557805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:21.557805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:21.557805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:21.558692 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:36:21.558692 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:36:21.558692 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:36:21.558692 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:36:21.558692 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:36:21.558692 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:36:21.558692 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:21.558692 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:21.559600 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730be6e-a53c-4889-bed6-a2b07356ea83 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:21.559690 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 323/642] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:21.559690 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc7b26-1ee5-4c17-9bfe-94839be7554d None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:21.609095 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:21.669532 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730be6e-a53c-4889-bed6-a2b07356ea83 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:21.673250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc7b26-1ee5-4c17-9bfe-94839be7554d None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:21.709319 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56ad27-9cba-4f87-9931-c47d867d5073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:21.709713 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149b304-2b8d-415f-bc51-e528d10ae10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:21.709994 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56ad27-9cba-4f87-9931-c47d867d5073 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:21.710287 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56ad27-9cba-4f87-9931-c47d867d5073 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:21.710570 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56ad27-9cba-4f87-9931-c47d867d5073 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:21.710676 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149b304-2b8d-415f-bc51-e528d10ae10e None admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:21.710889 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149b304-2b8d-415f-bc51-e528d10ae10e None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:21.711171 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149b304-2b8d-415f-bc51-e528d10ae10e None admin] PATH_INFO: `/v3/projects/07652ced88cf4f069d1765176be5130b/users/28a5c169576e432c8174a562ae358e8b/roles/92c47f3813b04366b3019ba2a56337eb` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:21.711319 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56ad27-9cba-4f87-9931-c47d867d5073 None admin] RBAC: Adding query filter params (name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:21.711632 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56ad27-9cba-4f87-9931-c47d867d5073 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:21.713036 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56ad27-9cba-4f87-9931-c47d867d5073 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:21.721329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 320/643] 10.222.0.119 () {56 vars in 1108 bytes} [Thu Jul 14 15:36:21 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:21.722129 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56ad27-9cba-4f87-9931-c47d867d5073 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:21.727804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149b304-2b8d-415f-bc51-e528d10ae10e None admin] RBAC: Authorizing `identity:create_grant(project_id=07652ced88cf4f069d1765176be5130b, user_id=28a5c169576e432c8174a562ae358e8b, role_id=92c47f3813b04366b3019ba2a56337eb)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:21.729287 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149b304-2b8d-415f-bc51-e528d10ae10e None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:21.817895 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 324/644] 10.222.0.119 () {58 vars in 1444 bytes} [Thu Jul 14 15:36:21 2022] PUT /identity/v3/projects/07652ced88cf4f069d1765176be5130b/users/28a5c169576e432c8174a562ae358e8b/roles/92c47f3813b04366b3019ba2a56337eb => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:36:21.818853 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149b304-2b8d-415f-bc51-e528d10ae10e None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:21.826906 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56ad27-9cba-4f87-9931-c47d867d5073 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:21.828805 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:21.867209 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:21.867748 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1615a1-ebd6-49b7-a9d8-eb9b1d39ee4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:21.868613 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1615a1-ebd6-49b7-a9d8-eb9b1d39ee4b None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:21.868900 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1615a1-ebd6-49b7-a9d8-eb9b1d39ee4b None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:21.869178 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1615a1-ebd6-49b7-a9d8-eb9b1d39ee4b None admin] PATH_INFO: `/v3/users/glance` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:21.879242 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1615a1-ebd6-49b7-a9d8-eb9b1d39ee4b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:21.880768 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1615a1-ebd6-49b7-a9d8-eb9b1d39ee4b None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:21.898102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-ad1615a1-ebd6-49b7-a9d8-eb9b1d39ee4b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 15:36:21.898102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:21.898102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:21.898102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:21.898102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:21.898102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:21.898102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:21.898102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:21.898102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:21.898102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:21.898102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:21.898102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:21.898102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:36:21.898102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:36:21.898102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:36:21.898102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:36:21.899382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:21.899382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:21.899382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:21.899382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:21.899382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:21.899382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:21.899382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:21.899382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:21.899382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:21.899382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:21.899382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:21.899382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:21.899382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:21.899382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:21.899382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:21.899382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:21.899382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:21.899382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:21.900548 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:21.900548 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:21.900548 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:36:21.900548 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:36:21.900548 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:36:21.900548 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:36:21.900548 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:36:21.900548 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:36:21.900548 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 15:36:21.900548 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:21.900548 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 321/645] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:36:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:21.900548 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1615a1-ebd6-49b7-a9d8-eb9b1d39ee4b None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:21.966162 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149b304-2b8d-415f-bc51-e528d10ae10e None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:22.009040 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234a9b3-03f5-4070-8900-db2d6b3cc01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:22.009712 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234a9b3-03f5-4070-8900-db2d6b3cc01f None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:22.010002 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234a9b3-03f5-4070-8900-db2d6b3cc01f None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:22.010284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234a9b3-03f5-4070-8900-db2d6b3cc01f None admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:22.011223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234a9b3-03f5-4070-8900-db2d6b3cc01f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:22.011620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234a9b3-03f5-4070-8900-db2d6b3cc01f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:22.013079 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234a9b3-03f5-4070-8900-db2d6b3cc01f None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:22.026911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1615a1-ebd6-49b7-a9d8-eb9b1d39ee4b None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:22.032153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 325/646] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:36:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:22.032153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234a9b3-03f5-4070-8900-db2d6b3cc01f None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:22.062180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c10dc-f623-4084-a169-0d35eaa31899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:22.062994 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c10dc-f623-4084-a169-0d35eaa31899 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:22.063270 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c10dc-f623-4084-a169-0d35eaa31899 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:22.063548 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c10dc-f623-4084-a169-0d35eaa31899 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:22.074210 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193c10dc-f623-4084-a169-0d35eaa31899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:36:22.081904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-193c10dc-f623-4084-a169-0d35eaa31899 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:22.081904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:22.081904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:22.081904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:22.081904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:22.081904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:22.081904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:22.081904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:22.081904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:22.081904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:22.081904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:22.081904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:22.081904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:36:22.081904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:36:22.081904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:36:22.081904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:36:22.083053 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:36:22.083053 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:36:22.083053 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:36:22.083053 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:36:22.083053 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:22.083053 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:22.083053 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:22.083053 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:22.083053 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:22.083053 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:22.083053 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:22.083053 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:22.083053 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:22.083053 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:22.083053 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:22.083053 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:22.083940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:22.083940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:22.083940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:22.083940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:22.083940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:36:22.083940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:36:22.083940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:36:22.083940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:36:22.083940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:36:22.083940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:36:22.083940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:22.083940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:22.083940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 322/647] 10.222.0.119 () {56 vars in 1107 bytes} [Thu Jul 14 15:36:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:22.085408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c10dc-f623-4084-a169-0d35eaa31899 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:22.110033 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:22.135330 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:22.156859 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234a9b3-03f5-4070-8900-db2d6b3cc01f None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:22.198231 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c626613-61cb-4ff3-af88-49890a95f562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:22.199026 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c626613-61cb-4ff3-af88-49890a95f562 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:22.199382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c626613-61cb-4ff3-af88-49890a95f562 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:22.199645 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c626613-61cb-4ff3-af88-49890a95f562 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:22.211190 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c626613-61cb-4ff3-af88-49890a95f562 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:22.212118 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c10dc-f623-4084-a169-0d35eaa31899 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:22.212704 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c626613-61cb-4ff3-af88-49890a95f562 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:22.231326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-7c626613-61cb-4ff3-af88-49890a95f562 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:22.231326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:22.231326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:22.231326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:22.231326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:22.231326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:22.231326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:22.231326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:22.231326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:22.231326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:22.231326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:22.231326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:22.231326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:22.231326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:22.231326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:22.232300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:22.232300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:22.232300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:22.232300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:22.232300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:22.232300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:22.232300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:22.232300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:22.232300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:22.232300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:22.232300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:22.232300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:22.232300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:22.232300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:22.232300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:22.232300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:22.232300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:22.233215 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:22.233215 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:22.233215 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:22.233215 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:22.233215 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 326/648] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:22.233495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c626613-61cb-4ff3-af88-49890a95f562 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:22.262365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412ee52-1a42-4291-bfb9-c09b607def97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:22.263240 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412ee52-1a42-4291-bfb9-c09b607def97 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:22.263649 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412ee52-1a42-4291-bfb9-c09b607def97 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:22.264121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412ee52-1a42-4291-bfb9-c09b607def97 None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:22.265344 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412ee52-1a42-4291-bfb9-c09b607def97 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:22.265797 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412ee52-1a42-4291-bfb9-c09b607def97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:22.267923 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412ee52-1a42-4291-bfb9-c09b607def97 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:22.304256 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 323/649] 10.222.0.119 () {56 vars in 1142 bytes} [Thu Jul 14 15:36:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:22.305879 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412ee52-1a42-4291-bfb9-c09b607def97 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:22.350288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c626613-61cb-4ff3-af88-49890a95f562 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:22.390999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2392b6-d380-4639-af00-6097389a76b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:22.391615 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2392b6-d380-4639-af00-6097389a76b3 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:22.391852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2392b6-d380-4639-af00-6097389a76b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:22.392410 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:22.392622 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2392b6-d380-4639-af00-6097389a76b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:22.393997 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2392b6-d380-4639-af00-6097389a76b3 None admin] RBAC: Adding query filter params (role.id=92c47f3813b04366b3019ba2a56337eb, scope.project.id=07652ced88cf4f069d1765176be5130b, user.id=a1e4c833a4684561ab52eda5734a7766) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:22.394187 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2392b6-d380-4639-af00-6097389a76b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:22.395585 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2392b6-d380-4639-af00-6097389a76b3 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:22.400032 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:22.412130 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 327/650] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:36:22 2022] GET /identity/v3/role_assignments?user.id=a1e4c833a4684561ab52eda5734a7766&scope.project.id=07652ced88cf4f069d1765176be5130b&role.id=92c47f3813b04366b3019ba2a56337eb => generated 610 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:22.412130 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2392b6-d380-4639-af00-6097389a76b3 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:22.426693 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412ee52-1a42-4291-bfb9-c09b607def97 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:22.481036 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751392a8-2e62-482d-af99-b3bd872d506f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:22.482064 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751392a8-2e62-482d-af99-b3bd872d506f None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:22.482451 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751392a8-2e62-482d-af99-b3bd872d506f None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:22.482736 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751392a8-2e62-482d-af99-b3bd872d506f None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:22.483831 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751392a8-2e62-482d-af99-b3bd872d506f None admin] RBAC: Adding query filter params (name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:22.484630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751392a8-2e62-482d-af99-b3bd872d506f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:22.486376 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751392a8-2e62-482d-af99-b3bd872d506f None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:22.500687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 324/651] 10.222.0.119 () {56 vars in 1108 bytes} [Thu Jul 14 15:36:22 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:22.501579 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751392a8-2e62-482d-af99-b3bd872d506f None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:22.534467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2392b6-d380-4639-af00-6097389a76b3 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:22.572797 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c543346-c079-4959-b142-5380d3284c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:22.573670 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c543346-c079-4959-b142-5380d3284c67 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:22.574104 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c543346-c079-4959-b142-5380d3284c67 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:22.574476 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c543346-c079-4959-b142-5380d3284c67 None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:22.575315 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c543346-c079-4959-b142-5380d3284c67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:22.575832 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c543346-c079-4959-b142-5380d3284c67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:22.577497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c543346-c079-4959-b142-5380d3284c67 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:22.592833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 328/652] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:22.594069 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c543346-c079-4959-b142-5380d3284c67 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:22.627384 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751392a8-2e62-482d-af99-b3bd872d506f None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:22.659750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:22.668437 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f5a63-d5f5-44bd-bcd3-f94298111fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:22.674471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f5a63-d5f5-44bd-bcd3-f94298111fa0 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:22.674471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f5a63-d5f5-44bd-bcd3-f94298111fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:22.674471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f5a63-d5f5-44bd-bcd3-f94298111fa0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:22.686345 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:22.710229 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c543346-c079-4959-b142-5380d3284c67 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:22.761724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e6c5f-cc2b-46ba-9c52-aabb7f22a933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:22.762774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e6c5f-cc2b-46ba-9c52-aabb7f22a933 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:22.763055 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e6c5f-cc2b-46ba-9c52-aabb7f22a933 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:22.764008 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e6c5f-cc2b-46ba-9c52-aabb7f22a933 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:22.766291 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f5a63-d5f5-44bd-bcd3-f94298111fa0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:22.767781 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f5a63-d5f5-44bd-bcd3-f94298111fa0 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:22.788614 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e6c5f-cc2b-46ba-9c52-aabb7f22a933 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:22.790844 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e6c5f-cc2b-46ba-9c52-aabb7f22a933 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:22.814346 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-894e6c5f-cc2b-46ba-9c52-aabb7f22a933 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:22.814346 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:22.814346 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:22.814346 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:22.814346 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:22.814346 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:22.814346 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:22.814346 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:22.814346 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:22.814346 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:22.814346 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:22.814346 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:22.814346 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:22.814346 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:22.814346 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:22.815378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:22.815378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:22.815378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:22.815378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:22.815378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:22.815378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:22.815378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:22.815378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:22.815378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:22.815378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:22.815378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:22.815378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:22.815378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:22.815378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:22.815378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:22.815378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:22.815378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:22.816284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:22.816284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:22.816284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:22.816284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:22.816284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 329/653] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:22.820616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e6c5f-cc2b-46ba-9c52-aabb7f22a933 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:22.908971 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 325/654] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:36:22 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:22.910981 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f5a63-d5f5-44bd-bcd3-f94298111fa0 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:22.952318 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e6c5f-cc2b-46ba-9c52-aabb7f22a933 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:22.974554 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:22.977061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:23.010064 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20192cbb-6588-4e87-a61d-d2001e541d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:23.011915 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20192cbb-6588-4e87-a61d-d2001e541d6c None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:23.012474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20192cbb-6588-4e87-a61d-d2001e541d6c None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:23.012961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20192cbb-6588-4e87-a61d-d2001e541d6c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:23.025179 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20192cbb-6588-4e87-a61d-d2001e541d6c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:23.027724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20192cbb-6588-4e87-a61d-d2001e541d6c None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:23.039287 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f5a63-d5f5-44bd-bcd3-f94298111fa0 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:23.049640 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-20192cbb-6588-4e87-a61d-d2001e541d6c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 15:36:23.049640 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:23.049640 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:23.049640 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:23.049640 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:23.049640 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:23.049640 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:23.049640 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:23.049640 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:23.049640 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:23.049640 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:23.049640 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:23.049640 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:36:23.049640 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:36:23.049640 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:36:23.049640 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:36:23.050604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:23.050604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:23.050604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:23.050604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:23.050604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:23.050604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:23.050604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:23.050604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:23.050604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:23.050604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:23.050604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:23.050604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:23.050604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:23.050604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:23.050604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:23.050604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:23.050604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:23.050604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:23.051525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:23.051525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:23.051525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:36:23.051525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:36:23.051525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:36:23.051525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:36:23.051525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:36:23.051525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:36:23.051525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 15:36:23.051525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:23.058977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 330/655] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:36:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:23.058977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20192cbb-6588-4e87-a61d-d2001e541d6c None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:23.096740 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421c0b7-2285-4899-80e3-9a597db4298b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:23.097571 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421c0b7-2285-4899-80e3-9a597db4298b None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:23.097959 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421c0b7-2285-4899-80e3-9a597db4298b None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:23.098336 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421c0b7-2285-4899-80e3-9a597db4298b None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:23.099428 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421c0b7-2285-4899-80e3-9a597db4298b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:23.100381 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421c0b7-2285-4899-80e3-9a597db4298b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:23.102947 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421c0b7-2285-4899-80e3-9a597db4298b None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:23.119171 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 326/656] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:23.120263 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421c0b7-2285-4899-80e3-9a597db4298b None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:23.192817 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20192cbb-6588-4e87-a61d-d2001e541d6c None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:23.238994 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421c0b7-2285-4899-80e3-9a597db4298b None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:23.241457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:23.243043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111214af-f8d6-4655-a1f6-c8f36ceaa9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:23.244123 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111214af-f8d6-4655-a1f6-c8f36ceaa9ac None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:23.244609 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111214af-f8d6-4655-a1f6-c8f36ceaa9ac None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:23.245134 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111214af-f8d6-4655-a1f6-c8f36ceaa9ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:23.258047 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111214af-f8d6-4655-a1f6-c8f36ceaa9ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:23.260149 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111214af-f8d6-4655-a1f6-c8f36ceaa9ac None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:23.281329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-111214af-f8d6-4655-a1f6-c8f36ceaa9ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:23.281329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:23.281329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:23.281329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:23.281329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:23.281329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:23.281329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:23.281329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:23.281329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:23.281329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:23.281329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:23.281329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:23.281329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:23.281329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:23.281329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:23.282251 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:23.282251 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:23.282251 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:23.282251 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:23.282251 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:23.282251 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:23.282251 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:23.282251 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:23.282251 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:23.282251 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:23.282251 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:23.282251 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:23.282251 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:23.282251 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:23.282251 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:23.282251 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:23.282251 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:23.283510 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:23.283510 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:23.283510 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:23.283510 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:23.289942 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 331/657] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:23.289942 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111214af-f8d6-4655-a1f6-c8f36ceaa9ac None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:23.292701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa387b-fbda-48ef-be33-ed5119756ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:23.293551 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa387b-fbda-48ef-be33-ed5119756ac4 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:23.293847 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa387b-fbda-48ef-be33-ed5119756ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:23.294132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa387b-fbda-48ef-be33-ed5119756ac4 None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:23.295327 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa387b-fbda-48ef-be33-ed5119756ac4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:23.295661 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa387b-fbda-48ef-be33-ed5119756ac4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:23.298141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa387b-fbda-48ef-be33-ed5119756ac4 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:23.320812 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:23.324176 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 327/658] 10.222.0.119 () {56 vars in 1142 bytes} [Thu Jul 14 15:36:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:23.325619 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa387b-fbda-48ef-be33-ed5119756ac4 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:23.407689 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111214af-f8d6-4655-a1f6-c8f36ceaa9ac None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:23.448779 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686b0d0-0c02-414e-ba41-ac1137d35706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:23.450073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686b0d0-0c02-414e-ba41-ac1137d35706 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:23.450567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686b0d0-0c02-414e-ba41-ac1137d35706 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:23.451039 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686b0d0-0c02-414e-ba41-ac1137d35706 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:23.460018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6686b0d0-0c02-414e-ba41-ac1137d35706 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:23.462178 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6686b0d0-0c02-414e-ba41-ac1137d35706 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:23.473812 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa387b-fbda-48ef-be33-ed5119756ac4 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:23.479538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-6686b0d0-0c02-414e-ba41-ac1137d35706 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 15:36:23.479538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:23.479538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:23.479538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:23.479538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:23.479538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:23.479538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:23.479538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:23.479538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:23.479538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:23.479538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:23.479538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:23.479538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:36:23.479538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:36:23.479538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:36:23.479538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:36:23.480726 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:23.480726 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:23.480726 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:23.480726 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:23.480726 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:23.480726 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:23.480726 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:23.480726 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:23.480726 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:23.480726 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:23.480726 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:23.480726 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:23.480726 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:23.480726 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:23.480726 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:23.480726 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:23.480726 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:23.480726 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:23.481669 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:23.481669 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:23.481669 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:36:23.481669 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:36:23.481669 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:36:23.481669 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:36:23.481669 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:36:23.481669 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:36:23.481669 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 15:36:23.481669 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:23.484319 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 332/659] 10.222.0.119 () {56 vars in 1107 bytes} [Thu Jul 14 15:36:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:23.485335 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686b0d0-0c02-414e-ba41-ac1137d35706 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:23.518364 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06497e41-8383-4d8c-a936-e2a6c4b1f948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:23.518763 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06497e41-8383-4d8c-a936-e2a6c4b1f948 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:23.520581 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06497e41-8383-4d8c-a936-e2a6c4b1f948 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:23.520876 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06497e41-8383-4d8c-a936-e2a6c4b1f948 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:23.521647 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06497e41-8383-4d8c-a936-e2a6c4b1f948 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:23.521959 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06497e41-8383-4d8c-a936-e2a6c4b1f948 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:23.523571 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06497e41-8383-4d8c-a936-e2a6c4b1f948 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:23.540246 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 328/660] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:23.540246 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06497e41-8383-4d8c-a936-e2a6c4b1f948 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:23.574627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:23.601570 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:23.620282 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686b0d0-0c02-414e-ba41-ac1137d35706 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:23.659198 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89535824-b157-4dd0-a885-2ffd6b05a993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:23.660370 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89535824-b157-4dd0-a885-2ffd6b05a993 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:23.661022 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89535824-b157-4dd0-a885-2ffd6b05a993 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:23.661517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89535824-b157-4dd0-a885-2ffd6b05a993 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:23.702676 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06497e41-8383-4d8c-a936-e2a6c4b1f948 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:23.738005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89535824-b157-4dd0-a885-2ffd6b05a993 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:23.740171 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89535824-b157-4dd0-a885-2ffd6b05a993 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:23.754712 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29a444-5108-4991-9cc2-53432540c71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:23.776220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29a444-5108-4991-9cc2-53432540c71a None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:23.776220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29a444-5108-4991-9cc2-53432540c71a None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:23.776220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29a444-5108-4991-9cc2-53432540c71a None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:23.776220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29a444-5108-4991-9cc2-53432540c71a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:23.776220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29a444-5108-4991-9cc2-53432540c71a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:23.776220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29a444-5108-4991-9cc2-53432540c71a None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:23.793205 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 329/661] 10.222.0.119 () {56 vars in 1144 bytes} [Thu Jul 14 15:36:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:23.794773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29a444-5108-4991-9cc2-53432540c71a None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:23.841743 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:23.861940 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 333/662] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:36:23 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:23.863131 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89535824-b157-4dd0-a885-2ffd6b05a993 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:23.927068 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:23.951368 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29a444-5108-4991-9cc2-53432540c71a None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:23.973793 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89535824-b157-4dd0-a885-2ffd6b05a993 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:23.991897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429f450-642e-4eeb-b311-b28bb46cc01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:23.992809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429f450-642e-4eeb-b311-b28bb46cc01d None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:23.993040 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429f450-642e-4eeb-b311-b28bb46cc01d None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:23.993380 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429f450-642e-4eeb-b311-b28bb46cc01d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:24.000390 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429f450-642e-4eeb-b311-b28bb46cc01d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:24.001857 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429f450-642e-4eeb-b311-b28bb46cc01d None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:24.013756 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d7e1b-17a4-4c31-83a1-d03668b63543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:24.014664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d7e1b-17a4-4c31-83a1-d03668b63543 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:24.015093 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d7e1b-17a4-4c31-83a1-d03668b63543 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:24.015514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d7e1b-17a4-4c31-83a1-d03668b63543 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:24.015862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-c429f450-642e-4eeb-b311-b28bb46cc01d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:24.015862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:24.015862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:24.015862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:24.015862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:24.015862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:24.015862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:24.015862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:24.015862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:24.015862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:24.015862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:24.015862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:24.015862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:36:24.015862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:36:24.015862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:36:24.016919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:36:24.016919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:24.016919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:24.016919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:24.016919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:24.016919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:24.016919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:24.016919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:24.016919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:24.016919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:24.016919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:24.016919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:24.016919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:24.016919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:24.016919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:24.016919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:24.016919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:24.017824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:36:24.017824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:36:24.017824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:36:24.017824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:36:24.017824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:36:24.017824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:36:24.017824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:24.017824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:24.017824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 330/663] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:24.017824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429f450-642e-4eeb-b311-b28bb46cc01d None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:24.071437 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:24.086975 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d7e1b-17a4-4c31-83a1-d03668b63543 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:24.088464 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d7e1b-17a4-4c31-83a1-d03668b63543 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:24.128623 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429f450-642e-4eeb-b311-b28bb46cc01d None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:24.164566 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2011ee-1b26-4d30-b594-8c44406debfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:24.165368 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2011ee-1b26-4d30-b594-8c44406debfe None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:24.165654 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2011ee-1b26-4d30-b594-8c44406debfe None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:24.165935 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2011ee-1b26-4d30-b594-8c44406debfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:24.173247 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:24.177872 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2011ee-1b26-4d30-b594-8c44406debfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:24.179975 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2011ee-1b26-4d30-b594-8c44406debfe None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:24.194178 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 334/664] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:36:23 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:24.197030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-4e2011ee-1b26-4d30-b594-8c44406debfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:24.197030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:24.197030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:24.197030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:24.197030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:24.197030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:24.197030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:24.197030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:24.197030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:24.197030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:24.197030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:24.197030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:24.197030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:24.197030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:24.197030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:24.197887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:24.197887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:24.197887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:24.197887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:24.197887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:24.197887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:24.197887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:24.197887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:24.197887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:24.197887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:24.197887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:24.197887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:24.197887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:24.197887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:24.197887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:24.197887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:24.197887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:24.203624 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:24.203624 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:24.203624 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:24.203624 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:24.203624 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 331/665] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:24.203624 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2011ee-1b26-4d30-b594-8c44406debfe None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:24.203969 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d6f48-b1b9-4591-a037-006079b14318 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:24.203969 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d6f48-b1b9-4591-a037-006079b14318 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:24.203969 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d6f48-b1b9-4591-a037-006079b14318 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:24.203969 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 335/666] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:24 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:24.203969 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d6f48-b1b9-4591-a037-006079b14318 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:24.295387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:24.310041 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2011ee-1b26-4d30-b594-8c44406debfe None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:24.313380 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d6f48-b1b9-4591-a037-006079b14318 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:24.345663 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14516032-ba41-41f9-aebe-e86e60c1eddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:24.346348 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14516032-ba41-41f9-aebe-e86e60c1eddf None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:24.346619 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14516032-ba41-41f9-aebe-e86e60c1eddf None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:24.346901 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14516032-ba41-41f9-aebe-e86e60c1eddf None admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:24.347695 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14516032-ba41-41f9-aebe-e86e60c1eddf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:24.348008 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14516032-ba41-41f9-aebe-e86e60c1eddf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:24.349473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14516032-ba41-41f9-aebe-e86e60c1eddf None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:24.355351 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15ed13-e6bc-4bb4-a3b5-7bbb2f10760f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:24.356443 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15ed13-e6bc-4bb4-a3b5-7bbb2f10760f None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:24.356934 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15ed13-e6bc-4bb4-a3b5-7bbb2f10760f None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:24.357413 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15ed13-e6bc-4bb4-a3b5-7bbb2f10760f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:24.362840 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 332/667] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:36:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:24.363651 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14516032-ba41-41f9-aebe-e86e60c1eddf None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:24.373416 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15ed13-e6bc-4bb4-a3b5-7bbb2f10760f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:24.375176 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15ed13-e6bc-4bb4-a3b5-7bbb2f10760f None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:24.394339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-1a15ed13-e6bc-4bb4-a3b5-7bbb2f10760f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:24.394339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:24.394339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:24.394339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:24.394339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:24.394339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:24.394339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:24.394339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:24.394339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:24.394339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:24.394339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:24.394339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:24.394339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:24.394339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:24.394339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:24.395250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:24.395250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:24.395250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:24.395250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:24.395250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:24.395250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:24.395250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:24.395250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:24.395250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:24.395250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:24.395250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:24.395250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:24.395250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:24.395250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:24.395250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:24.395250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:24.395250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:24.396179 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:24.396179 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:24.396179 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:24.396179 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:24.396179 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 336/668] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:24.397743 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ae4f1-e243-4037-ab20-77e6d9fd3824 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:24.397743 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ae4f1-e243-4037-ab20-77e6d9fd3824 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:24.397970 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ae4f1-e243-4037-ab20-77e6d9fd3824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:24.415686 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-ad9ae4f1-e243-4037-ab20-77e6d9fd3824 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:24.416912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-ad9ae4f1-e243-4037-ab20-77e6d9fd3824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:24.424968 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:24.474351 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14516032-ba41-41f9-aebe-e86e60c1eddf None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:24.492497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 337/669] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:24 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:36:24.493906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ae4f1-e243-4037-ab20-77e6d9fd3824 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:24.521486 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fcacb-79a2-400b-8aef-13c8d50de6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:24.523081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fcacb-79a2-400b-8aef-13c8d50de6d0 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:24.523440 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fcacb-79a2-400b-8aef-13c8d50de6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:24.523823 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fcacb-79a2-400b-8aef-13c8d50de6d0 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:24.525072 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fcacb-79a2-400b-8aef-13c8d50de6d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:24.525249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fcacb-79a2-400b-8aef-13c8d50de6d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:24.526753 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fcacb-79a2-400b-8aef-13c8d50de6d0 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:24.539197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 333/670] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:24.540029 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fcacb-79a2-400b-8aef-13c8d50de6d0 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:24.587342 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:24.630241 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ae4f1-e243-4037-ab20-77e6d9fd3824 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:24.656082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fcacb-79a2-400b-8aef-13c8d50de6d0 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:24.667120 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:24.670778 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89557226-7fb1-4c06-9fda-c8ef999ec54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:24.671153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89557226-7fb1-4c06-9fda-c8ef999ec54a None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:24.671438 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89557226-7fb1-4c06-9fda-c8ef999ec54a None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:24.671715 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89557226-7fb1-4c06-9fda-c8ef999ec54a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:24.672638 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89557226-7fb1-4c06-9fda-c8ef999ec54a None admin] RBAC: Adding query filter params (role.id=92c47f3813b04366b3019ba2a56337eb, scope.project.id=07652ced88cf4f069d1765176be5130b, user.id=40b236c66c184d3ca40c2069dc316664) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:24.672950 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89557226-7fb1-4c06-9fda-c8ef999ec54a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:24.676622 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89557226-7fb1-4c06-9fda-c8ef999ec54a None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:24.681364 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 338/671] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:36:24 2022] GET /identity/v3/role_assignments?user.id=40b236c66c184d3ca40c2069dc316664&scope.project.id=07652ced88cf4f069d1765176be5130b&role.id=92c47f3813b04366b3019ba2a56337eb => generated 610 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:24.682140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89557226-7fb1-4c06-9fda-c8ef999ec54a None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:24.711515 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae07883-19d0-412e-853b-2f88991438bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:24.712898 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae07883-19d0-412e-853b-2f88991438bb None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:24.714036 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae07883-19d0-412e-853b-2f88991438bb None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:24.714817 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae07883-19d0-412e-853b-2f88991438bb None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:24.716188 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae07883-19d0-412e-853b-2f88991438bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:24.716954 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae07883-19d0-412e-853b-2f88991438bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:24.719428 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae07883-19d0-412e-853b-2f88991438bb None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:24.738544 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 334/672] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:24.740444 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae07883-19d0-412e-853b-2f88991438bb None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:24.812949 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89557226-7fb1-4c06-9fda-c8ef999ec54a None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:24.847813 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:24.856627 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc68d6-174f-4e15-989a-d574aff9c454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:24.857666 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc68d6-174f-4e15-989a-d574aff9c454 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:24.858107 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc68d6-174f-4e15-989a-d574aff9c454 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:24.858623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc68d6-174f-4e15-989a-d574aff9c454 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:24.874770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc68d6-174f-4e15-989a-d574aff9c454 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:36:24.885977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-22dc68d6-174f-4e15-989a-d574aff9c454 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:24.885977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:24.885977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:24.885977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:24.885977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:24.885977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:24.885977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:24.885977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:24.885977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:24.885977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:24.885977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:24.885977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:24.885977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:36:24.885977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:36:24.885977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:36:24.885977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:36:24.887440 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:36:24.887440 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:36:24.887440 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:36:24.887440 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:36:24.887440 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:24.887440 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:24.887440 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:24.887440 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:24.887440 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:24.887440 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:24.887440 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:24.887440 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:24.887440 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:24.887440 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:24.887440 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:24.887440 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:24.888737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:24.888737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:24.888737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:24.888737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:24.888737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:36:24.888737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:36:24.888737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:36:24.888737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:36:24.888737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:36:24.888737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:36:24.888737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:24.888737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:24.889492 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae07883-19d0-412e-853b-2f88991438bb None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:24.891210 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 339/673] 10.222.0.119 () {56 vars in 1107 bytes} [Thu Jul 14 15:36:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:24.891620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc68d6-174f-4e15-989a-d574aff9c454 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:24.937810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85646737-a65c-454d-970a-4ccf313eb144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:24.939004 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85646737-a65c-454d-970a-4ccf313eb144 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:24.939488 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85646737-a65c-454d-970a-4ccf313eb144 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:24.939962 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85646737-a65c-454d-970a-4ccf313eb144 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:24.955319 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85646737-a65c-454d-970a-4ccf313eb144 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:24.962487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85646737-a65c-454d-970a-4ccf313eb144 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:24.979026 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-85646737-a65c-454d-970a-4ccf313eb144 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:24.979026 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:24.979026 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:24.979026 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:24.979026 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:24.979026 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:24.979026 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:24.979026 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:24.979026 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:24.979026 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:24.979026 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:24.979026 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:24.979026 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:36:24.979026 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:36:24.979026 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:36:24.979950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:36:24.979950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:24.979950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:24.979950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:24.979950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:24.979950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:24.979950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:24.979950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:24.979950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:24.979950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:24.979950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:24.979950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:24.979950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:24.979950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:24.979950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:24.979950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:24.979950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:24.980897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:36:24.980897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:36:24.980897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:36:24.980897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:36:24.980897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:36:24.980897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:36:24.980897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:24.980897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:24.980897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 335/674] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:24.981420 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85646737-a65c-454d-970a-4ccf313eb144 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:25.028488 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:25.039767 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc68d6-174f-4e15-989a-d574aff9c454 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:25.087554 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa09eef-658c-48ad-87ca-1ec4b1af6062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:25.088728 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa09eef-658c-48ad-87ca-1ec4b1af6062 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:25.089320 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa09eef-658c-48ad-87ca-1ec4b1af6062 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:25.089668 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa09eef-658c-48ad-87ca-1ec4b1af6062 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:25.100440 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85646737-a65c-454d-970a-4ccf313eb144 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:25.100602 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa09eef-658c-48ad-87ca-1ec4b1af6062 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:25.101976 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa09eef-658c-48ad-87ca-1ec4b1af6062 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:25.119387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-caa09eef-658c-48ad-87ca-1ec4b1af6062 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:25.119387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:25.119387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:25.119387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:25.119387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:25.119387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:25.119387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:25.119387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:25.119387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:25.119387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:25.119387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:25.119387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:25.119387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:36:25.119387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:36:25.119387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:36:25.120524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:36:25.120524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:25.120524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:25.120524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:25.120524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:25.120524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:25.120524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:25.120524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:25.120524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:25.120524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:25.120524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:25.120524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:25.120524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:25.120524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:25.120524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:25.120524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:25.120524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:25.121450 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:36:25.121450 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:36:25.121450 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:36:25.121450 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:36:25.121450 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:36:25.121450 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:36:25.121450 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:25.121450 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:25.121450 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 340/675] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:25.121947 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa09eef-658c-48ad-87ca-1ec4b1af6062 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:25.138260 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c5f3b-69f8-4cd9-8f4a-c32dcffefcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:25.138938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c5f3b-69f8-4cd9-8f4a-c32dcffefcb6 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:25.139539 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c5f3b-69f8-4cd9-8f4a-c32dcffefcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:25.139539 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c5f3b-69f8-4cd9-8f4a-c32dcffefcb6 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:25.140280 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c5f3b-69f8-4cd9-8f4a-c32dcffefcb6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:25.140594 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c5f3b-69f8-4cd9-8f4a-c32dcffefcb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:25.141963 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c5f3b-69f8-4cd9-8f4a-c32dcffefcb6 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:25.152166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 336/676] 10.222.0.119 () {56 vars in 1108 bytes} [Thu Jul 14 15:36:24 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:25.152349 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d93af1-9311-4deb-adbf-8fd6f355003c None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:25.152778 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d93af1-9311-4deb-adbf-8fd6f355003c None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:25.152904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d93af1-9311-4deb-adbf-8fd6f355003c None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:25.154375 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 337/677] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:25.155121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d93af1-9311-4deb-adbf-8fd6f355003c None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:25.179688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:25.232222 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa09eef-658c-48ad-87ca-1ec4b1af6062 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:25.267865 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:25.278216 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d93af1-9311-4deb-adbf-8fd6f355003c None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:25.279306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbf346-27a0-4268-88ef-c47a73b3d269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:25.279978 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbf346-27a0-4268-88ef-c47a73b3d269 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:25.280296 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbf346-27a0-4268-88ef-c47a73b3d269 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:25.281269 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbf346-27a0-4268-88ef-c47a73b3d269 None admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:25.281381 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddbf346-27a0-4268-88ef-c47a73b3d269 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:25.281678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddbf346-27a0-4268-88ef-c47a73b3d269 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:25.283097 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddbf346-27a0-4268-88ef-c47a73b3d269 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:25.295528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 341/678] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:36:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:25.297371 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbf346-27a0-4268-88ef-c47a73b3d269 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:25.316470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0e289-987c-4fcb-a15e-e2faaf873e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:25.317142 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0e289-987c-4fcb-a15e-e2faaf873e15 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:25.317435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0e289-987c-4fcb-a15e-e2faaf873e15 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:25.317708 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0e289-987c-4fcb-a15e-e2faaf873e15 None admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:25.318559 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0e289-987c-4fcb-a15e-e2faaf873e15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:25.319451 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0e289-987c-4fcb-a15e-e2faaf873e15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:25.320901 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0e289-987c-4fcb-a15e-e2faaf873e15 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:25.333250 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 338/679] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:36:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:25.334762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4758a0e-2fb2-4837-9d2c-77919cf18199 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:25.335070 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4758a0e-2fb2-4837-9d2c-77919cf18199 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:25.335355 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4758a0e-2fb2-4837-9d2c-77919cf18199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:25.352821 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-b4758a0e-2fb2-4837-9d2c-77919cf18199 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:25.353950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-b4758a0e-2fb2-4837-9d2c-77919cf18199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:25.419235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbf346-27a0-4268-88ef-c47a73b3d269 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:25.428931 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 339/680] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:25 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:36:25.430315 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4758a0e-2fb2-4837-9d2c-77919cf18199 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:25.440933 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:25.455785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56682a48-8add-4383-bb5d-3e359478f2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:25.456666 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56682a48-8add-4383-bb5d-3e359478f2c4 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:25.456953 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56682a48-8add-4383-bb5d-3e359478f2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:25.457233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56682a48-8add-4383-bb5d-3e359478f2c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:25.469048 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56682a48-8add-4383-bb5d-3e359478f2c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:25.470515 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56682a48-8add-4383-bb5d-3e359478f2c4 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:25.488761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-56682a48-8add-4383-bb5d-3e359478f2c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:25.488761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:25.488761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:25.488761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:25.488761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:25.488761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:25.488761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:25.488761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:25.488761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:25.488761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:25.488761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:25.488761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:25.488761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:25.488761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:25.488761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:25.489901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:25.489901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:25.489901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:25.489901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:25.489901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:25.489901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:25.489901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:25.489901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:25.489901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:25.489901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:25.489901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:25.489901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:25.489901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:25.489901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:25.489901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:25.489901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:25.489901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:25.491268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:25.491268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:25.491268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:25.491268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:25.491268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 342/681] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:25.491268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56682a48-8add-4383-bb5d-3e359478f2c4 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:25.546660 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:25.566677 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4758a0e-2fb2-4837-9d2c-77919cf18199 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:25.605319 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56682a48-8add-4383-bb5d-3e359478f2c4 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:25.607748 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd6661-a122-454f-833c-8c6c27511788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:25.608621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd6661-a122-454f-833c-8c6c27511788 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:25.608975 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd6661-a122-454f-833c-8c6c27511788 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:25.609259 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd6661-a122-454f-833c-8c6c27511788 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:25.610112 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd6661-a122-454f-833c-8c6c27511788 None admin] RBAC: Adding query filter params (role.id=92c47f3813b04366b3019ba2a56337eb, scope.project.id=07652ced88cf4f069d1765176be5130b, user.id=d96e2cb043e64d04b3f7628a3419a064) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:25.610433 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd6661-a122-454f-833c-8c6c27511788 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:25.611880 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd6661-a122-454f-833c-8c6c27511788 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:25.628134 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 340/682] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:36:25 2022] GET /identity/v3/role_assignments?user.id=d96e2cb043e64d04b3f7628a3419a064&scope.project.id=07652ced88cf4f069d1765176be5130b&role.id=92c47f3813b04366b3019ba2a56337eb => generated 610 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:25.628134 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd6661-a122-454f-833c-8c6c27511788 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:25.668219 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f51ce5-42af-440e-ac9c-c4e4d9b49f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:25.668957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f51ce5-42af-440e-ac9c-c4e4d9b49f43 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:25.669473 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f51ce5-42af-440e-ac9c-c4e4d9b49f43 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:25.669764 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f51ce5-42af-440e-ac9c-c4e4d9b49f43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:25.671401 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f51ce5-42af-440e-ac9c-c4e4d9b49f43 None admin] RBAC: Adding query filter params (role.id=92c47f3813b04366b3019ba2a56337eb, scope.project.id=07652ced88cf4f069d1765176be5130b, user.id=70559c2ce32043dd9a902837ab444622) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:25.671727 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f51ce5-42af-440e-ac9c-c4e4d9b49f43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:25.673975 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f51ce5-42af-440e-ac9c-c4e4d9b49f43 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:25.688358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 343/683] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:36:25 2022] GET /identity/v3/role_assignments?user.id=70559c2ce32043dd9a902837ab444622&scope.project.id=07652ced88cf4f069d1765176be5130b&role.id=92c47f3813b04366b3019ba2a56337eb => generated 610 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:25.689387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f51ce5-42af-440e-ac9c-c4e4d9b49f43 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:25.753873 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:25.811657 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd6661-a122-454f-833c-8c6c27511788 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:25.869444 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa29cf3-a431-41d5-9b92-0352995cacc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:25.870192 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa29cf3-a431-41d5-9b92-0352995cacc9 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:25.870475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa29cf3-a431-41d5-9b92-0352995cacc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:25.870751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa29cf3-a431-41d5-9b92-0352995cacc9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:25.871146 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f51ce5-42af-440e-ac9c-c4e4d9b49f43 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:25.886043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa29cf3-a431-41d5-9b92-0352995cacc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:36:25.898540 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-4fa29cf3-a431-41d5-9b92-0352995cacc9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:36:25.898540 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:25.898540 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:25.898540 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:25.898540 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:25.898540 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:25.898540 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:25.898540 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:25.898540 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:25.898540 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:25.898540 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:25.898540 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:25.898540 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:36:25.898540 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:36:25.898540 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:36:25.898540 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:36:25.899574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:36:25.899574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:36:25.899574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:36:25.899574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:36:25.899574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:25.899574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:25.899574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:25.899574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:25.899574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:25.899574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:25.899574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:25.899574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:25.899574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:25.899574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:25.899574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:25.899574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:25.900875 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:25.900875 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:25.900875 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:25.900875 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:25.900875 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:36:25.900875 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:36:25.900875 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:36:25.900875 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:36:25.900875 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:36:25.900875 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:36:25.900875 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:36:25.900875 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:25.900875 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 341/684] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:36:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:25.908712 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa29cf3-a431-41d5-9b92-0352995cacc9 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:25.919683 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b46a7-d7dd-48fa-91b2-7e748d88a73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:25.920157 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:25.920481 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b46a7-d7dd-48fa-91b2-7e748d88a73f None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:25.921151 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b46a7-d7dd-48fa-91b2-7e748d88a73f None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:25.921451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b46a7-d7dd-48fa-91b2-7e748d88a73f None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:25.922182 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b46a7-d7dd-48fa-91b2-7e748d88a73f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:25.922493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b46a7-d7dd-48fa-91b2-7e748d88a73f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:25.923916 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b46a7-d7dd-48fa-91b2-7e748d88a73f None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:25.937544 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 344/685] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:25.942989 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b46a7-d7dd-48fa-91b2-7e748d88a73f None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:26.042920 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa29cf3-a431-41d5-9b92-0352995cacc9 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:26.054233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:26.074435 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b46a7-d7dd-48fa-91b2-7e748d88a73f None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:26.088219 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23c8d8-b206-449f-bfb0-6cf6c7eb1b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:26.089173 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23c8d8-b206-449f-bfb0-6cf6c7eb1b2f None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:26.089606 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23c8d8-b206-449f-bfb0-6cf6c7eb1b2f None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:26.090039 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23c8d8-b206-449f-bfb0-6cf6c7eb1b2f None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:26.090945 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23c8d8-b206-449f-bfb0-6cf6c7eb1b2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:26.091767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23c8d8-b206-449f-bfb0-6cf6c7eb1b2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:26.094708 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23c8d8-b206-449f-bfb0-6cf6c7eb1b2f None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:26.105960 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 342/686] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:36:25 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:26.112264 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23c8d8-b206-449f-bfb0-6cf6c7eb1b2f None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:26.157631 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb744e06-6140-4c8a-8ef7-8e1c7600a877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:26.158359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb744e06-6140-4c8a-8ef7-8e1c7600a877 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:26.158649 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb744e06-6140-4c8a-8ef7-8e1c7600a877 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:26.158931 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb744e06-6140-4c8a-8ef7-8e1c7600a877 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:26.181783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb744e06-6140-4c8a-8ef7-8e1c7600a877 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:26.183981 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb744e06-6140-4c8a-8ef7-8e1c7600a877 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:26.212898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-fb744e06-6140-4c8a-8ef7-8e1c7600a877 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:36:26.212898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:26.212898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:26.212898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:26.212898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:26.212898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:26.212898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:26.212898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:26.212898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:26.212898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:26.212898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:26.212898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:26.212898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:36:26.212898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:36:26.212898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:36:26.212898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:36:26.213886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:26.213886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:26.213886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:26.213886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:26.213886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:26.213886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:26.213886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:26.213886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:26.213886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:26.213886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:26.213886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:26.213886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:26.213886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:26.213886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:26.213886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:26.213886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:26.213886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:26.213886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:26.214801 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:26.214801 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:26.214801 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:36:26.214801 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:36:26.214801 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:36:26.214801 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:36:26.214801 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:36:26.214801 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:36:26.214801 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:36:26.214801 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:26.215816 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 345/687] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:36:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:36:26.219860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb744e06-6140-4c8a-8ef7-8e1c7600a877 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:26.244541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:26.306283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23c8d8-b206-449f-bfb0-6cf6c7eb1b2f None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:26.368082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb17a8-8cb5-41ea-8bf1-e6a9b2d34c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:26.368918 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb17a8-8cb5-41ea-8bf1-e6a9b2d34c92 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:26.369209 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb17a8-8cb5-41ea-8bf1-e6a9b2d34c92 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:26.369490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb17a8-8cb5-41ea-8bf1-e6a9b2d34c92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:26.384269 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb17a8-8cb5-41ea-8bf1-e6a9b2d34c92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:26.385761 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb17a8-8cb5-41ea-8bf1-e6a9b2d34c92 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:26.404586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-3bdb17a8-8cb5-41ea-8bf1-e6a9b2d34c92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:26.404586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:26.404586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:26.404586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:26.404586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:26.404586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:26.404586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:26.404586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:26.404586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:26.404586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:26.404586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:26.404586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:26.404586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:26.404586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:26.404586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:26.405518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:26.405518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:26.405518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:26.405518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:26.405518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:26.405518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:26.405518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:26.405518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:26.405518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:26.405518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:26.405518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:26.405518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:26.405518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:26.405518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:26.405518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:26.405518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:26.405518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:26.406391 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:26.406391 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:26.406391 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:26.406391 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:26.410171 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb744e06-6140-4c8a-8ef7-8e1c7600a877 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:26.410377 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 343/688] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:26.411815 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb17a8-8cb5-41ea-8bf1-e6a9b2d34c92 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:26.486921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e906692-7a88-4c1a-88c3-0b06173562a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:26.487606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e906692-7a88-4c1a-88c3-0b06173562a6 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:26.487884 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e906692-7a88-4c1a-88c3-0b06173562a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:26.492511 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e906692-7a88-4c1a-88c3-0b06173562a6 None admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:26.492511 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e906692-7a88-4c1a-88c3-0b06173562a6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:26.492511 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e906692-7a88-4c1a-88c3-0b06173562a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:26.492511 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e906692-7a88-4c1a-88c3-0b06173562a6 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:26.531866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 346/689] 10.222.0.119 () {56 vars in 1140 bytes} [Thu Jul 14 15:36:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:26.537008 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e906692-7a88-4c1a-88c3-0b06173562a6 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:26.544946 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb17a8-8cb5-41ea-8bf1-e6a9b2d34c92 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:26.547106 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:26.568727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:26.583480 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf9186-d18e-4e68-aa71-5a85a4168454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:26.585214 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf9186-d18e-4e68-aa71-5a85a4168454 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:26.585742 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf9186-d18e-4e68-aa71-5a85a4168454 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:26.586226 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf9186-d18e-4e68-aa71-5a85a4168454 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:26.587158 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf9186-d18e-4e68-aa71-5a85a4168454 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:26.587682 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf9186-d18e-4e68-aa71-5a85a4168454 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:26.589756 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf9186-d18e-4e68-aa71-5a85a4168454 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:26.608207 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 344/690] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:26.610437 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf9186-d18e-4e68-aa71-5a85a4168454 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:26.719496 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf9186-d18e-4e68-aa71-5a85a4168454 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:26.757881 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12f1ee-d85f-41a1-a8c3-1e705cf407b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:26.759239 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12f1ee-d85f-41a1-a8c3-1e705cf407b1 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:26.759595 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12f1ee-d85f-41a1-a8c3-1e705cf407b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:26.760075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12f1ee-d85f-41a1-a8c3-1e705cf407b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:26.768215 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12f1ee-d85f-41a1-a8c3-1e705cf407b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:26.770127 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12f1ee-d85f-41a1-a8c3-1e705cf407b1 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:26.787123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-8c12f1ee-d85f-41a1-a8c3-1e705cf407b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:36:26.787123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:26.787123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:26.787123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:26.787123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:26.787123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:26.787123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:26.787123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:26.787123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:26.787123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:26.787123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:26.787123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:26.787123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:36:26.787123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:36:26.787123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:36:26.787123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:36:26.788472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:26.788472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:26.788472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:26.788472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:26.788472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:26.788472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:26.788472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:26.788472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:26.788472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:26.788472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:26.788472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:26.788472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:26.788472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:26.788472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:26.788472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:26.788472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:26.788472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:26.788472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:26.789507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:26.789507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:26.789507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:36:26.789507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:36:26.789507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:36:26.789507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:36:26.789507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:36:26.789507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:36:26.789507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:36:26.789507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:26.796445 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 345/691] 10.222.0.119 () {56 vars in 1098 bytes} [Thu Jul 14 15:36:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:26.798229 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12f1ee-d85f-41a1-a8c3-1e705cf407b1 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:26.848432 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:26.850531 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e906692-7a88-4c1a-88c3-0b06173562a6 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:26.908079 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12f1ee-d85f-41a1-a8c3-1e705cf407b1 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:26.946979 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f48785-c715-41c5-823b-e156b8b5b6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:26.948007 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f48785-c715-41c5-823b-e156b8b5b6af None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:26.948598 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f48785-c715-41c5-823b-e156b8b5b6af None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:26.949090 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f48785-c715-41c5-823b-e156b8b5b6af None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:26.950296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f48785-c715-41c5-823b-e156b8b5b6af None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:26.950827 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f48785-c715-41c5-823b-e156b8b5b6af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:26.952480 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f48785-c715-41c5-823b-e156b8b5b6af None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:26.976356 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 346/692] 10.222.0.119 () {56 vars in 1138 bytes} [Thu Jul 14 15:36:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:26.978832 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f48785-c715-41c5-823b-e156b8b5b6af None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:26.980870 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844a3bf-c6ef-4aee-b2b4-16b33426a02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:26.981549 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844a3bf-c6ef-4aee-b2b4-16b33426a02c None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:26.981838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844a3bf-c6ef-4aee-b2b4-16b33426a02c None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:26.982120 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844a3bf-c6ef-4aee-b2b4-16b33426a02c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:27.091393 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844a3bf-c6ef-4aee-b2b4-16b33426a02c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:27.093423 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844a3bf-c6ef-4aee-b2b4-16b33426a02c None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:27.097173 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:27.107155 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f48785-c715-41c5-823b-e156b8b5b6af None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:27.132572 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:27.156863 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b420f9-46c9-4a5a-9e51-96334fb24c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:27.158153 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b420f9-46c9-4a5a-9e51-96334fb24c8b None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:27.159036 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b420f9-46c9-4a5a-9e51-96334fb24c8b None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:27.159799 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b420f9-46c9-4a5a-9e51-96334fb24c8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:27.206435 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 347/693] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:36:26 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:27.208046 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af23a96-bbd4-4b61-8899-c77353f1d2b3 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:27.208473 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af23a96-bbd4-4b61-8899-c77353f1d2b3 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:27.208760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af23a96-bbd4-4b61-8899-c77353f1d2b3 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:27.215032 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 348/694] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:27.215941 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af23a96-bbd4-4b61-8899-c77353f1d2b3 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:27.257847 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b420f9-46c9-4a5a-9e51-96334fb24c8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:27.260857 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b420f9-46c9-4a5a-9e51-96334fb24c8b None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:27.347389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af23a96-bbd4-4b61-8899-c77353f1d2b3 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:27.350749 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:27.379345 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:27.385054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 347/695] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:36:26 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 15:36:27.389328 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0244401-5b40-47b5-b3a9-31711afd99b1 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:27.389328 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0244401-5b40-47b5-b3a9-31711afd99b1 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:27.389328 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0244401-5b40-47b5-b3a9-31711afd99b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:27.401328 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d6b0f-e280-4913-8811-0199cdb5a400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:27.402846 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d6b0f-e280-4913-8811-0199cdb5a400 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:27.403309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d6b0f-e280-4913-8811-0199cdb5a400 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:27.403759 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d6b0f-e280-4913-8811-0199cdb5a400 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:27.408501 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-f0244401-5b40-47b5-b3a9-31711afd99b1 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:27.409685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f0244401-5b40-47b5-b3a9-31711afd99b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:27.416718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d6b0f-e280-4913-8811-0199cdb5a400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:27.418950 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d6b0f-e280-4913-8811-0199cdb5a400 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:27.442359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-bf8d6b0f-e280-4913-8811-0199cdb5a400 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:27.442359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:27.442359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:27.442359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:27.442359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:27.442359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:27.442359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:27.442359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:27.442359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:27.442359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:27.442359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:27.442359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:27.442359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:27.442359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:27.442359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:27.443309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:27.443309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:27.443309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:27.443309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:27.443309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:27.443309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:27.443309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:27.443309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:27.443309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:27.443309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:27.443309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:27.443309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:27.443309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:27.443309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:27.443309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:27.443309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:27.443309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:27.444876 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:27.444876 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:27.444876 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:27.444876 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:27.448921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 349/696] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:27.449906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d6b0f-e280-4913-8811-0199cdb5a400 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:27.496782 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 348/697] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:36:27.498184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0244401-5b40-47b5-b3a9-31711afd99b1 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:27.569352 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d6b0f-e280-4913-8811-0199cdb5a400 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:27.605466 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0022f-e265-40a3-a664-35234e57ba3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:27.606272 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0022f-e265-40a3-a664-35234e57ba3c None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:27.606559 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0022f-e265-40a3-a664-35234e57ba3c None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:27.607053 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0022f-e265-40a3-a664-35234e57ba3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:27.620632 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0022f-e265-40a3-a664-35234e57ba3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:27.622215 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0244401-5b40-47b5-b3a9-31711afd99b1 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:27.623401 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0022f-e265-40a3-a664-35234e57ba3c None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:27.643760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-66f0022f-e265-40a3-a664-35234e57ba3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:27.643760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:27.643760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:27.643760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:27.643760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:27.643760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:27.643760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:27.643760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:27.643760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:27.643760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:27.643760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:27.643760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:27.643760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:27.643760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:27.643760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:27.644730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:27.644730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:27.644730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:27.644730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:27.644730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:27.644730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:27.644730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:27.644730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:27.644730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:27.644730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:27.644730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:27.644730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:27.644730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:27.644730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:27.644730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:27.644730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:27.644730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:27.646036 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:27.646036 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:27.646036 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:27.646036 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:27.646036 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 350/698] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:27.646310 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0022f-e265-40a3-a664-35234e57ba3c None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:27.659071 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:27.666296 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:27.671058 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2b3f3-d17e-4758-ae8c-c0a0e5110359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:27.672072 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2b3f3-d17e-4758-ae8c-c0a0e5110359 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:27.672647 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2b3f3-d17e-4758-ae8c-c0a0e5110359 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:27.673173 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2b3f3-d17e-4758-ae8c-c0a0e5110359 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:27.674163 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2b3f3-d17e-4758-ae8c-c0a0e5110359 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:27.674741 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2b3f3-d17e-4758-ae8c-c0a0e5110359 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:27.676417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2b3f3-d17e-4758-ae8c-c0a0e5110359 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:27.690169 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 349/699] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:27.691433 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2b3f3-d17e-4758-ae8c-c0a0e5110359 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:27.773306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0022f-e265-40a3-a664-35234e57ba3c None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:27.808987 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f93517-c6d8-4095-9e13-9eb489a295db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:27.809797 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f93517-c6d8-4095-9e13-9eb489a295db None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:27.810081 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f93517-c6d8-4095-9e13-9eb489a295db None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:27.810359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f93517-c6d8-4095-9e13-9eb489a295db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:27.811011 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2b3f3-d17e-4758-ae8c-c0a0e5110359 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:27.821997 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f93517-c6d8-4095-9e13-9eb489a295db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:27.823467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f93517-c6d8-4095-9e13-9eb489a295db None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:27.842956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-e0f93517-c6d8-4095-9e13-9eb489a295db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:27.842956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:27.842956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:27.842956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:27.842956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:27.842956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:27.842956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:27.842956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:27.842956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:27.842956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:27.842956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:27.842956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:27.842956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:27.842956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:27.842956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:27.843952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:27.843952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:27.843952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:27.843952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:27.843952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:27.843952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:27.843952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:27.843952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:27.843952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:27.843952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:27.843952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:27.843952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:27.843952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:27.843952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:27.843952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:27.843952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:27.843952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:27.845464 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:27.845464 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:27.845464 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:27.845464 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:27.848221 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 351/700] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:27.849251 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f93517-c6d8-4095-9e13-9eb489a295db None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:27.855242 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b793927-8f2c-4f07-9987-9ad3b1c19ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:27.856298 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b793927-8f2c-4f07-9987-9ad3b1c19ed6 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:27.856794 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b793927-8f2c-4f07-9987-9ad3b1c19ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:27.857282 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b793927-8f2c-4f07-9987-9ad3b1c19ed6 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:27.858316 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b793927-8f2c-4f07-9987-9ad3b1c19ed6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:27.858942 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b793927-8f2c-4f07-9987-9ad3b1c19ed6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:27.860622 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b793927-8f2c-4f07-9987-9ad3b1c19ed6 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:27.875112 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 350/701] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:27.876416 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b793927-8f2c-4f07-9987-9ad3b1c19ed6 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:27.917135 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:27.933343 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:27.958861 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f93517-c6d8-4095-9e13-9eb489a295db None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:27.987942 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b793927-8f2c-4f07-9987-9ad3b1c19ed6 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:27.996092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54487319-fdf0-4a09-81f6-c95a3767a98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:27.997050 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54487319-fdf0-4a09-81f6-c95a3767a98a None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:27.997441 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54487319-fdf0-4a09-81f6-c95a3767a98a None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:27.997823 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54487319-fdf0-4a09-81f6-c95a3767a98a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:28.005612 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54487319-fdf0-4a09-81f6-c95a3767a98a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:28.009890 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54487319-fdf0-4a09-81f6-c95a3767a98a None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:28.025063 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-54487319-fdf0-4a09-81f6-c95a3767a98a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:28.025063 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:28.025063 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:28.025063 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:28.025063 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:28.025063 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:28.025063 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:28.025063 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:28.025063 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:28.025063 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:28.025063 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:28.025063 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:28.025063 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:36:28.025063 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:36:28.025063 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:36:28.026032 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:36:28.026032 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:28.026032 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:28.026032 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:28.026032 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:28.026032 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:28.026032 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:28.026032 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:28.026032 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:28.026032 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:28.026032 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:28.026032 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:28.026032 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:28.026032 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:28.026032 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:28.026032 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:28.026032 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:28.026957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:36:28.026957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:36:28.026957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:36:28.026957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:36:28.026957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:36:28.026957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:36:28.026957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:28.026957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:28.031592 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 352/702] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:28.032601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54487319-fdf0-4a09-81f6-c95a3767a98a None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:28.034845 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e4dfa-3ed3-487b-a416-4d18f8d8dabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:28.035894 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e4dfa-3ed3-487b-a416-4d18f8d8dabc None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:28.036392 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e4dfa-3ed3-487b-a416-4d18f8d8dabc None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:28.036849 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e4dfa-3ed3-487b-a416-4d18f8d8dabc None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:28.038392 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e4dfa-3ed3-487b-a416-4d18f8d8dabc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:28.038897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e4dfa-3ed3-487b-a416-4d18f8d8dabc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:28.040556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e4dfa-3ed3-487b-a416-4d18f8d8dabc None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:28.054045 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 351/703] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:28.055243 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e4dfa-3ed3-487b-a416-4d18f8d8dabc None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:28.154200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54487319-fdf0-4a09-81f6-c95a3767a98a None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:28.163921 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e4dfa-3ed3-487b-a416-4d18f8d8dabc None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:28.173690 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:28.175686 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:28.191311 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8651490-f45b-45f9-ab26-3187a136cf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:28.192192 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8651490-f45b-45f9-ab26-3187a136cf68 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:28.192476 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8651490-f45b-45f9-ab26-3187a136cf68 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:28.192751 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8651490-f45b-45f9-ab26-3187a136cf68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:28.201762 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8651490-f45b-45f9-ab26-3187a136cf68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:28.202262 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b6bb0-7ee7-41b9-91ef-d4e69975c6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:28.203207 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8651490-f45b-45f9-ab26-3187a136cf68 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:28.203358 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b6bb0-7ee7-41b9-91ef-d4e69975c6d4 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:28.203854 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b6bb0-7ee7-41b9-91ef-d4e69975c6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:28.204319 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b6bb0-7ee7-41b9-91ef-d4e69975c6d4 None admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:28.205183 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b6bb0-7ee7-41b9-91ef-d4e69975c6d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:28.205460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b6bb0-7ee7-41b9-91ef-d4e69975c6d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:28.206888 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b6bb0-7ee7-41b9-91ef-d4e69975c6d4 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:28.218420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-c8651490-f45b-45f9-ab26-3187a136cf68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:28.218420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:28.218420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:28.218420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:28.218420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:28.218420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:28.218420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:28.218420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:28.218420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:28.218420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:28.218420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:28.218420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:28.218420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:36:28.218420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:36:28.218420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:36:28.219431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:36:28.219431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:28.219431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:28.219431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:28.219431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:28.219431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:28.219431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:28.219431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:28.219431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:28.219431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:28.219431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:28.219431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:28.219431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:28.219431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:28.219431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:28.219431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:28.219431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:28.220628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:36:28.220628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:36:28.220628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:36:28.220628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:36:28.220628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:36:28.220628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:36:28.220628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:28.220628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:28.220628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 353/704] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:28.221147 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 352/705] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:36:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:28.221698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c56e57-da5c-4c3d-870c-0d667338080d None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:28.221996 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c56e57-da5c-4c3d-870c-0d667338080d None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:28.222279 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c56e57-da5c-4c3d-870c-0d667338080d None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:28.228501 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 353/706] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:28.228501 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9e78a-79f9-4e05-85c3-d343cd88da72 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:28.228501 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9e78a-79f9-4e05-85c3-d343cd88da72 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:28.228801 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8651490-f45b-45f9-ab26-3187a136cf68 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:28.228888 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9e78a-79f9-4e05-85c3-d343cd88da72 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:28.228888 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 354/707] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:28.228888 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9e78a-79f9-4e05-85c3-d343cd88da72 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:28.327304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8651490-f45b-45f9-ab26-3187a136cf68 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:28.333985 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9e78a-79f9-4e05-85c3-d343cd88da72 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:28.361666 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed3c0d-2885-4754-8b4a-fa3d6faa161a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:28.362337 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed3c0d-2885-4754-8b4a-fa3d6faa161a None admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:28.362619 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed3c0d-2885-4754-8b4a-fa3d6faa161a None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:28.362891 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed3c0d-2885-4754-8b4a-fa3d6faa161a None admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:28.363590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed3c0d-2885-4754-8b4a-fa3d6faa161a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:28.365033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed3c0d-2885-4754-8b4a-fa3d6faa161a None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:28.367999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723499cb-3a0d-44eb-a0a2-4f2548316e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:28.368687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723499cb-3a0d-44eb-a0a2-4f2548316e86 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:28.368974 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723499cb-3a0d-44eb-a0a2-4f2548316e86 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:28.369252 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723499cb-3a0d-44eb-a0a2-4f2548316e86 None admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:28.370039 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723499cb-3a0d-44eb-a0a2-4f2548316e86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:28.370352 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723499cb-3a0d-44eb-a0a2-4f2548316e86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:28.371767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723499cb-3a0d-44eb-a0a2-4f2548316e86 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:28.384683 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 355/708] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:36:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:28.385499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723499cb-3a0d-44eb-a0a2-4f2548316e86 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:28.414790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:28.483474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 354/709] 10.222.0.119 () {60 vars in 1137 bytes} [Thu Jul 14 15:36:28 2022] POST /identity/v3/users => generated 255 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:28.484875 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65335770-8eb4-46be-8ddd-cb487ce4479a None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:28.485175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65335770-8eb4-46be-8ddd-cb487ce4479a None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:28.485457 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65335770-8eb4-46be-8ddd-cb487ce4479a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:28.494826 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723499cb-3a0d-44eb-a0a2-4f2548316e86 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:28.503296 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-65335770-8eb4-46be-8ddd-cb487ce4479a None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:28.504612 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-65335770-8eb4-46be-8ddd-cb487ce4479a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:28.535939 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870bf7a-8769-459f-8042-871c0cbbad1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:28.536782 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870bf7a-8769-459f-8042-871c0cbbad1b None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:28.537073 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870bf7a-8769-459f-8042-871c0cbbad1b None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:28.537858 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870bf7a-8769-459f-8042-871c0cbbad1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:28.538859 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870bf7a-8769-459f-8042-871c0cbbad1b None admin] RBAC: Adding query filter params (role.id=92c47f3813b04366b3019ba2a56337eb, scope.project.id=07652ced88cf4f069d1765176be5130b, user.id=28a5c169576e432c8174a562ae358e8b) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:28.539187 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870bf7a-8769-459f-8042-871c0cbbad1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:28.540726 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870bf7a-8769-459f-8042-871c0cbbad1b None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:28.547158 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 356/710] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:36:28 2022] GET /identity/v3/role_assignments?user.id=28a5c169576e432c8174a562ae358e8b&scope.project.id=07652ced88cf4f069d1765176be5130b&role.id=92c47f3813b04366b3019ba2a56337eb => generated 610 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:28.548487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b19036-b8fb-4642-9de6-2335e7514a04 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:28.548779 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b19036-b8fb-4642-9de6-2335e7514a04 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:28.549057 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b19036-b8fb-4642-9de6-2335e7514a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:28.567538 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-e8b19036-b8fb-4642-9de6-2335e7514a04 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:28.569621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-e8b19036-b8fb-4642-9de6-2335e7514a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:28.572396 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:28.624268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 355/711] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:36:28.625578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65335770-8eb4-46be-8ddd-cb487ce4479a None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:28.669262 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 357/712] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:36:28.670424 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b19036-b8fb-4642-9de6-2335e7514a04 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:28.700122 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:28.781091 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65335770-8eb4-46be-8ddd-cb487ce4479a None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:28.815498 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b19036-b8fb-4642-9de6-2335e7514a04 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:28.827956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96fb10-5867-4767-85ad-c3111f38e976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:28.828678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96fb10-5867-4767-85ad-c3111f38e976 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:28.829863 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96fb10-5867-4767-85ad-c3111f38e976 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:28.829863 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96fb10-5867-4767-85ad-c3111f38e976 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:28.830055 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96fb10-5867-4767-85ad-c3111f38e976 None admin] RBAC: Adding query filter params (role.id=07aaf007cde043318319928d151bdc75, scope.project.id=07652ced88cf4f069d1765176be5130b, user.id=a1e4c833a4684561ab52eda5734a7766) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:28.830365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96fb10-5867-4767-85ad-c3111f38e976 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:28.831790 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96fb10-5867-4767-85ad-c3111f38e976 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:28.843023 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 356/713] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:36:28 2022] GET /identity/v3/role_assignments?user.id=a1e4c833a4684561ab52eda5734a7766&scope.project.id=07652ced88cf4f069d1765176be5130b&role.id=07aaf007cde043318319928d151bdc75 => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:28.844087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96fb10-5867-4767-85ad-c3111f38e976 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:28.859383 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80232db6-4638-4d76-bdd9-e074b76a9f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:28.860332 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80232db6-4638-4d76-bdd9-e074b76a9f24 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:28.860620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80232db6-4638-4d76-bdd9-e074b76a9f24 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:28.860896 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80232db6-4638-4d76-bdd9-e074b76a9f24 None admin] PATH_INFO: `/v3/services/network` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:28.861567 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80232db6-4638-4d76-bdd9-e074b76a9f24 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:28.862963 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80232db6-4638-4d76-bdd9-e074b76a9f24 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:28.884895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-80232db6-4638-4d76-bdd9-e074b76a9f24 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 15:36:28.884895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:28.884895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:36:28.884895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:36:28.884895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:36:28.884895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:36:28.884895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:36:28.884895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:28.884895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 15:36:28.884895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:28.884895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:36:28.884895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:28.884895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:28.884895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:28.884895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:28.884895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:28.884895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:28.886199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:28.886199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:28.886199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:28.886199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:28.886199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:28.886199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:28.886199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:36:28.886199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:36:28.886199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:36:28.886199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:36:28.886199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:28.886199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:28.886199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:28.886199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:28.886199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:28.886199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:28.887212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:28.887212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:28.887212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:28.887212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:28.887212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:28.887212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:28.887212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:28.887212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:28.887212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:28.887212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:28.887212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:36:28.887212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:28.887212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 15:36:28.887212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:28.887212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 358/714] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:28 2022] GET /identity/v3/services/network => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:28.894623 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80232db6-4638-4d76-bdd9-e074b76a9f24 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:28.895461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:28.992635 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96fb10-5867-4767-85ad-c3111f38e976 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:29.021459 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:29.054663 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80232db6-4638-4d76-bdd9-e074b76a9f24 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:29.069439 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bc39e-7300-46b7-8c98-a0eea2daa215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:29.070501 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bc39e-7300-46b7-8c98-a0eea2daa215 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:29.070912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bc39e-7300-46b7-8c98-a0eea2daa215 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:29.071387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bc39e-7300-46b7-8c98-a0eea2daa215 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:29.072300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bc39e-7300-46b7-8c98-a0eea2daa215 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:29.073770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bc39e-7300-46b7-8c98-a0eea2daa215 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:29.094961 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915878f8-83f8-4a03-8834-496755f8cf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:29.095631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915878f8-83f8-4a03-8834-496755f8cf07 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:29.095916 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915878f8-83f8-4a03-8834-496755f8cf07 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:29.096223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915878f8-83f8-4a03-8834-496755f8cf07 None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:29.096944 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915878f8-83f8-4a03-8834-496755f8cf07 None admin] RBAC: Adding query filter params (name=network) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:29.097254 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915878f8-83f8-4a03-8834-496755f8cf07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:29.098640 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915878f8-83f8-4a03-8834-496755f8cf07 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:29.104856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 359/715] 10.222.0.119 () {56 vars in 1117 bytes} [Thu Jul 14 15:36:28 2022] GET /identity/v3/services?name=network => generated 125 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:29.107394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-809bc39e-7300-46b7-8c98-a0eea2daa215 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 15:36:29.107394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:29.107394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:36:29.107394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:36:29.107394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:36:29.107394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:36:29.107394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:36:29.107394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:29.107394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 15:36:29.107394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:29.107394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:36:29.107394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:29.107394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:29.107394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:29.107394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:29.107394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:29.108568 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:29.108568 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:29.108568 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:29.108568 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:29.108568 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:29.108568 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:29.108568 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:29.108568 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:36:29.108568 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:36:29.108568 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:36:29.108568 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:36:29.108568 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:29.108568 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:29.108568 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:29.108568 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:29.108568 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:29.109602 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:29.109602 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:29.109602 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:29.109602 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:29.109602 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:29.109602 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:29.109602 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:29.109602 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:29.109602 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:29.109602 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:29.109602 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:29.109602 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:36:29.109602 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:29.109602 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 15:36:29.109602 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:29.110594 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915878f8-83f8-4a03-8834-496755f8cf07 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:29.116198 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 357/716] 10.222.0.119 () {56 vars in 1134 bytes} [Thu Jul 14 15:36:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:29.118414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bc39e-7300-46b7-8c98-a0eea2daa215 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:29.251146 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915878f8-83f8-4a03-8834-496755f8cf07 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:29.292495 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec51322-72d0-4a13-8a7c-79644e76483c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:29.293494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec51322-72d0-4a13-8a7c-79644e76483c None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:29.293906 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec51322-72d0-4a13-8a7c-79644e76483c None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:29.294210 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec51322-72d0-4a13-8a7c-79644e76483c None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:29.295043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec51322-72d0-4a13-8a7c-79644e76483c None admin] RBAC: Adding query filter params (type=network) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:29.295362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec51322-72d0-4a13-8a7c-79644e76483c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:29.296951 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec51322-72d0-4a13-8a7c-79644e76483c None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:29.303777 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 360/717] 10.222.0.119 () {56 vars in 1117 bytes} [Thu Jul 14 15:36:29 2022] GET /identity/v3/services?type=network => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:29.333111 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bc39e-7300-46b7-8c98-a0eea2daa215 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:29.336498 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:29.381033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b50eb-b013-46d0-b549-890d48e37f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:29.382414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b50eb-b013-46d0-b549-890d48e37f63 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:29.382705 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b50eb-b013-46d0-b549-890d48e37f63 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:29.382989 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b50eb-b013-46d0-b549-890d48e37f63 None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:29.383736 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b50eb-b013-46d0-b549-890d48e37f63 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:29.384050 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b50eb-b013-46d0-b549-890d48e37f63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:29.385536 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b50eb-b013-46d0-b549-890d48e37f63 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:29.391351 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 358/718] 10.222.0.119 () {56 vars in 1129 bytes} [Thu Jul 14 15:36:29 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:29.397864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec51322-72d0-4a13-8a7c-79644e76483c None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:29.427331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:29.550102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec51322-72d0-4a13-8a7c-79644e76483c None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:29.586798 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02398a1-80b2-4e17-94f8-37c4db196fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:29.587478 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02398a1-80b2-4e17-94f8-37c4db196fe5 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:29.587761 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02398a1-80b2-4e17-94f8-37c4db196fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:29.588038 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02398a1-80b2-4e17-94f8-37c4db196fe5 None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:29.588781 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02398a1-80b2-4e17-94f8-37c4db196fe5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:29.589091 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02398a1-80b2-4e17-94f8-37c4db196fe5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:29.590463 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02398a1-80b2-4e17-94f8-37c4db196fe5 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:29.595932 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 361/719] 10.222.0.119 () {56 vars in 1129 bytes} [Thu Jul 14 15:36:29 2022] GET /identity/v3/services?type=block-storage => generated 131 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:30.996446 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f55b9-16c1-4ce6-989e-b21073858908 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:30.996971 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f55b9-16c1-4ce6-989e-b21073858908 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:30.997050 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f55b9-16c1-4ce6-989e-b21073858908 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:30.998714 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 359/720] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:31.003673 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82285b0b-62b9-4ab3-986e-52d53fb10506 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:31.004083 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82285b0b-62b9-4ab3-986e-52d53fb10506 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:31.004283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82285b0b-62b9-4ab3-986e-52d53fb10506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:31.029108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-82285b0b-62b9-4ab3-986e-52d53fb10506 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:31.030316 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-82285b0b-62b9-4ab3-986e-52d53fb10506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:31.126786 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 362/721] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:36:31.166286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f55b9-16c1-4ce6-989e-b21073858908 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:31.272562 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd91974-9047-4328-9cfc-24dd6c12ed84 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:31.272864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd91974-9047-4328-9cfc-24dd6c12ed84 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:31.273146 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd91974-9047-4328-9cfc-24dd6c12ed84 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:31.274790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 363/722] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:31 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:36:31.279836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457996c-8232-4955-842d-0ee9d3ef8adf None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:31.280146 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457996c-8232-4955-842d-0ee9d3ef8adf None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:31.280428 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457996c-8232-4955-842d-0ee9d3ef8adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:31.299013 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-f457996c-8232-4955-842d-0ee9d3ef8adf None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:31.300229 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f457996c-8232-4955-842d-0ee9d3ef8adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:31.300572 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f55b9-16c1-4ce6-989e-b21073858908 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:31.302274 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:31.344450 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8d959-6ef4-444c-b9b5-4d8fb9cdec8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:31.346694 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8d959-6ef4-444c-b9b5-4d8fb9cdec8c None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:31.347203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8d959-6ef4-444c-b9b5-4d8fb9cdec8c None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:31.347711 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8d959-6ef4-444c-b9b5-4d8fb9cdec8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:31.361593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8d959-6ef4-444c-b9b5-4d8fb9cdec8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:36:31.372620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-9dd8d959-6ef4-444c-b9b5-4d8fb9cdec8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:31.372620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:31.372620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:31.372620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:31.372620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:31.372620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:31.372620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:31.372620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:31.372620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:31.372620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:31.372620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:31.372620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:31.372620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:36:31.372620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:36:31.372620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:36:31.372620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:36:31.373580 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:36:31.373580 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:36:31.373580 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:36:31.373580 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:36:31.373580 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:31.373580 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:31.373580 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:31.373580 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:31.373580 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:31.373580 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:31.373580 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:31.373580 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:31.373580 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:31.373580 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:31.373580 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:31.373580 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:31.374423 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:31.374423 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:31.374423 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:31.374423 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:31.374423 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:36:31.374423 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:36:31.374423 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:36:31.374423 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:36:31.374423 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:36:31.374423 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:36:31.374423 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:31.374423 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:31.383162 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 360/723] 10.222.0.119 () {56 vars in 1107 bytes} [Thu Jul 14 15:36:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:31.383162 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda95954-065f-4998-aff7-bc69e4015629 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:31.383162 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda95954-065f-4998-aff7-bc69e4015629 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:31.383162 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda95954-065f-4998-aff7-bc69e4015629 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:31.384254 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 361/724] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:31.384778 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda95954-065f-4998-aff7-bc69e4015629 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:31.391043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 364/725] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:36:31.400727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b05e4-526c-465a-850b-cbe54a5f0d0a None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:31.402600 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b05e4-526c-465a-850b-cbe54a5f0d0a None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:31.403098 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b05e4-526c-465a-850b-cbe54a5f0d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:31.426715 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-4b0b05e4-526c-465a-850b-cbe54a5f0d0a None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:31.428123 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:31.429988 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-4b0b05e4-526c-465a-850b-cbe54a5f0d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:31.509186 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 365/726] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:36:31.510405 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b05e4-526c-465a-850b-cbe54a5f0d0a None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:31.521541 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda95954-065f-4998-aff7-bc69e4015629 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:31.557710 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57194e9c-3ae1-41d8-bdbf-9067f3d2ff4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:31.558742 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57194e9c-3ae1-41d8-bdbf-9067f3d2ff4b None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:31.559170 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57194e9c-3ae1-41d8-bdbf-9067f3d2ff4b None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:31.559634 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57194e9c-3ae1-41d8-bdbf-9067f3d2ff4b None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:31.560726 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57194e9c-3ae1-41d8-bdbf-9067f3d2ff4b None admin] RBAC: Adding query filter params (name=service) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:31.561212 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57194e9c-3ae1-41d8-bdbf-9067f3d2ff4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:31.562849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57194e9c-3ae1-41d8-bdbf-9067f3d2ff4b None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:31.572748 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 362/727] 10.222.0.119 () {56 vars in 1108 bytes} [Thu Jul 14 15:36:31 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:31.573823 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57194e9c-3ae1-41d8-bdbf-9067f3d2ff4b None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:31.594565 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:31.641157 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b05e4-526c-465a-850b-cbe54a5f0d0a None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:31.682945 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:31.689530 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f3fbb-d1b4-4789-ae45-2ec478904af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:31.690350 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f3fbb-d1b4-4789-ae45-2ec478904af0 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:31.690646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f3fbb-d1b4-4789-ae45-2ec478904af0 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:31.690930 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f3fbb-d1b4-4789-ae45-2ec478904af0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:31.704704 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57194e9c-3ae1-41d8-bdbf-9067f3d2ff4b None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:31.705073 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f3fbb-d1b4-4789-ae45-2ec478904af0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:36:31.715491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-534f3fbb-d1b4-4789-ae45-2ec478904af0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:36:31.715491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:31.715491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:31.715491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:31.715491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:31.715491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:31.715491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:31.715491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:31.715491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:31.715491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:31.715491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:31.715491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:31.715491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:36:31.715491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:36:31.715491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:36:31.715491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:36:31.716490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:36:31.716490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:36:31.716490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:36:31.716490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:36:31.716490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:31.716490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:31.716490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:31.716490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:31.716490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:31.716490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:31.716490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:31.716490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:31.716490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:31.716490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:31.716490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:31.716490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:31.717627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:31.717627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:31.717627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:31.717627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:31.717627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:36:31.717627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:36:31.717627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:36:31.717627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:36:31.717627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:36:31.717627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:36:31.717627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:36:31.717627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:31.720179 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 366/728] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:36:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:31.721193 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f3fbb-d1b4-4789-ae45-2ec478904af0 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:31.755755 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67bc17-02d4-4089-8e6b-c3310398b145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:31.756981 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67bc17-02d4-4089-8e6b-c3310398b145 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:31.757204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67bc17-02d4-4089-8e6b-c3310398b145 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:31.757497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67bc17-02d4-4089-8e6b-c3310398b145 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:31.775717 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67bc17-02d4-4089-8e6b-c3310398b145 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:36:31.783974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-6f67bc17-02d4-4089-8e6b-c3310398b145 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:36:31.783974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:31.783974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:31.783974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:31.783974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:31.783974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:31.783974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:31.783974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:31.783974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:31.783974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:31.783974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:31.783974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:31.783974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:36:31.783974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:36:31.783974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:36:31.783974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:36:31.785105 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:36:31.785105 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:36:31.785105 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:36:31.785105 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:36:31.785105 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:31.785105 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:31.785105 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:31.785105 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:31.785105 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:31.785105 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:31.785105 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:31.785105 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:31.785105 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:31.785105 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:31.785105 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:31.785105 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:31.786352 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:31.786352 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:31.786352 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:31.786352 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:31.786352 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:36:31.786352 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:36:31.786352 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:36:31.786352 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:36:31.786352 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:36:31.786352 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:36:31.786352 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:36:31.786352 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:31.786352 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 363/729] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:36:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:31.787239 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67bc17-02d4-4089-8e6b-c3310398b145 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:31.862048 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f3fbb-d1b4-4789-ae45-2ec478904af0 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:31.891083 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:31.900074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978dd57-b598-4150-aadf-3cc2ceaa9bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:31.900853 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978dd57-b598-4150-aadf-3cc2ceaa9bcb None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:31.901141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978dd57-b598-4150-aadf-3cc2ceaa9bcb None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:31.901478 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978dd57-b598-4150-aadf-3cc2ceaa9bcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:31.912707 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978dd57-b598-4150-aadf-3cc2ceaa9bcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:31.914260 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978dd57-b598-4150-aadf-3cc2ceaa9bcb None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:31.919430 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67bc17-02d4-4089-8e6b-c3310398b145 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:31.933946 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-1978dd57-b598-4150-aadf-3cc2ceaa9bcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:31.933946 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:31.933946 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:31.933946 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:31.933946 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:31.933946 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:31.933946 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:31.933946 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:31.933946 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:31.933946 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:31.933946 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:31.933946 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:31.933946 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:31.933946 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:31.933946 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:31.934911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:31.934911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:31.934911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:31.934911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:31.934911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:31.934911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:31.934911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:31.934911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:31.934911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:31.934911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:31.934911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:31.934911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:31.934911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:31.934911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:31.934911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:31.934911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:31.934911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:31.935831 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:31.935831 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:31.935831 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:31.935831 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:31.939837 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 367/730] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:31.940767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978dd57-b598-4150-aadf-3cc2ceaa9bcb None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:31.965660 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c78aa4-9252-475a-870b-6d5db32283ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:31.967282 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c78aa4-9252-475a-870b-6d5db32283ab None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:31.968011 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c78aa4-9252-475a-870b-6d5db32283ab None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:31.968470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c78aa4-9252-475a-870b-6d5db32283ab None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:31.969530 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c78aa4-9252-475a-870b-6d5db32283ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:31.970282 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c78aa4-9252-475a-870b-6d5db32283ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:31.972231 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c78aa4-9252-475a-870b-6d5db32283ab None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:31.987293 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 364/731] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:36:31 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:31.987293 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c78aa4-9252-475a-870b-6d5db32283ab None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:31.987293 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:32.057600 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978dd57-b598-4150-aadf-3cc2ceaa9bcb None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:32.094098 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f7884-3bc8-4d80-8884-6a1d543462c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:32.094692 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c78aa4-9252-475a-870b-6d5db32283ab None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:32.095721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f7884-3bc8-4d80-8884-6a1d543462c4 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:32.096354 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f7884-3bc8-4d80-8884-6a1d543462c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:32.096976 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f7884-3bc8-4d80-8884-6a1d543462c4 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:32.097818 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f7884-3bc8-4d80-8884-6a1d543462c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:32.098138 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f7884-3bc8-4d80-8884-6a1d543462c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:32.099611 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f7884-3bc8-4d80-8884-6a1d543462c4 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:32.114638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 368/732] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:36:31 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:32.114638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d4b68-9084-4446-b5f3-fa1f80cde343 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:32.114638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d4b68-9084-4446-b5f3-fa1f80cde343 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:32.114638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d4b68-9084-4446-b5f3-fa1f80cde343 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:32.114638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 369/733] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:32.114638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d4b68-9084-4446-b5f3-fa1f80cde343 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:32.138574 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538fb22-c6ff-4874-a51d-97b6bfe85948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:32.139252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538fb22-c6ff-4874-a51d-97b6bfe85948 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:32.139543 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538fb22-c6ff-4874-a51d-97b6bfe85948 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:32.139822 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538fb22-c6ff-4874-a51d-97b6bfe85948 None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:32.140591 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538fb22-c6ff-4874-a51d-97b6bfe85948 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:32.140900 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538fb22-c6ff-4874-a51d-97b6bfe85948 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:32.142282 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538fb22-c6ff-4874-a51d-97b6bfe85948 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:32.154838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 365/734] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:32.156006 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538fb22-c6ff-4874-a51d-97b6bfe85948 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:32.182298 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:32.230895 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:32.244762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d4b68-9084-4446-b5f3-fa1f80cde343 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:32.274727 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538fb22-c6ff-4874-a51d-97b6bfe85948 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:32.280737 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df3290-2c46-4744-86b2-d80e46e20831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:32.281544 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df3290-2c46-4744-86b2-d80e46e20831 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:32.281832 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df3290-2c46-4744-86b2-d80e46e20831 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:32.282113 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df3290-2c46-4744-86b2-d80e46e20831 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:32.293686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df3290-2c46-4744-86b2-d80e46e20831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:32.295149 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df3290-2c46-4744-86b2-d80e46e20831 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:32.312432 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a99688-5317-40db-ba52-923b31827d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:32.313243 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a99688-5317-40db-ba52-923b31827d1b None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:32.313534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a99688-5317-40db-ba52-923b31827d1b None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:32.313731 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-80df3290-2c46-4744-86b2-d80e46e20831 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:32.313731 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:32.313731 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:32.313731 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:32.313731 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:32.313731 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:32.313731 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:32.313731 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:32.313731 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:32.313731 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:32.313731 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:32.313731 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:32.313731 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:32.313731 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:32.313731 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:32.314630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:32.314630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:32.314630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:32.314630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:32.314630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:32.314630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:32.314630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:32.314630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:32.314630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:32.314630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:32.314630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:32.314630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:32.314630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:32.314630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:32.314630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:32.314630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:32.314630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:32.315605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:32.315605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:32.315605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:32.315605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:32.315833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a99688-5317-40db-ba52-923b31827d1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:32.319672 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 370/735] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:32.320924 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62511f53-f0f9-48af-99af-4335870db9b6 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:32.321222 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62511f53-f0f9-48af-99af-4335870db9b6 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:32.321508 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62511f53-f0f9-48af-99af-4335870db9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:32.328048 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a99688-5317-40db-ba52-923b31827d1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:32.329546 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a99688-5317-40db-ba52-923b31827d1b None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:32.338124 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-62511f53-f0f9-48af-99af-4335870db9b6 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:32.339312 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-62511f53-f0f9-48af-99af-4335870db9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:32.348777 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-70a99688-5317-40db-ba52-923b31827d1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:32.348777 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:32.348777 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:32.348777 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:32.348777 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:32.348777 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:32.348777 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:32.348777 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:32.348777 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:32.348777 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:32.348777 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:32.348777 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:32.348777 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:32.348777 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:32.348777 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:32.349684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:32.349684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:32.349684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:32.349684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:32.349684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:32.349684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:32.349684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:32.349684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:32.349684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:32.349684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:32.349684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:32.349684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:32.349684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:32.349684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:32.349684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:32.349684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:32.349684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:32.351701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:32.351701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:32.351701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:32.351701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:32.351701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 366/736] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:32.351701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a99688-5317-40db-ba52-923b31827d1b None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:32.414071 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 371/737] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:36:32.414845 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62511f53-f0f9-48af-99af-4335870db9b6 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:32.440547 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:32.466404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a99688-5317-40db-ba52-923b31827d1b None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:32.481897 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:32.502487 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ce0d6-ec64-494e-8a32-7989e3d65bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:32.503304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ce0d6-ec64-494e-8a32-7989e3d65bc4 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:32.503589 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ce0d6-ec64-494e-8a32-7989e3d65bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:32.503866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ce0d6-ec64-494e-8a32-7989e3d65bc4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:32.515408 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ce0d6-ec64-494e-8a32-7989e3d65bc4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:32.516974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ce0d6-ec64-494e-8a32-7989e3d65bc4 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:32.520041 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62511f53-f0f9-48af-99af-4335870db9b6 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:32.533497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-955ce0d6-ec64-494e-8a32-7989e3d65bc4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:36:32.533497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:32.533497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:32.533497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:32.533497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:32.533497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:32.533497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:32.533497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:32.533497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:32.533497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:32.533497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:32.533497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:32.533497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:36:32.533497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:36:32.533497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:36:32.533497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:36:32.534456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:32.534456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:32.534456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:32.534456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:32.534456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:32.534456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:32.534456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:32.534456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:32.534456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:32.534456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:32.534456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:32.534456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:32.534456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:32.534456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:32.534456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:32.534456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:32.534456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:32.534456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:32.535365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:32.535365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:32.535365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:36:32.535365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:36:32.535365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:36:32.535365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:36:32.535365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:36:32.535365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:36:32.535365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:36:32.535365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:32.535365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 367/738] 10.222.0.119 () {56 vars in 1122 bytes} [Thu Jul 14 15:36:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:32.536028 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ce0d6-ec64-494e-8a32-7989e3d65bc4 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:32.556835 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e20ae-2103-4196-8989-bf6093519d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:32.557509 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e20ae-2103-4196-8989-bf6093519d91 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:32.557802 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e20ae-2103-4196-8989-bf6093519d91 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:32.558087 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e20ae-2103-4196-8989-bf6093519d91 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:32.558819 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e20ae-2103-4196-8989-bf6093519d91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:32.559135 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e20ae-2103-4196-8989-bf6093519d91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:32.560575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e20ae-2103-4196-8989-bf6093519d91 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:32.572747 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 372/739] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:32.573990 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30176dd4-255e-40b9-9c6a-3c73ce7f1134 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:32.574280 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30176dd4-255e-40b9-9c6a-3c73ce7f1134 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:32.574558 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30176dd4-255e-40b9-9c6a-3c73ce7f1134 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:32.575907 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 373/740] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:32 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:32.576470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30176dd4-255e-40b9-9c6a-3c73ce7f1134 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:32.640931 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ce0d6-ec64-494e-8a32-7989e3d65bc4 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:32.662273 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:32.674408 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd11e79-9402-4ac4-9402-f401045f75c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:32.675036 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd11e79-9402-4ac4-9402-f401045f75c9 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:32.675323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd11e79-9402-4ac4-9402-f401045f75c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:32.675598 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd11e79-9402-4ac4-9402-f401045f75c9 None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:32.676339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd11e79-9402-4ac4-9402-f401045f75c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:32.676647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd11e79-9402-4ac4-9402-f401045f75c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:32.678004 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd11e79-9402-4ac4-9402-f401045f75c9 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:32.679067 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30176dd4-255e-40b9-9c6a-3c73ce7f1134 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:32.689985 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 368/741] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:32.690776 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd11e79-9402-4ac4-9402-f401045f75c9 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:32.719604 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0199197-6ff8-45f8-9c71-1f8f6843c315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:32.720312 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0199197-6ff8-45f8-9c71-1f8f6843c315 None admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:32.720599 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0199197-6ff8-45f8-9c71-1f8f6843c315 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:32.720875 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0199197-6ff8-45f8-9c71-1f8f6843c315 None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:32.721589 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0199197-6ff8-45f8-9c71-1f8f6843c315 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:32.722950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0199197-6ff8-45f8-9c71-1f8f6843c315 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:32.724328 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:32.789871 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd11e79-9402-4ac4-9402-f401045f75c9 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:32.823921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30189dad-b2e5-425c-a91a-937600fc904a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:32.824624 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30189dad-b2e5-425c-a91a-937600fc904a None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:32.824917 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30189dad-b2e5-425c-a91a-937600fc904a None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:32.825201 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30189dad-b2e5-425c-a91a-937600fc904a None admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:32.826042 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30189dad-b2e5-425c-a91a-937600fc904a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:32.826361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30189dad-b2e5-425c-a91a-937600fc904a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:32.827899 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30189dad-b2e5-425c-a91a-937600fc904a None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:32.845859 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 369/742] 10.222.0.119 () {56 vars in 1154 bytes} [Thu Jul 14 15:36:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:32.846647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30189dad-b2e5-425c-a91a-937600fc904a None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:32.864142 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 374/743] 10.222.0.119 () {60 vars in 1146 bytes} [Thu Jul 14 15:36:32 2022] POST /identity/v3/services => generated 241 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:32.864142 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d90d8e-ae6b-40a1-b707-d2861b88980e None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:32.864142 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d90d8e-ae6b-40a1-b707-d2861b88980e None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:32.864142 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d90d8e-ae6b-40a1-b707-d2861b88980e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:32.883329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-22d90d8e-ae6b-40a1-b707-d2861b88980e None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:32.884616 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-22d90d8e-ae6b-40a1-b707-d2861b88980e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:32.962127 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:32.967163 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 375/744] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:32 2022] POST /identity/v3/auth/tokens => generated 899 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:36:32.968035 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d90d8e-ae6b-40a1-b707-d2861b88980e None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:32.987069 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30189dad-b2e5-425c-a91a-937600fc904a None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:33.033405 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af45493-8d7e-4477-8790-3bcc5b7cccec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:33.034217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af45493-8d7e-4477-8790-3bcc5b7cccec None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:33.034505 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af45493-8d7e-4477-8790-3bcc5b7cccec None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:33.034785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af45493-8d7e-4477-8790-3bcc5b7cccec None admin] PATH_INFO: `/v3/users/swift` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:33.044164 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af45493-8d7e-4477-8790-3bcc5b7cccec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:33.045643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af45493-8d7e-4477-8790-3bcc5b7cccec None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:33.061294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-8af45493-8d7e-4477-8790-3bcc5b7cccec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:36:33.061294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:33.061294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:33.061294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:33.061294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:33.061294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:33.061294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:33.061294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:33.061294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:33.061294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:33.061294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:33.061294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:33.061294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:36:33.061294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:36:33.061294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:36:33.061294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:36:33.062480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:33.062480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:33.062480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:33.062480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:33.062480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:33.062480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:33.062480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:33.062480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:33.062480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:33.062480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:33.062480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:33.062480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:33.062480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:33.062480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:33.062480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:33.062480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:33.062480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:33.062480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:33.063607 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:33.063607 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:33.063607 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:36:33.063607 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:36:33.063607 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:36:33.063607 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:36:33.063607 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:36:33.063607 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:36:33.063607 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:36:33.063607 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:33.063607 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 370/745] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:36:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:33.063607 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af45493-8d7e-4477-8790-3bcc5b7cccec None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:33.065870 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:33.100787 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d90d8e-ae6b-40a1-b707-d2861b88980e None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:33.138549 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62cb10-8009-43e8-b03c-ac588382d509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:33.139354 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62cb10-8009-43e8-b03c-ac588382d509 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:33.139643 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62cb10-8009-43e8-b03c-ac588382d509 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:33.139921 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62cb10-8009-43e8-b03c-ac588382d509 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:33.147968 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62cb10-8009-43e8-b03c-ac588382d509 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:33.149469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62cb10-8009-43e8-b03c-ac588382d509 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:33.164474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-6a62cb10-8009-43e8-b03c-ac588382d509 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:36:33.164474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:33.164474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:33.164474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:33.164474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:33.164474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:33.164474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:33.164474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:33.164474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:33.164474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:33.164474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:33.164474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:33.164474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:36:33.164474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:36:33.164474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:36:33.164474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:36:33.165724 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:33.165724 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:33.165724 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:33.165724 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:33.165724 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:33.165724 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:33.165724 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:33.165724 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:33.165724 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:33.165724 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:33.165724 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:33.165724 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:33.165724 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:33.165724 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:33.165724 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:33.165724 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:33.165724 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:33.165724 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:33.166961 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:33.166961 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:33.166961 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:36:33.166961 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:36:33.166961 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:36:33.166961 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:36:33.166961 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:36:33.166961 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:36:33.166961 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:36:33.166961 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:33.170370 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 376/746] 10.222.0.119 () {56 vars in 1098 bytes} [Thu Jul 14 15:36:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:33.171185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62cb10-8009-43e8-b03c-ac588382d509 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:33.176430 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af45493-8d7e-4477-8790-3bcc5b7cccec None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:33.214065 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4644d52-a5e9-46a3-96ab-10e392d69faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:33.214644 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4644d52-a5e9-46a3-96ab-10e392d69faf None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:33.214937 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4644d52-a5e9-46a3-96ab-10e392d69faf None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:33.215221 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4644d52-a5e9-46a3-96ab-10e392d69faf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:33.238660 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:33.278061 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62cb10-8009-43e8-b03c-ac588382d509 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:33.291264 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4644d52-a5e9-46a3-96ab-10e392d69faf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:33.292847 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4644d52-a5e9-46a3-96ab-10e392d69faf None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:33.308877 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:33.315100 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a90d22-51f1-46e5-8be9-42c0a58f268c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:33.315898 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a90d22-51f1-46e5-8be9-42c0a58f268c None admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:33.316253 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a90d22-51f1-46e5-8be9-42c0a58f268c None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:33.316601 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a90d22-51f1-46e5-8be9-42c0a58f268c None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:33.317395 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a90d22-51f1-46e5-8be9-42c0a58f268c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:33.319815 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a90d22-51f1-46e5-8be9-42c0a58f268c None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:33.393270 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 371/747] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:36:33 2022] GET /identity/v3/auth/tokens => generated 899 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:33.394275 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4644d52-a5e9-46a3-96ab-10e392d69faf None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:33.422102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 377/748] 10.222.0.119 () {60 vars in 1146 bytes} [Thu Jul 14 15:36:33 2022] POST /identity/v3/services => generated 252 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:33.422929 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a90d22-51f1-46e5-8be9-42c0a58f268c None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:33.457495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:33.524367 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4644d52-a5e9-46a3-96ab-10e392d69faf None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:33.576995 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a90d22-51f1-46e5-8be9-42c0a58f268c None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:33.585906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9b472-9f74-4ed5-8811-5225740802ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:33.587019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9b472-9f74-4ed5-8811-5225740802ab None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:33.587515 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9b472-9f74-4ed5-8811-5225740802ab None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:33.587999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9b472-9f74-4ed5-8811-5225740802ab None admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:33.589136 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9b472-9f74-4ed5-8811-5225740802ab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:33.589659 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9b472-9f74-4ed5-8811-5225740802ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:33.591405 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9b472-9f74-4ed5-8811-5225740802ab None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:33.614342 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 372/749] 10.222.0.119 () {56 vars in 1140 bytes} [Thu Jul 14 15:36:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:33.614530 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9b472-9f74-4ed5-8811-5225740802ab None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:33.628073 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a66387-3cc7-44a1-ae92-9f80163287ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:33.628756 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a66387-3cc7-44a1-ae92-9f80163287ea None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:33.629043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a66387-3cc7-44a1-ae92-9f80163287ea None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:33.629387 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a66387-3cc7-44a1-ae92-9f80163287ea None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:33.630243 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a66387-3cc7-44a1-ae92-9f80163287ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:33.630618 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a66387-3cc7-44a1-ae92-9f80163287ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:33.632422 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a66387-3cc7-44a1-ae92-9f80163287ea None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:33.652209 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 378/750] 10.222.0.119 () {56 vars in 1138 bytes} [Thu Jul 14 15:36:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:33.653071 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a66387-3cc7-44a1-ae92-9f80163287ea None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:33.715773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:33.737898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9b472-9f74-4ed5-8811-5225740802ab None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:33.750652 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:33.775889 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25852b-84a3-43ea-83a4-959a6d9c231e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:33.776901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25852b-84a3-43ea-83a4-959a6d9c231e None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:33.777288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25852b-84a3-43ea-83a4-959a6d9c231e None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:33.777673 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25852b-84a3-43ea-83a4-959a6d9c231e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:33.785804 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a66387-3cc7-44a1-ae92-9f80163287ea None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:33.789087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25852b-84a3-43ea-83a4-959a6d9c231e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:33.790603 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25852b-84a3-43ea-83a4-959a6d9c231e None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:33.810540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-ee25852b-84a3-43ea-83a4-959a6d9c231e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:33.810540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:33.810540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:33.810540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:33.810540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:33.810540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:33.810540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:33.810540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:33.810540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:33.810540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:33.810540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:33.810540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:33.810540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:33.810540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:33.810540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:33.811467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:33.811467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:33.811467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:33.811467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:33.811467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:33.811467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:33.811467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:33.811467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:33.811467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:33.811467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:33.811467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:33.811467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:33.811467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:33.811467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:33.811467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:33.811467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:33.811467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:33.812381 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:33.812381 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:33.812381 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:33.812381 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:33.812381 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 373/751] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:33.813128 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25852b-84a3-43ea-83a4-959a6d9c231e None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:33.848701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126dcdd-9348-4a3c-913b-2448594e2b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:33.850000 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126dcdd-9348-4a3c-913b-2448594e2b89 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:33.850431 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126dcdd-9348-4a3c-913b-2448594e2b89 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:33.850850 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126dcdd-9348-4a3c-913b-2448594e2b89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:33.927731 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25852b-84a3-43ea-83a4-959a6d9c231e None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:33.963547 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126dcdd-9348-4a3c-913b-2448594e2b89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:33.965479 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126dcdd-9348-4a3c-913b-2448594e2b89 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:33.967124 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13992e-9af4-478f-abb6-caec68d7167d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:33.968025 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13992e-9af4-478f-abb6-caec68d7167d None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:33.968456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13992e-9af4-478f-abb6-caec68d7167d None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:33.968832 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13992e-9af4-478f-abb6-caec68d7167d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:33.980081 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13992e-9af4-478f-abb6-caec68d7167d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:33.981709 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13992e-9af4-478f-abb6-caec68d7167d None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:34.000800 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-bf13992e-9af4-478f-abb6-caec68d7167d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:34.000800 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:34.000800 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:34.000800 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:34.000800 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:34.000800 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:34.000800 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:34.000800 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:34.000800 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:34.000800 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:34.000800 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:34.000800 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:34.000800 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:34.000800 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:34.000800 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:34.001881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:34.001881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:34.001881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:34.001881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:34.001881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:34.001881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:34.001881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:34.001881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:34.001881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:34.001881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:34.001881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:34.001881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:34.001881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:34.001881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:34.001881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:34.001881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:34.001881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:34.003065 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:34.003065 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:34.003065 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:34.003065 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:34.009438 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 374/752] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:34.010467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13992e-9af4-478f-abb6-caec68d7167d None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:34.019530 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:34.030592 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:34.088031 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 379/753] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:36:33 2022] GET /identity/v3/auth/tokens => generated 1003 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:36:34.089494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126dcdd-9348-4a3c-913b-2448594e2b89 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:34.150331 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13992e-9af4-478f-abb6-caec68d7167d None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:34.196205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4d0fb-50d1-455c-9ebd-dd9634a1f1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:34.198059 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4d0fb-50d1-455c-9ebd-dd9634a1f1de None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:34.198572 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4d0fb-50d1-455c-9ebd-dd9634a1f1de None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:34.199054 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4d0fb-50d1-455c-9ebd-dd9634a1f1de None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:34.200618 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab4d0fb-50d1-455c-9ebd-dd9634a1f1de None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:34.200942 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab4d0fb-50d1-455c-9ebd-dd9634a1f1de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:34.202319 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab4d0fb-50d1-455c-9ebd-dd9634a1f1de None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:34.217835 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 375/754] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:34.218003 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126dcdd-9348-4a3c-913b-2448594e2b89 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:34.219057 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4d0fb-50d1-455c-9ebd-dd9634a1f1de None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:34.261376 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac9091-1a6e-42b3-bccb-f40dcc660904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:34.262053 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac9091-1a6e-42b3-bccb-f40dcc660904 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:34.262343 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac9091-1a6e-42b3-bccb-f40dcc660904 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:34.262628 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac9091-1a6e-42b3-bccb-f40dcc660904 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:34.263425 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac9091-1a6e-42b3-bccb-f40dcc660904 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:34.263738 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac9091-1a6e-42b3-bccb-f40dcc660904 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:34.266198 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac9091-1a6e-42b3-bccb-f40dcc660904 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:34.281524 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 380/755] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:34.284898 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac9091-1a6e-42b3-bccb-f40dcc660904 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:34.293396 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:34.327107 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:34.366992 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4d0fb-50d1-455c-9ebd-dd9634a1f1de None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:34.409996 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc68ab1-c270-4dc4-8577-6ca119d6bcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:34.411769 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc68ab1-c270-4dc4-8577-6ca119d6bcbb None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:34.412642 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc68ab1-c270-4dc4-8577-6ca119d6bcbb None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:34.413318 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc68ab1-c270-4dc4-8577-6ca119d6bcbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:34.414250 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac9091-1a6e-42b3-bccb-f40dcc660904 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:34.428530 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc68ab1-c270-4dc4-8577-6ca119d6bcbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:34.430084 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc68ab1-c270-4dc4-8577-6ca119d6bcbb None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:34.448474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-9fc68ab1-c270-4dc4-8577-6ca119d6bcbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:34.448474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:34.448474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:34.448474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:34.448474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:34.448474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:34.448474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:34.448474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:34.448474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:34.448474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:34.448474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:34.448474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:34.448474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:34.448474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:34.448474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:34.449678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:34.449678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:34.449678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:34.449678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:34.449678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:34.449678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:34.449678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:34.449678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:34.449678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:34.449678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:34.449678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:34.449678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:34.449678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:34.449678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:34.449678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:34.449678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:34.449678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:34.450585 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:34.450585 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:34.450585 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:34.450585 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:34.454518 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 376/756] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:34.455228 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc68ab1-c270-4dc4-8577-6ca119d6bcbb None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:34.461445 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b17bf-d03d-49bb-9ac8-4c78f2610975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:34.462549 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b17bf-d03d-49bb-9ac8-4c78f2610975 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:34.463038 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b17bf-d03d-49bb-9ac8-4c78f2610975 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:34.463519 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b17bf-d03d-49bb-9ac8-4c78f2610975 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:34.473649 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b17bf-d03d-49bb-9ac8-4c78f2610975 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:34.475881 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b17bf-d03d-49bb-9ac8-4c78f2610975 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:34.495725 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-fc5b17bf-d03d-49bb-9ac8-4c78f2610975 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:34.495725 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:34.495725 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:34.495725 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:34.495725 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:34.495725 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:34.495725 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:34.495725 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:34.495725 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:34.495725 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:34.495725 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:34.495725 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:34.495725 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:36:34.495725 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:36:34.495725 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:36:34.496679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:36:34.496679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:34.496679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:34.496679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:34.496679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:34.496679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:34.496679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:34.496679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:34.496679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:34.496679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:34.496679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:34.496679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:34.496679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:34.496679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:34.496679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:34.496679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:34.496679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:34.497578 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:36:34.497578 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:36:34.497578 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:36:34.497578 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:36:34.497578 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:36:34.497578 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:36:34.497578 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:34.497578 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:34.500573 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 381/757] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:34.502028 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b17bf-d03d-49bb-9ac8-4c78f2610975 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:34.572313 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc68ab1-c270-4dc4-8577-6ca119d6bcbb None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:34.588985 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:34.601284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:34.610892 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d7486-1c01-476b-85d6-b883f44a480a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:34.614690 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d7486-1c01-476b-85d6-b883f44a480a None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:34.614690 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d7486-1c01-476b-85d6-b883f44a480a None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:34.614690 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d7486-1c01-476b-85d6-b883f44a480a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:34.619767 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d7486-1c01-476b-85d6-b883f44a480a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:34.621269 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d7486-1c01-476b-85d6-b883f44a480a None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:34.638017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-ce2d7486-1c01-476b-85d6-b883f44a480a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:34.638017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:34.638017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:34.638017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:34.638017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:34.638017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:34.638017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:34.638017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:34.638017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:34.638017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:34.638017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:34.638017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:34.638017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:36:34.638017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:36:34.638017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:36:34.638986 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:36:34.638986 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:34.638986 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:34.638986 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:34.638986 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:34.638986 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:34.638986 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:34.638986 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:34.638986 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:34.638986 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:34.638986 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:34.638986 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:34.638986 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:34.638986 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:34.638986 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:34.638986 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:34.638986 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:34.639884 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:36:34.639884 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:36:34.639884 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:36:34.639884 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:36:34.639884 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:36:34.639884 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:36:34.639884 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:34.639884 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:34.642744 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b17bf-d03d-49bb-9ac8-4c78f2610975 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:34.643991 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 377/758] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:34.645067 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d7486-1c01-476b-85d6-b883f44a480a None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:34.689631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cd340-4ce6-4d57-bcf2-8a1ebd957985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:34.690758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cd340-4ce6-4d57-bcf2-8a1ebd957985 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:34.692131 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cd340-4ce6-4d57-bcf2-8a1ebd957985 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:34.692653 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cd340-4ce6-4d57-bcf2-8a1ebd957985 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:34.694288 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2cd340-4ce6-4d57-bcf2-8a1ebd957985 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:34.694834 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2cd340-4ce6-4d57-bcf2-8a1ebd957985 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:34.697257 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2cd340-4ce6-4d57-bcf2-8a1ebd957985 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:34.715337 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 382/759] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:34.716515 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cd340-4ce6-4d57-bcf2-8a1ebd957985 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:34.772896 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d7486-1c01-476b-85d6-b883f44a480a None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:34.817284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc2667-b149-43cc-af30-ad1024262486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:34.819325 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc2667-b149-43cc-af30-ad1024262486 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:34.819838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc2667-b149-43cc-af30-ad1024262486 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:34.820886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc2667-b149-43cc-af30-ad1024262486 None admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:34.822366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc2667-b149-43cc-af30-ad1024262486 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:34.823150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc2667-b149-43cc-af30-ad1024262486 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:34.825160 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc2667-b149-43cc-af30-ad1024262486 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:34.843927 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 378/760] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:36:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:34.845145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc2667-b149-43cc-af30-ad1024262486 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:34.845255 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cd340-4ce6-4d57-bcf2-8a1ebd957985 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:34.872495 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:34.883642 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3dcb1-29be-4c24-9721-9bdaa46958f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:34.884370 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3dcb1-29be-4c24-9721-9bdaa46958f8 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:34.884647 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3dcb1-29be-4c24-9721-9bdaa46958f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:34.884929 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3dcb1-29be-4c24-9721-9bdaa46958f8 None admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:34.885867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3dcb1-29be-4c24-9721-9bdaa46958f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:34.886048 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3dcb1-29be-4c24-9721-9bdaa46958f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:34.887489 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3dcb1-29be-4c24-9721-9bdaa46958f8 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:34.906835 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 383/761] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:36:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:34.907536 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3dcb1-29be-4c24-9721-9bdaa46958f8 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:34.914585 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:34.977869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc2667-b149-43cc-af30-ad1024262486 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:35.025473 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbe417-3910-438b-8c65-20b2b5224594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:35.026287 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbe417-3910-438b-8c65-20b2b5224594 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:35.026574 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbe417-3910-438b-8c65-20b2b5224594 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:35.026857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbe417-3910-438b-8c65-20b2b5224594 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:35.034216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dbe417-3910-438b-8c65-20b2b5224594 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:35.035596 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3dcb1-29be-4c24-9721-9bdaa46958f8 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:35.035708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dbe417-3910-438b-8c65-20b2b5224594 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:35.050217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-c9dbe417-3910-438b-8c65-20b2b5224594 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:35.050217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:35.050217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:35.050217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:35.050217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:35.050217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:35.050217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:35.050217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:35.050217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:35.050217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:35.050217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:35.050217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:35.050217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:36:35.050217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:36:35.050217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:36:35.051233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:36:35.051233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:35.051233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:35.051233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:35.051233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:35.051233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:35.051233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:35.051233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:35.051233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:35.051233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:35.051233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:35.051233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:35.051233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:35.051233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:35.051233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:35.051233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:35.051233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:35.052168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:36:35.052168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:36:35.052168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:36:35.052168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:36:35.052168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:36:35.052168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:36:35.052168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:35.052168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:35.052168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 379/762] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:35.052168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbe417-3910-438b-8c65-20b2b5224594 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:35.077826 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bae52-bbaa-42c8-abeb-b5544ea9a15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:35.078428 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bae52-bbaa-42c8-abeb-b5544ea9a15b None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:35.078720 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bae52-bbaa-42c8-abeb-b5544ea9a15b None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:35.079000 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bae52-bbaa-42c8-abeb-b5544ea9a15b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:35.079835 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0bae52-bbaa-42c8-abeb-b5544ea9a15b None admin] RBAC: Adding query filter params (role.id=92c47f3813b04366b3019ba2a56337eb, scope.project.id=07652ced88cf4f069d1765176be5130b, user.id=4a1474b39e0b477daff5833491cd6df5) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:35.080179 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0bae52-bbaa-42c8-abeb-b5544ea9a15b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:35.081624 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0bae52-bbaa-42c8-abeb-b5544ea9a15b None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:35.092135 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 384/763] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:36:34 2022] GET /identity/v3/role_assignments?user.id=4a1474b39e0b477daff5833491cd6df5&scope.project.id=07652ced88cf4f069d1765176be5130b&role.id=92c47f3813b04366b3019ba2a56337eb => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:35.092135 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c15de-e0c7-4d01-9428-9429bf64e42e None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:35.092135 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c15de-e0c7-4d01-9428-9429bf64e42e None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:35.092135 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c15de-e0c7-4d01-9428-9429bf64e42e None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:35.092135 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 385/764] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:35.092135 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c15de-e0c7-4d01-9428-9429bf64e42e None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:35.162195 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:35.193334 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbe417-3910-438b-8c65-20b2b5224594 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:35.205383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:35.225926 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c15de-e0c7-4d01-9428-9429bf64e42e None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:35.249507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f77ba9-fb39-478a-91ab-a085350e3772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:35.250821 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f77ba9-fb39-478a-91ab-a085350e3772 None admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:35.251398 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f77ba9-fb39-478a-91ab-a085350e3772 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:35.251876 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f77ba9-fb39-478a-91ab-a085350e3772 None admin] PATH_INFO: `/v3/projects/07652ced88cf4f069d1765176be5130b/users/a1e4c833a4684561ab52eda5734a7766/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:35.254393 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f77ba9-fb39-478a-91ab-a085350e3772 None admin] RBAC: Authorizing `identity:create_grant(project_id=07652ced88cf4f069d1765176be5130b, user_id=a1e4c833a4684561ab52eda5734a7766, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:35.256890 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f77ba9-fb39-478a-91ab-a085350e3772 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:35.267221 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15578956-e183-4076-8cb4-2dfac321b46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:35.267904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15578956-e183-4076-8cb4-2dfac321b46e None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:35.268235 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15578956-e183-4076-8cb4-2dfac321b46e None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:35.268526 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15578956-e183-4076-8cb4-2dfac321b46e None admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:35.269396 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15578956-e183-4076-8cb4-2dfac321b46e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:35.269717 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15578956-e183-4076-8cb4-2dfac321b46e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:35.271167 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15578956-e183-4076-8cb4-2dfac321b46e None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:35.286219 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 386/765] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:36:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:35.287893 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890234b-5768-4920-959e-19198e4fce43 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:35.288331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890234b-5768-4920-959e-19198e4fce43 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:35.288792 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890234b-5768-4920-959e-19198e4fce43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:35.306196 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-3890234b-5768-4920-959e-19198e4fce43 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:35.307544 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-3890234b-5768-4920-959e-19198e4fce43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:35.345410 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 380/766] 10.222.0.119 () {58 vars in 1444 bytes} [Thu Jul 14 15:36:35 2022] PUT /identity/v3/projects/07652ced88cf4f069d1765176be5130b/users/a1e4c833a4684561ab52eda5734a7766/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:36:35.347511 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f77ba9-fb39-478a-91ab-a085350e3772 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:35.427421 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 387/767] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:35 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:36:35.501209 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890234b-5768-4920-959e-19198e4fce43 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:35.509155 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f77ba9-fb39-478a-91ab-a085350e3772 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:35.560984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:35.593077 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1564cf3-f06e-4b9f-942b-027eb07d4b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:35.593996 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1564cf3-f06e-4b9f-942b-027eb07d4b08 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:35.594433 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1564cf3-f06e-4b9f-942b-027eb07d4b08 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:35.594879 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1564cf3-f06e-4b9f-942b-027eb07d4b08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:35.595930 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1564cf3-f06e-4b9f-942b-027eb07d4b08 None admin] RBAC: Adding query filter params (role.id=07aaf007cde043318319928d151bdc75, scope.project.id=07652ced88cf4f069d1765176be5130b, user.id=28a5c169576e432c8174a562ae358e8b) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:35.596432 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1564cf3-f06e-4b9f-942b-027eb07d4b08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:35.598039 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1564cf3-f06e-4b9f-942b-027eb07d4b08 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:35.604985 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 381/768] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:36:35 2022] GET /identity/v3/role_assignments?user.id=28a5c169576e432c8174a562ae358e8b&scope.project.id=07652ced88cf4f069d1765176be5130b&role.id=07aaf007cde043318319928d151bdc75 => generated 260 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:35.638564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890234b-5768-4920-959e-19198e4fce43 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:35.669793 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cd453-db1d-49f0-b492-58ed092ea66c None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:35.670320 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cd453-db1d-49f0-b492-58ed092ea66c None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:35.670760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cd453-db1d-49f0-b492-58ed092ea66c None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:35.672293 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 382/769] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:36:35.678396 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f7250-1ee3-4ee7-aec3-73e443758ab1 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:35.678636 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f7250-1ee3-4ee7-aec3-73e443758ab1 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:35.678920 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f7250-1ee3-4ee7-aec3-73e443758ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:35.679343 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa8885-10cd-46d7-a86c-438244e22b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:35.680459 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa8885-10cd-46d7-a86c-438244e22b56 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:35.680891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa8885-10cd-46d7-a86c-438244e22b56 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:35.681345 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa8885-10cd-46d7-a86c-438244e22b56 None admin] PATH_INFO: `/v3/services/network` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:35.682154 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa8885-10cd-46d7-a86c-438244e22b56 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:35.683773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa8885-10cd-46d7-a86c-438244e22b56 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:35.698299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-d8fa8885-10cd-46d7-a86c-438244e22b56 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 15:36:35.698299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:35.698299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:36:35.698299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:36:35.698299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:36:35.698299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:36:35.698299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:36:35.698299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:35.698299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 15:36:35.698299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:35.698299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:36:35.698299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:35.698299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:35.698299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:35.698299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:35.698299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:35.698299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:35.699385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:35.699385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:35.699385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:35.699385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:35.699385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:35.699385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:35.699385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:36:35.699385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:36:35.699385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:36:35.699385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:36:35.699385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:35.699385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:35.699385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:35.699385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:35.699385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:35.699385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:35.701017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:35.701017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:35.701017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:35.701017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:35.701017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:35.701017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:35.701017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:35.701017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:35.701017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:35.701017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:35.701017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:36:35.701017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:35.701017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 15:36:35.701017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:35.703658 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 388/770] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:35 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:35.708590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-5c6f7250-1ee3-4ee7-aec3-73e443758ab1 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:35.710292 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-5c6f7250-1ee3-4ee7-aec3-73e443758ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:35.715667 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa8885-10cd-46d7-a86c-438244e22b56 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:35.764567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:35.791324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 383/771] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:35 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:36:35.829553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f7250-1ee3-4ee7-aec3-73e443758ab1 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:35.896666 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa8885-10cd-46d7-a86c-438244e22b56 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:35.898514 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:35.939053 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac50dd9-2ce7-40e5-b129-5d2210176a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:35.939733 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac50dd9-2ce7-40e5-b129-5d2210176a86 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:35.940021 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac50dd9-2ce7-40e5-b129-5d2210176a86 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:35.940326 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac50dd9-2ce7-40e5-b129-5d2210176a86 None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:35.944454 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac50dd9-2ce7-40e5-b129-5d2210176a86 None admin] RBAC: Adding query filter params (name=network) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:35.944770 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac50dd9-2ce7-40e5-b129-5d2210176a86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:35.946198 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac50dd9-2ce7-40e5-b129-5d2210176a86 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:35.957051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 389/772] 10.222.0.119 () {56 vars in 1117 bytes} [Thu Jul 14 15:36:35 2022] GET /identity/v3/services?name=network => generated 125 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:35.959111 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac50dd9-2ce7-40e5-b129-5d2210176a86 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:36.042261 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f7250-1ee3-4ee7-aec3-73e443758ab1 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:36.076752 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac50dd9-2ce7-40e5-b129-5d2210176a86 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:36.117923 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6471d7-15eb-4d20-bd25-5e651d54643f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:36.118689 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6471d7-15eb-4d20-bd25-5e651d54643f None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:36.118876 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6471d7-15eb-4d20-bd25-5e651d54643f None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:36.119162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6471d7-15eb-4d20-bd25-5e651d54643f None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:36.119974 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6471d7-15eb-4d20-bd25-5e651d54643f None admin] RBAC: Adding query filter params (type=network) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:36.120323 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6471d7-15eb-4d20-bd25-5e651d54643f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:36.121809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6471d7-15eb-4d20-bd25-5e651d54643f None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:36.131813 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 390/773] 10.222.0.119 () {56 vars in 1117 bytes} [Thu Jul 14 15:36:35 2022] GET /identity/v3/services?type=network => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:36.132711 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38855b-543a-409e-a00e-5d27c7b116a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:36.133069 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6471d7-15eb-4d20-bd25-5e651d54643f None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:36.133967 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38855b-543a-409e-a00e-5d27c7b116a1 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:36.134440 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38855b-543a-409e-a00e-5d27c7b116a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:36.134902 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38855b-543a-409e-a00e-5d27c7b116a1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:36.135743 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38855b-543a-409e-a00e-5d27c7b116a1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:36.137323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38855b-543a-409e-a00e-5d27c7b116a1 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:36.172204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-6d38855b-543a-409e-a00e-5d27c7b116a1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 15:36:36.172204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:36.172204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:36:36.172204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:36:36.172204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:36:36.172204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:36:36.172204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:36:36.172204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:36.172204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 15:36:36.172204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:36.172204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:36:36.172204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:36.172204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:36.172204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:36.172204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:36.172204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:36.173166 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:36.173166 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:36.173166 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:36.173166 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:36.173166 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:36.173166 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:36.173166 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:36.173166 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:36:36.173166 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:36:36.173166 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:36:36.173166 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:36:36.173166 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:36.173166 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:36.173166 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:36.173166 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:36.173166 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:36.174000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:36.174000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:36.174000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:36.174000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:36.174000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:36.174000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:36.174000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:36.174000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:36.174000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:36.174000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:36.174000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:36.174000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:36:36.174000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:36.174000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 15:36:36.174000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:36.174770 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:36.176632 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 384/774] 10.222.0.119 () {56 vars in 1134 bytes} [Thu Jul 14 15:36:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:36:36.183144 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38855b-543a-409e-a00e-5d27c7b116a1 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:36.241360 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:36.246273 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6471d7-15eb-4d20-bd25-5e651d54643f None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:36.299804 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76b8d7-4a23-42e3-a42e-061542e0d881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:36.300810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76b8d7-4a23-42e3-a42e-061542e0d881 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:36.301314 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76b8d7-4a23-42e3-a42e-061542e0d881 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:36.301777 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76b8d7-4a23-42e3-a42e-061542e0d881 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:36.302767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76b8d7-4a23-42e3-a42e-061542e0d881 None admin] RBAC: Adding query filter params (interface=public, service_id=62bdaf95c06849f9b03c8cc9a76f041f, region_id=RegionOne) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:36.304033 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76b8d7-4a23-42e3-a42e-061542e0d881 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:36.308361 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76b8d7-4a23-42e3-a42e-061542e0d881 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:36.321020 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 391/775] 10.222.0.119 () {56 vars in 1256 bytes} [Thu Jul 14 15:36:36 2022] GET /identity/v3/endpoints?service_id=62bdaf95c06849f9b03c8cc9a76f041f&interface=public®ion_id=RegionOne => generated 195 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:36.328761 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76b8d7-4a23-42e3-a42e-061542e0d881 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:36.405458 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38855b-543a-409e-a00e-5d27c7b116a1 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:36.474314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea9a55-ca93-4bb1-a221-5abf9a4a922b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:36.475962 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea9a55-ca93-4bb1-a221-5abf9a4a922b None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:36.476512 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea9a55-ca93-4bb1-a221-5abf9a4a922b None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:36.477013 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea9a55-ca93-4bb1-a221-5abf9a4a922b None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:36.477942 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea9a55-ca93-4bb1-a221-5abf9a4a922b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:36.478458 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea9a55-ca93-4bb1-a221-5abf9a4a922b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:36.480037 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea9a55-ca93-4bb1-a221-5abf9a4a922b None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:36.485815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 385/776] 10.222.0.119 () {56 vars in 1129 bytes} [Thu Jul 14 15:36:36 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:36.494216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea9a55-ca93-4bb1-a221-5abf9a4a922b None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:36.500448 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:36.514210 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76b8d7-4a23-42e3-a42e-061542e0d881 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:36.587620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f2f7b-0ee6-4eb4-98ab-5c65e6ffadec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:36.588431 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f2f7b-0ee6-4eb4-98ab-5c65e6ffadec None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:36.588785 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f2f7b-0ee6-4eb4-98ab-5c65e6ffadec None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:36.589132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f2f7b-0ee6-4eb4-98ab-5c65e6ffadec None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:36.591591 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f2f7b-0ee6-4eb4-98ab-5c65e6ffadec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:36.596386 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f2f7b-0ee6-4eb4-98ab-5c65e6ffadec None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:36.608590 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 392/777] 10.222.0.119 () {56 vars in 1092 bytes} [Thu Jul 14 15:36:36 2022] GET /identity/v3/services => generated 776 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:36.685873 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:36.700624 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea9a55-ca93-4bb1-a221-5abf9a4a922b None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:36.754331 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c21a9-197d-4364-af17-27b5cf6bf683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:36.754933 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c21a9-197d-4364-af17-27b5cf6bf683 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:36.755220 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c21a9-197d-4364-af17-27b5cf6bf683 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:36.755495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c21a9-197d-4364-af17-27b5cf6bf683 None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:36.756243 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c21a9-197d-4364-af17-27b5cf6bf683 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:36.757191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c21a9-197d-4364-af17-27b5cf6bf683 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:36.758489 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c21a9-197d-4364-af17-27b5cf6bf683 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:36.769640 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 386/778] 10.222.0.119 () {56 vars in 1129 bytes} [Thu Jul 14 15:36:36 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:36.775928 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f2f7b-0ee6-4eb4-98ab-5c65e6ffadec None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:36.948957 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f2f7b-0ee6-4eb4-98ab-5c65e6ffadec None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:37.011753 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc8dd7-c081-4480-914d-ec3708958e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:37.012793 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc8dd7-c081-4480-914d-ec3708958e26 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:37.013315 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc8dd7-c081-4480-914d-ec3708958e26 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:37.013816 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc8dd7-c081-4480-914d-ec3708958e26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:37.014818 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc8dd7-c081-4480-914d-ec3708958e26 None admin] RBAC: Adding query filter params (interface=public, service_id=f8125dcc2b644a58a1238cd7b001ca96, region_id=RegionOne) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:37.015338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc8dd7-c081-4480-914d-ec3708958e26 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:37.016956 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc8dd7-c081-4480-914d-ec3708958e26 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:37.028555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 393/779] 10.222.0.119 () {56 vars in 1256 bytes} [Thu Jul 14 15:36:36 2022] GET /identity/v3/endpoints?service_id=f8125dcc2b644a58a1238cd7b001ca96&interface=public®ion_id=RegionOne => generated 195 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:37.037209 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c21a9-197d-4364-af17-27b5cf6bf683 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:37.197665 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c21a9-197d-4364-af17-27b5cf6bf683 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:37.249286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5ea0d-03f6-4ced-856a-5d99da2fec62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:37.250810 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5ea0d-03f6-4ced-856a-5d99da2fec62 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:37.251307 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5ea0d-03f6-4ced-856a-5d99da2fec62 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:37.251788 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5ea0d-03f6-4ced-856a-5d99da2fec62 None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:37.252707 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5ea0d-03f6-4ced-856a-5d99da2fec62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:37.254290 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5ea0d-03f6-4ced-856a-5d99da2fec62 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:37.262314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 387/780] 10.222.0.119 () {56 vars in 1092 bytes} [Thu Jul 14 15:36:37 2022] GET /identity/v3/services => generated 776 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:37.476647 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fbc9f-833e-4533-b2f1-5ec8f72088a5 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:37.477662 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fbc9f-833e-4533-b2f1-5ec8f72088a5 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:37.478179 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fbc9f-833e-4533-b2f1-5ec8f72088a5 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:37.479773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 394/781] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:37 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:37.486072 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eb5e2-a4a5-4695-8142-b00d47009fdb None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:37.486072 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eb5e2-a4a5-4695-8142-b00d47009fdb None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:37.486072 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eb5e2-a4a5-4695-8142-b00d47009fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:37.505269 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-cf1eb5e2-a4a5-4695-8142-b00d47009fdb None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:37.507937 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-cf1eb5e2-a4a5-4695-8142-b00d47009fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:37.520728 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:37.585329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 388/782] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:37 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:36:37.616663 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fbc9f-833e-4533-b2f1-5ec8f72088a5 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:37.663483 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:37.825087 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fbc9f-833e-4533-b2f1-5ec8f72088a5 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:37.860280 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b881fa-b96f-48a0-8a2f-098104798a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:37.861094 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b881fa-b96f-48a0-8a2f-098104798a81 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:37.861387 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b881fa-b96f-48a0-8a2f-098104798a81 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:37.861671 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b881fa-b96f-48a0-8a2f-098104798a81 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:37.873200 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b881fa-b96f-48a0-8a2f-098104798a81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:36:37.881098 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-26b881fa-b96f-48a0-8a2f-098104798a81 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:37.881098 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:37.881098 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:37.881098 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:37.881098 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:37.881098 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:37.881098 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:37.881098 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:37.881098 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:37.881098 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:37.881098 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:37.881098 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:37.881098 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:36:37.881098 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:36:37.881098 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:36:37.881098 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:36:37.882249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:36:37.882249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:36:37.882249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:36:37.882249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:36:37.882249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:37.882249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:37.882249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:37.882249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:37.882249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:37.882249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:37.882249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:37.882249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:37.882249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:37.882249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:37.882249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:37.882249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:37.883089 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:37.883089 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:37.883089 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:37.883089 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:37.883089 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:36:37.883089 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:36:37.883089 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:36:37.883089 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:36:37.883089 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:36:37.883089 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:36:37.883089 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:37.883089 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:37.883089 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 395/783] 10.222.0.119 () {56 vars in 1107 bytes} [Thu Jul 14 15:36:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:37.889783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1eb5e2-a4a5-4695-8142-b00d47009fdb None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:37.906642 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee436d-ba58-4576-8693-d702ab357f97 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:37.906945 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee436d-ba58-4576-8693-d702ab357f97 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:37.907220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee436d-ba58-4576-8693-d702ab357f97 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:37.908883 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 396/784] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:36:37.916982 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455437ff-8570-4b6d-b021-2dcb75f63c65 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:37.917277 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455437ff-8570-4b6d-b021-2dcb75f63c65 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:37.917576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455437ff-8570-4b6d-b021-2dcb75f63c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:37.939469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-455437ff-8570-4b6d-b021-2dcb75f63c65 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:37.940767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-455437ff-8570-4b6d-b021-2dcb75f63c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:38.070216 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 397/785] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:37 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:36:38.078634 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1eb5e2-a4a5-4695-8142-b00d47009fdb None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:38.107410 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455437ff-8570-4b6d-b021-2dcb75f63c65 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:38.132484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:38.141278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c0cb7-6f27-4eed-b3be-98feb4e47d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:38.141960 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c0cb7-6f27-4eed-b3be-98feb4e47d31 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:38.142244 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c0cb7-6f27-4eed-b3be-98feb4e47d31 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:38.142519 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c0cb7-6f27-4eed-b3be-98feb4e47d31 None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:38.143339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c0cb7-6f27-4eed-b3be-98feb4e47d31 None admin] RBAC: Adding query filter params (name=service) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:38.143647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c0cb7-6f27-4eed-b3be-98feb4e47d31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:38.145048 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c0cb7-6f27-4eed-b3be-98feb4e47d31 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:38.166512 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 389/786] 10.222.0.119 () {56 vars in 1108 bytes} [Thu Jul 14 15:36:37 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:38.172181 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c0cb7-6f27-4eed-b3be-98feb4e47d31 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:38.188451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:38.306885 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c0cb7-6f27-4eed-b3be-98feb4e47d31 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:38.309515 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455437ff-8570-4b6d-b021-2dcb75f63c65 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:38.368917 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0cb90c-e79c-46c1-812a-99cdb587b67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:38.369638 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cb90c-e79c-46c1-812a-99cdb587b67f None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:38.369929 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cb90c-e79c-46c1-812a-99cdb587b67f None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:38.370222 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cb90c-e79c-46c1-812a-99cdb587b67f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:38.376657 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f75c68-25f2-4911-8b06-3e76f03151c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:38.377723 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f75c68-25f2-4911-8b06-3e76f03151c8 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:38.378210 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f75c68-25f2-4911-8b06-3e76f03151c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:38.378688 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f75c68-25f2-4911-8b06-3e76f03151c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:38.384072 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0cb90c-e79c-46c1-812a-99cdb587b67f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:38.385926 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0cb90c-e79c-46c1-812a-99cdb587b67f None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:38.391131 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f75c68-25f2-4911-8b06-3e76f03151c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:36:38.399902 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-00f75c68-25f2-4911-8b06-3e76f03151c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:36:38.399902 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:38.399902 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:38.399902 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:38.399902 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:38.399902 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:38.399902 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:38.399902 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:38.399902 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:38.399902 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:38.399902 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:38.399902 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:38.399902 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:36:38.399902 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:36:38.399902 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:36:38.399902 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:36:38.400867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:36:38.400867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:36:38.400867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:36:38.400867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:36:38.400867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:38.400867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:38.400867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:38.400867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:38.400867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:38.400867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:38.400867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:38.400867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:38.400867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:38.400867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:38.400867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:38.400867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:38.401685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:38.401685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:38.401685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:38.401685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:38.401685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:36:38.401685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:36:38.401685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:36:38.401685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:36:38.401685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:36:38.401685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:36:38.401685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:36:38.401685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:38.404436 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 398/787] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:36:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:36:38.406145 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf63a78-72e1-4f94-8e12-681617cdc6ce None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:38.406651 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf63a78-72e1-4f94-8e12-681617cdc6ce None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:38.407131 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf63a78-72e1-4f94-8e12-681617cdc6ce None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:38.408891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 399/788] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:38.409795 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf63a78-72e1-4f94-8e12-681617cdc6ce None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:38.410980 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-fb0cb90c-e79c-46c1-812a-99cdb587b67f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:38.410980 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:38.410980 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:38.410980 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:38.410980 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:38.410980 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:38.410980 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:38.410980 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:38.410980 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:38.410980 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:38.410980 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:38.410980 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:38.410980 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:38.410980 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:38.410980 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:38.411850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:38.411850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:38.411850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:38.411850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:38.411850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:38.411850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:38.411850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:38.411850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:38.411850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:38.411850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:38.411850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:38.411850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:38.411850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:38.411850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:38.411850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:38.411850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:38.411850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:38.412796 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:38.412796 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:38.412796 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:38.412796 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:38.412796 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 390/789] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:36:38.420408 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0cb90c-e79c-46c1-812a-99cdb587b67f None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:38.499043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:38.519802 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:38.552957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0cb90c-e79c-46c1-812a-99cdb587b67f None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:38.557211 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf63a78-72e1-4f94-8e12-681617cdc6ce None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:38.592454 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9492e-7c09-409d-bd6d-8302eaf5a0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:38.593651 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9492e-7c09-409d-bd6d-8302eaf5a0ac None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:38.593838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234dcf1f-b939-4065-a794-65bd0869630d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:38.594351 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9492e-7c09-409d-bd6d-8302eaf5a0ac None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:38.594525 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234dcf1f-b939-4065-a794-65bd0869630d None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:38.594772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234dcf1f-b939-4065-a794-65bd0869630d None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:38.595059 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234dcf1f-b939-4065-a794-65bd0869630d None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:38.595407 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9492e-7c09-409d-bd6d-8302eaf5a0ac None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:38.595834 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234dcf1f-b939-4065-a794-65bd0869630d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:38.596163 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234dcf1f-b939-4065-a794-65bd0869630d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:38.596992 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9492e-7c09-409d-bd6d-8302eaf5a0ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:38.597524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9492e-7c09-409d-bd6d-8302eaf5a0ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:38.597628 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234dcf1f-b939-4065-a794-65bd0869630d None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:38.599628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9492e-7c09-409d-bd6d-8302eaf5a0ac None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:38.611858 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 400/790] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:36:38 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:38.613282 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ccace-b2d9-4778-8179-eb11afc74496 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:38.613585 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ccace-b2d9-4778-8179-eb11afc74496 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:38.613980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ccace-b2d9-4778-8179-eb11afc74496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:38.620409 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 391/791] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:38.621912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9492e-7c09-409d-bd6d-8302eaf5a0ac None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:38.638073 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-368ccace-b2d9-4778-8179-eb11afc74496 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:38.640412 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-368ccace-b2d9-4778-8179-eb11afc74496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:38.728341 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9492e-7c09-409d-bd6d-8302eaf5a0ac None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:38.728536 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 401/792] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:38 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:36:38.729270 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ccace-b2d9-4778-8179-eb11afc74496 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:38.777012 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fea3d-6d18-49ba-ae28-32d905961889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:38.778237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fea3d-6d18-49ba-ae28-32d905961889 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:38.778799 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fea3d-6d18-49ba-ae28-32d905961889 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:38.779359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fea3d-6d18-49ba-ae28-32d905961889 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:38.780411 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:38.791503 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053fea3d-6d18-49ba-ae28-32d905961889 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:38.796778 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053fea3d-6d18-49ba-ae28-32d905961889 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:38.802751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:38.814250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-053fea3d-6d18-49ba-ae28-32d905961889 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:38.814250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:38.814250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:38.814250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:38.814250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:38.814250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:38.814250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:38.814250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:38.814250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:38.814250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:38.814250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:38.814250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:38.814250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:38.814250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:38.814250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:38.815150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:38.815150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:38.815150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:38.815150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:38.815150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:38.815150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:38.815150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:38.815150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:38.815150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:38.815150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:38.815150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:38.815150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:38.815150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:38.815150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:38.815150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:38.815150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:38.815150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:38.816045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:38.816045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:38.816045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:38.816045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:38.818458 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 392/793] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:38.819576 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fea3d-6d18-49ba-ae28-32d905961889 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:38.847471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ccace-b2d9-4778-8179-eb11afc74496 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:38.884388 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f19d8-57c4-41eb-a481-7cf0533bbf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:38.885144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f19d8-57c4-41eb-a481-7cf0533bbf28 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:38.885431 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f19d8-57c4-41eb-a481-7cf0533bbf28 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:38.885712 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f19d8-57c4-41eb-a481-7cf0533bbf28 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:38.893272 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f19d8-57c4-41eb-a481-7cf0533bbf28 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:38.894744 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f19d8-57c4-41eb-a481-7cf0533bbf28 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:38.910141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-e81f19d8-57c4-41eb-a481-7cf0533bbf28 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:36:38.910141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:38.910141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:38.910141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:38.910141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:38.910141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:38.910141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:38.910141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:38.910141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:38.910141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:38.910141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:38.910141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:38.910141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:36:38.910141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:36:38.910141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:36:38.910141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:36:38.911139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:38.911139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:38.911139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:38.911139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:38.911139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:38.911139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:38.911139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:38.911139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:38.911139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:38.911139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:38.911139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:38.911139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:38.911139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:38.911139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:38.911139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:38.911139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:38.911139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:38.911139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:38.912079 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:38.912079 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:38.912079 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:36:38.912079 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:36:38.912079 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:36:38.912079 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:36:38.912079 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:36:38.912079 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:36:38.912079 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:36:38.912079 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:38.916341 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 402/794] 10.222.0.119 () {56 vars in 1122 bytes} [Thu Jul 14 15:36:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:38.917229 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f19d8-57c4-41eb-a481-7cf0533bbf28 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:38.937884 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fea3d-6d18-49ba-ae28-32d905961889 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:38.978553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b8f98-6a62-4b43-bcc4-a6a05027adb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:38.979831 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b8f98-6a62-4b43-bcc4-a6a05027adb3 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:38.980399 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b8f98-6a62-4b43-bcc4-a6a05027adb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:38.980887 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b8f98-6a62-4b43-bcc4-a6a05027adb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:38.993705 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b8f98-6a62-4b43-bcc4-a6a05027adb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:36:39.001785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-441b8f98-6a62-4b43-bcc4-a6a05027adb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:36:39.001785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:39.001785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:39.001785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:39.001785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:39.001785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:39.001785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:39.001785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:39.001785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:39.001785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:39.001785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:39.001785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:39.001785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:36:39.001785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:36:39.001785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:36:39.001785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:36:39.002903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:36:39.002903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:36:39.002903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:36:39.002903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:36:39.002903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:39.002903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:39.002903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:39.002903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:39.002903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:39.002903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:39.002903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:39.002903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:39.002903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:39.002903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:39.002903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:39.002903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:39.003938 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:39.003938 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:39.003938 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:39.003938 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:39.003938 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:36:39.003938 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:36:39.003938 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:36:39.003938 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:36:39.003938 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:36:39.003938 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:36:39.003938 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:36:39.003938 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:39.005985 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 393/795] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:36:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:39.007980 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b8f98-6a62-4b43-bcc4-a6a05027adb3 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:39.040479 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f19d8-57c4-41eb-a481-7cf0533bbf28 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:39.046383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:39.071479 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:39.082616 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdedc383-e494-44b7-b03a-07b146d31c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:39.083402 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedc383-e494-44b7-b03a-07b146d31c4d None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:39.083703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedc383-e494-44b7-b03a-07b146d31c4d None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:39.083967 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedc383-e494-44b7-b03a-07b146d31c4d None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:39.085130 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdedc383-e494-44b7-b03a-07b146d31c4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:39.085130 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdedc383-e494-44b7-b03a-07b146d31c4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:39.086644 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdedc383-e494-44b7-b03a-07b146d31c4d None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:39.104506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 403/796] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:39.106883 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6497fd0-acb3-40e3-ac4a-7f07e975e68d None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:39.107291 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6497fd0-acb3-40e3-ac4a-7f07e975e68d None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:39.107750 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6497fd0-acb3-40e3-ac4a-7f07e975e68d None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:39.109864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 404/797] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:39 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:39.110546 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6497fd0-acb3-40e3-ac4a-7f07e975e68d None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:39.123808 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b8f98-6a62-4b43-bcc4-a6a05027adb3 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:39.156838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ba942-f69c-4427-9a4c-4800d2776933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:39.157436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ba942-f69c-4427-9a4c-4800d2776933 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:39.157730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ba942-f69c-4427-9a4c-4800d2776933 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:39.158009 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ba942-f69c-4427-9a4c-4800d2776933 None admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:39.158838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ba942-f69c-4427-9a4c-4800d2776933 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:39.159148 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ba942-f69c-4427-9a4c-4800d2776933 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:39.160609 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ba942-f69c-4427-9a4c-4800d2776933 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:39.179638 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 394/798] 10.222.0.119 () {56 vars in 1154 bytes} [Thu Jul 14 15:36:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:39.180050 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ba942-f69c-4427-9a4c-4800d2776933 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:39.230332 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6497fd0-acb3-40e3-ac4a-7f07e975e68d None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:39.267388 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808ba49-ec3b-414b-95f4-a0353aec05fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:39.268188 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808ba49-ec3b-414b-95f4-a0353aec05fb None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:39.268553 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808ba49-ec3b-414b-95f4-a0353aec05fb None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:39.269010 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808ba49-ec3b-414b-95f4-a0353aec05fb None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:39.269761 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808ba49-ec3b-414b-95f4-a0353aec05fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:39.270076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808ba49-ec3b-414b-95f4-a0353aec05fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:39.271456 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808ba49-ec3b-414b-95f4-a0353aec05fb None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:39.271883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:39.286950 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ba942-f69c-4427-9a4c-4800d2776933 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:39.287156 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 405/799] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:36:39 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:39.287156 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d1f23-cc45-4418-9fe6-12a6dbcd60e7 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:39.287156 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d1f23-cc45-4418-9fe6-12a6dbcd60e7 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:39.287156 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d1f23-cc45-4418-9fe6-12a6dbcd60e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:39.304165 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-060d1f23-cc45-4418-9fe6-12a6dbcd60e7 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:39.305789 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-060d1f23-cc45-4418-9fe6-12a6dbcd60e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:39.323876 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875e790-a3b1-4653-b76f-470966017360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:39.324711 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875e790-a3b1-4653-b76f-470966017360 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:39.324998 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875e790-a3b1-4653-b76f-470966017360 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:39.325275 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875e790-a3b1-4653-b76f-470966017360 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:39.332655 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875e790-a3b1-4653-b76f-470966017360 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:39.334087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875e790-a3b1-4653-b76f-470966017360 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:39.349894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-5875e790-a3b1-4653-b76f-470966017360 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:36:39.349894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:39.349894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:39.349894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:39.349894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:39.349894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:39.349894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:39.349894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:39.349894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:39.349894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:39.349894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:39.349894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:39.349894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:36:39.349894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:36:39.349894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:36:39.349894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:36:39.352018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:39.352018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:39.352018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:39.352018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:39.352018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:39.352018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:39.352018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:39.352018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:39.352018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:39.352018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:39.352018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:39.352018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:39.352018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:39.352018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:39.352018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:39.352018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:39.352018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:39.352018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:39.362134 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:39.362134 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:39.362134 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:36:39.362134 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:36:39.362134 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:36:39.362134 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:36:39.362134 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:36:39.362134 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:36:39.362134 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:36:39.362134 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:39.362134 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 395/800] 10.222.0.119 () {56 vars in 1098 bytes} [Thu Jul 14 15:36:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:39.362134 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875e790-a3b1-4653-b76f-470966017360 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:39.367703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:39.395786 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 406/801] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:39 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:36:39.396811 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d1f23-cc45-4418-9fe6-12a6dbcd60e7 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:39.481120 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875e790-a3b1-4653-b76f-470966017360 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:39.515207 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d1f23-cc45-4418-9fe6-12a6dbcd60e7 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:39.524341 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a32ff-f700-474c-a177-1bf6e6013806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:39.525712 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a32ff-f700-474c-a177-1bf6e6013806 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:39.526311 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a32ff-f700-474c-a177-1bf6e6013806 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:39.526603 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a32ff-f700-474c-a177-1bf6e6013806 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:39.537418 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a32ff-f700-474c-a177-1bf6e6013806 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:39.539081 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a32ff-f700-474c-a177-1bf6e6013806 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:39.549846 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e73476-6717-4680-a68a-080268b05488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:39.550656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e73476-6717-4680-a68a-080268b05488 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:39.550937 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e73476-6717-4680-a68a-080268b05488 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:39.551219 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e73476-6717-4680-a68a-080268b05488 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:39.558213 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-670a32ff-f700-474c-a177-1bf6e6013806 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:39.558213 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:39.558213 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:39.558213 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:39.558213 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:39.558213 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:39.558213 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:39.558213 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:39.558213 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:39.558213 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:39.558213 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:39.558213 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:39.558213 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:39.558213 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:39.558213 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:39.559280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:39.559280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:39.559280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:39.559280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:39.559280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:39.559280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:39.559280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:39.559280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:39.559280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:39.559280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:39.559280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:39.559280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:39.559280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:39.559280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:39.559280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:39.559280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:39.559280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:39.564869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:39.564869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:39.564869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:39.564869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:39.564869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 396/802] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:39.564869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a32ff-f700-474c-a177-1bf6e6013806 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:39.565290 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e73476-6717-4680-a68a-080268b05488 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:39.565290 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e73476-6717-4680-a68a-080268b05488 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:39.566001 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:39.582494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-76e73476-6717-4680-a68a-080268b05488 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:39.582494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:39.582494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:39.582494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:39.582494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:39.582494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:39.582494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:39.582494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:39.582494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:39.582494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:39.582494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:39.582494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:39.582494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:39.582494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:39.582494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:39.584408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:39.584408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:39.584408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:39.584408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:39.584408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:39.584408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:39.584408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:39.584408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:39.584408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:39.584408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:39.584408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:39.584408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:39.584408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:39.584408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:39.584408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:39.584408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:39.584408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:39.585343 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:39.585343 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:39.585343 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:39.585343 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:39.585343 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 407/803] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:39.585343 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e73476-6717-4680-a68a-080268b05488 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:39.615790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:39.670101 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a32ff-f700-474c-a177-1bf6e6013806 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:39.691429 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e73476-6717-4680-a68a-080268b05488 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:39.703515 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793bdef-072f-4a9b-b507-f669e25ccb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:39.704214 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793bdef-072f-4a9b-b507-f669e25ccb04 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:39.704503 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793bdef-072f-4a9b-b507-f669e25ccb04 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:39.704781 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793bdef-072f-4a9b-b507-f669e25ccb04 None admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:39.705611 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793bdef-072f-4a9b-b507-f669e25ccb04 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:39.705918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793bdef-072f-4a9b-b507-f669e25ccb04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:39.707331 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793bdef-072f-4a9b-b507-f669e25ccb04 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:39.724979 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 397/804] 10.222.0.119 () {56 vars in 1138 bytes} [Thu Jul 14 15:36:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:39.725705 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5cb21a-3c30-4c92-bd83-8e936820b28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:39.726600 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cb21a-3c30-4c92-bd83-8e936820b28e None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:39.726844 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a2823-9d24-4df4-9732-4018caa8325e None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:39.726949 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cb21a-3c30-4c92-bd83-8e936820b28e None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:39.727149 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a2823-9d24-4df4-9732-4018caa8325e None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:39.727246 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cb21a-3c30-4c92-bd83-8e936820b28e None admin] PATH_INFO: `/v3/services/network` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:39.727393 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a2823-9d24-4df4-9732-4018caa8325e None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:39.727806 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5cb21a-3c30-4c92-bd83-8e936820b28e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:39.728840 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 398/805] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:39.729342 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a2823-9d24-4df4-9732-4018caa8325e None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:39.730861 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5cb21a-3c30-4c92-bd83-8e936820b28e None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:39.744071 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-1a5cb21a-3c30-4c92-bd83-8e936820b28e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 15:36:39.744071 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:39.744071 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:36:39.744071 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:36:39.744071 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:36:39.744071 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:36:39.744071 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:36:39.744071 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:39.744071 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 15:36:39.744071 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:39.744071 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:36:39.744071 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:39.744071 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:39.744071 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:39.744071 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:39.744071 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:39.744071 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:39.745126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:39.745126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:39.745126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:39.745126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:39.745126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:39.745126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:39.745126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:36:39.745126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:36:39.745126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:36:39.745126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:36:39.745126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:39.745126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:39.745126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:39.745126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:39.745126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:39.745126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:39.745958 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:39.745958 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:39.745958 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:39.745958 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:39.745958 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:39.745958 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:39.745958 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:39.745958 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:39.745958 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:39.745958 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:39.745958 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:36:39.745958 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:39.745958 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 15:36:39.745958 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:39.745958 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 408/806] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:39 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:39.746736 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5cb21a-3c30-4c92-bd83-8e936820b28e None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:39.799211 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:39.840317 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a2823-9d24-4df4-9732-4018caa8325e None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:39.843033 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:39.852020 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5cb21a-3c30-4c92-bd83-8e936820b28e None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:39.875394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d404fa-fe25-4488-ac9b-054bf689610a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:39.876056 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d404fa-fe25-4488-ac9b-054bf689610a None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:39.876392 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d404fa-fe25-4488-ac9b-054bf689610a None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:39.876667 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d404fa-fe25-4488-ac9b-054bf689610a None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:39.877417 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d404fa-fe25-4488-ac9b-054bf689610a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:39.877682 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d404fa-fe25-4488-ac9b-054bf689610a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:39.879064 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d404fa-fe25-4488-ac9b-054bf689610a None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:39.885743 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f48466-922b-4493-b74c-3ca972f1c4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:39.886419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f48466-922b-4493-b74c-3ca972f1c4f5 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:39.886713 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f48466-922b-4493-b74c-3ca972f1c4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:39.886994 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f48466-922b-4493-b74c-3ca972f1c4f5 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:39.887736 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f48466-922b-4493-b74c-3ca972f1c4f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:39.888035 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f48466-922b-4493-b74c-3ca972f1c4f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:39.889427 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f48466-922b-4493-b74c-3ca972f1c4f5 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:39.890231 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 399/807] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:39.891013 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d404fa-fe25-4488-ac9b-054bf689610a None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:39.901492 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 409/808] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:39.902799 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b4e2b-76d8-4bee-a6e3-1e4322f991b3 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:39.903152 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b4e2b-76d8-4bee-a6e3-1e4322f991b3 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:39.903437 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b4e2b-76d8-4bee-a6e3-1e4322f991b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:39.922559 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-8a2b4e2b-76d8-4bee-a6e3-1e4322f991b3 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:39.923759 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-8a2b4e2b-76d8-4bee-a6e3-1e4322f991b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:39.991317 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 410/809] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:39 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:36:39.992420 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b4e2b-76d8-4bee-a6e3-1e4322f991b3 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:39.994045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d404fa-fe25-4488-ac9b-054bf689610a None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:40.015856 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:40.030034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ceab3d-60ce-4e56-8a8a-7c3719e0e086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:40.030689 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ceab3d-60ce-4e56-8a8a-7c3719e0e086 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:40.031018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ceab3d-60ce-4e56-8a8a-7c3719e0e086 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:40.031296 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ceab3d-60ce-4e56-8a8a-7c3719e0e086 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:40.075253 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:40.093970 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b4e2b-76d8-4bee-a6e3-1e4322f991b3 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:40.098629 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ceab3d-60ce-4e56-8a8a-7c3719e0e086 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:40.100844 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ceab3d-60ce-4e56-8a8a-7c3719e0e086 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:40.129461 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33155fa0-0183-4a59-87e4-7fcb03489723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:40.130138 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33155fa0-0183-4a59-87e4-7fcb03489723 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:40.130430 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33155fa0-0183-4a59-87e4-7fcb03489723 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:40.130711 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33155fa0-0183-4a59-87e4-7fcb03489723 None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:40.131420 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33155fa0-0183-4a59-87e4-7fcb03489723 None admin] RBAC: Adding query filter params (name=network) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:40.131767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33155fa0-0183-4a59-87e4-7fcb03489723 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:40.133132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33155fa0-0183-4a59-87e4-7fcb03489723 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:40.137638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 411/810] 10.222.0.119 () {56 vars in 1117 bytes} [Thu Jul 14 15:36:39 2022] GET /identity/v3/services?name=network => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:40.138461 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33155fa0-0183-4a59-87e4-7fcb03489723 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:40.204061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 400/811] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:36:39 2022] GET /identity/v3/auth/tokens => generated 1003 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:36:40.205183 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ceab3d-60ce-4e56-8a8a-7c3719e0e086 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:40.227770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:40.237757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33155fa0-0183-4a59-87e4-7fcb03489723 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:40.273227 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b18da5-38d4-47d1-96af-7b6085d701a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:40.273963 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b18da5-38d4-47d1-96af-7b6085d701a2 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:40.274254 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b18da5-38d4-47d1-96af-7b6085d701a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:40.274535 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b18da5-38d4-47d1-96af-7b6085d701a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:40.281343 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b18da5-38d4-47d1-96af-7b6085d701a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:40.282793 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b18da5-38d4-47d1-96af-7b6085d701a2 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:40.297099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-f0b18da5-38d4-47d1-96af-7b6085d701a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:40.297099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:40.297099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:40.297099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:40.297099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:40.297099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:40.297099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:40.297099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:40.297099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:40.297099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:40.297099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:40.297099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:40.297099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:36:40.297099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:36:40.297099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:36:40.298023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:36:40.298023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:40.298023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:40.298023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:40.298023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:40.298023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:40.298023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:40.298023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:40.298023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:40.298023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:40.298023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:40.298023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:40.298023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:40.298023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:40.298023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:40.298023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:40.298023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:40.298913 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:36:40.298913 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:36:40.298913 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:36:40.298913 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:36:40.298913 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:36:40.298913 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:36:40.298913 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:40.298913 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:40.298913 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 412/812] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:40.299405 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b18da5-38d4-47d1-96af-7b6085d701a2 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:40.308581 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:40.309943 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ceab3d-60ce-4e56-8a8a-7c3719e0e086 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:40.344577 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b1e7b-b2c3-49be-99f3-f7a2a34d3bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:40.345397 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b1e7b-b2c3-49be-99f3-f7a2a34d3bf1 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:40.345683 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b1e7b-b2c3-49be-99f3-f7a2a34d3bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:40.345960 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b1e7b-b2c3-49be-99f3-f7a2a34d3bf1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:40.353019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b1e7b-b2c3-49be-99f3-f7a2a34d3bf1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:40.354450 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b1e7b-b2c3-49be-99f3-f7a2a34d3bf1 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:40.368750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-ef7b1e7b-b2c3-49be-99f3-f7a2a34d3bf1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:36:40.368750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:40.368750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:40.368750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:40.368750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:40.368750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:40.368750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:40.368750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:40.368750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:40.368750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:40.368750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:40.368750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:40.368750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:36:40.368750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:36:40.368750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:36:40.368750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:36:40.369774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:40.369774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:40.369774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:40.369774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:40.369774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:40.369774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:40.369774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:40.369774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:40.369774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:40.369774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:40.369774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:40.369774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:40.369774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:40.369774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:40.369774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:40.369774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:40.369774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:40.369774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:40.370742 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:40.370742 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:40.370742 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:36:40.370742 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:36:40.370742 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:36:40.370742 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:36:40.370742 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:36:40.370742 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:36:40.370742 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:36:40.370742 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:40.370742 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 401/813] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:36:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:40.370742 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b1e7b-b2c3-49be-99f3-f7a2a34d3bf1 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:40.403819 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b18da5-38d4-47d1-96af-7b6085d701a2 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:40.438690 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff820c-4159-4fac-9f22-5062841f6f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:40.439504 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff820c-4159-4fac-9f22-5062841f6f12 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:40.439824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff820c-4159-4fac-9f22-5062841f6f12 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:40.440128 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff820c-4159-4fac-9f22-5062841f6f12 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:40.440782 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff820c-4159-4fac-9f22-5062841f6f12 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:40.442156 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff820c-4159-4fac-9f22-5062841f6f12 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:40.451556 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:40.454441 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-ceff820c-4159-4fac-9f22-5062841f6f12 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 15:36:40.454441 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:40.454441 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:36:40.454441 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:36:40.454441 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:36:40.454441 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:36:40.454441 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:36:40.454441 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:40.454441 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 15:36:40.454441 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:40.454441 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:36:40.454441 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:40.454441 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:40.454441 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:40.454441 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:40.454441 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:40.455555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:40.455555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:40.455555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:40.455555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:40.455555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:40.455555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:40.455555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:40.455555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:36:40.455555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:36:40.455555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:36:40.455555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:36:40.455555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:40.455555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:40.455555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:40.455555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:40.455555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:40.456612 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:40.456612 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:40.456612 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:40.456612 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:40.456612 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:40.456612 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:40.456612 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:40.456612 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:40.456612 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:40.456612 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:40.456612 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:40.456612 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:36:40.456612 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:40.456612 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 15:36:40.456612 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:40.456612 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 413/814] 10.222.0.119 () {56 vars in 1134 bytes} [Thu Jul 14 15:36:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:40.457861 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff820c-4159-4fac-9f22-5062841f6f12 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:40.473307 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b1e7b-b2c3-49be-99f3-f7a2a34d3bf1 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:40.508599 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de057f9e-eb5c-4ee3-a7df-f020980b1ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:40.509267 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de057f9e-eb5c-4ee3-a7df-f020980b1ded None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:40.509554 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de057f9e-eb5c-4ee3-a7df-f020980b1ded None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:40.509836 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de057f9e-eb5c-4ee3-a7df-f020980b1ded None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:40.510548 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de057f9e-eb5c-4ee3-a7df-f020980b1ded None admin] RBAC: Adding query filter params (type=network) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:40.510867 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de057f9e-eb5c-4ee3-a7df-f020980b1ded None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:40.512286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de057f9e-eb5c-4ee3-a7df-f020980b1ded None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:40.519966 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 402/815] 10.222.0.119 () {56 vars in 1117 bytes} [Thu Jul 14 15:36:40 2022] GET /identity/v3/services?type=network => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:40.520808 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de057f9e-eb5c-4ee3-a7df-f020980b1ded None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:40.528695 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:40.559085 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff820c-4159-4fac-9f22-5062841f6f12 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:40.594027 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f0e60-aa60-4574-96fc-ed494b66e064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:40.594832 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f0e60-aa60-4574-96fc-ed494b66e064 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:40.595122 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f0e60-aa60-4574-96fc-ed494b66e064 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:40.595407 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f0e60-aa60-4574-96fc-ed494b66e064 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:40.606809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f0e60-aa60-4574-96fc-ed494b66e064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:40.608336 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f0e60-aa60-4574-96fc-ed494b66e064 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:40.620769 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de057f9e-eb5c-4ee3-a7df-f020980b1ded None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:40.625415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-926f0e60-aa60-4574-96fc-ed494b66e064 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:40.625415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:40.625415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:40.625415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:40.625415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:40.625415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:40.625415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:40.625415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:40.625415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:40.625415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:40.625415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:40.625415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:40.625415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:40.625415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:40.625415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:40.626284 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:40.626284 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:40.626284 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:40.626284 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:40.626284 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:40.626284 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:40.626284 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:40.626284 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:40.626284 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:40.626284 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:40.626284 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:40.626284 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:40.626284 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:40.626284 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:40.626284 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:40.626284 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:40.626284 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:40.627165 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:40.627165 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:40.627165 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:40.627165 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:40.627165 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 414/816] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:40.627818 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f0e60-aa60-4574-96fc-ed494b66e064 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:40.659121 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c5ea7-35d9-4a4c-915f-a06a1a2983a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:40.659783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c5ea7-35d9-4a4c-915f-a06a1a2983a8 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:40.660067 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c5ea7-35d9-4a4c-915f-a06a1a2983a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:40.660374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c5ea7-35d9-4a4c-915f-a06a1a2983a8 None admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:40.661156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c5ea7-35d9-4a4c-915f-a06a1a2983a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:40.661466 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c5ea7-35d9-4a4c-915f-a06a1a2983a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:40.663434 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c5ea7-35d9-4a4c-915f-a06a1a2983a8 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:40.676870 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 403/817] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:36:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:40.677924 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c5ea7-35d9-4a4c-915f-a06a1a2983a8 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:40.683931 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:40.738786 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f0e60-aa60-4574-96fc-ed494b66e064 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:40.762919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:40.775123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9a29d-7994-4f50-9a48-0b2ab2eddc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:40.775804 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9a29d-7994-4f50-9a48-0b2ab2eddc12 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:40.776090 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9a29d-7994-4f50-9a48-0b2ab2eddc12 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:40.776397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9a29d-7994-4f50-9a48-0b2ab2eddc12 None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:40.777257 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9a29d-7994-4f50-9a48-0b2ab2eddc12 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:40.777567 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9a29d-7994-4f50-9a48-0b2ab2eddc12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:40.779140 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9a29d-7994-4f50-9a48-0b2ab2eddc12 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:40.793927 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c5ea7-35d9-4a4c-915f-a06a1a2983a8 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:40.830319 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de30d9e-4303-405b-84f7-4d7b6921e88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:40.831012 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de30d9e-4303-405b-84f7-4d7b6921e88d None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:40.831304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de30d9e-4303-405b-84f7-4d7b6921e88d None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:40.831588 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de30d9e-4303-405b-84f7-4d7b6921e88d None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:40.832342 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de30d9e-4303-405b-84f7-4d7b6921e88d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:40.832656 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de30d9e-4303-405b-84f7-4d7b6921e88d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:40.834060 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de30d9e-4303-405b-84f7-4d7b6921e88d None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:40.840145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 404/818] 10.222.0.119 () {56 vars in 1129 bytes} [Thu Jul 14 15:36:40 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:40.841052 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de30d9e-4303-405b-84f7-4d7b6921e88d None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:40.910643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:40.914028 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 415/819] 10.222.0.119 () {56 vars in 1140 bytes} [Thu Jul 14 15:36:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:40.914869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9a29d-7994-4f50-9a48-0b2ab2eddc12 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:40.946248 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de30d9e-4303-405b-84f7-4d7b6921e88d None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:40.981319 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789484a-916d-4745-970f-a61dee7e168c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:40.981983 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789484a-916d-4745-970f-a61dee7e168c None admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:40.982269 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789484a-916d-4745-970f-a61dee7e168c None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:40.982547 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789484a-916d-4745-970f-a61dee7e168c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:40.983286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789484a-916d-4745-970f-a61dee7e168c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:40.984706 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789484a-916d-4745-970f-a61dee7e168c None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:41.013510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9a29d-7994-4f50-9a48-0b2ab2eddc12 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:41.052424 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74717ad9-a078-407a-8a8a-9b5cc9de6cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:41.053010 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74717ad9-a078-407a-8a8a-9b5cc9de6cef None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:41.053338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74717ad9-a078-407a-8a8a-9b5cc9de6cef None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:41.053611 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74717ad9-a078-407a-8a8a-9b5cc9de6cef None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:41.054405 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74717ad9-a078-407a-8a8a-9b5cc9de6cef None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:41.054708 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74717ad9-a078-407a-8a8a-9b5cc9de6cef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:41.056073 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74717ad9-a078-407a-8a8a-9b5cc9de6cef None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:41.067283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 416/820] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:41.068046 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74717ad9-a078-407a-8a8a-9b5cc9de6cef None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:41.088129 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 405/821] 10.222.0.119 () {60 vars in 1149 bytes} [Thu Jul 14 15:36:40 2022] POST /identity/v3/endpoints => generated 329 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:41.088129 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789484a-916d-4745-970f-a61dee7e168c None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:41.115594 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:41.186872 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74717ad9-a078-407a-8a8a-9b5cc9de6cef None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:41.201635 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789484a-916d-4745-970f-a61dee7e168c None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:41.225740 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb8cbc-3df8-4381-b841-9ff1ba942f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:41.226815 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb8cbc-3df8-4381-b841-9ff1ba942f6f None admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:41.226955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:41.227277 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb8cbc-3df8-4381-b841-9ff1ba942f6f None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:41.227561 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb8cbc-3df8-4381-b841-9ff1ba942f6f None admin] PATH_INFO: `/v3/projects/07652ced88cf4f069d1765176be5130b/users/4a1474b39e0b477daff5833491cd6df5/roles/92c47f3813b04366b3019ba2a56337eb` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:41.241965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d52a7-0a43-4578-9658-818fe415fd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:41.242650 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d52a7-0a43-4578-9658-818fe415fd84 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:41.242799 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb8cbc-3df8-4381-b841-9ff1ba942f6f None admin] RBAC: Authorizing `identity:create_grant(project_id=07652ced88cf4f069d1765176be5130b, user_id=4a1474b39e0b477daff5833491cd6df5, role_id=92c47f3813b04366b3019ba2a56337eb)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:41.242937 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d52a7-0a43-4578-9658-818fe415fd84 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:41.243218 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d52a7-0a43-4578-9658-818fe415fd84 None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:41.243937 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d52a7-0a43-4578-9658-818fe415fd84 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:41.244194 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb8cbc-3df8-4381-b841-9ff1ba942f6f None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:41.245081 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d52a7-0a43-4578-9658-818fe415fd84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:41.246532 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d52a7-0a43-4578-9658-818fe415fd84 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:41.252145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 406/822] 10.222.0.119 () {56 vars in 1129 bytes} [Thu Jul 14 15:36:41 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:41.252946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d52a7-0a43-4578-9658-818fe415fd84 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:41.299723 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 417/823] 10.222.0.119 () {58 vars in 1444 bytes} [Thu Jul 14 15:36:41 2022] PUT /identity/v3/projects/07652ced88cf4f069d1765176be5130b/users/4a1474b39e0b477daff5833491cd6df5/roles/92c47f3813b04366b3019ba2a56337eb => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:36:41.299938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb8cbc-3df8-4381-b841-9ff1ba942f6f None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:41.377129 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d52a7-0a43-4578-9658-818fe415fd84 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:41.406603 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:41.416504 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46439f70-8c68-425a-aaa8-e27d20889558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:41.417453 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46439f70-8c68-425a-aaa8-e27d20889558 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:41.425306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46439f70-8c68-425a-aaa8-e27d20889558 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:41.425306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46439f70-8c68-425a-aaa8-e27d20889558 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:41.425534 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb8cbc-3df8-4381-b841-9ff1ba942f6f None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:41.432264 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46439f70-8c68-425a-aaa8-e27d20889558 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:41.433946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46439f70-8c68-425a-aaa8-e27d20889558 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:41.453680 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-46439f70-8c68-425a-aaa8-e27d20889558 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:41.453680 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:41.453680 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:41.453680 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:41.453680 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:41.453680 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:41.453680 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:41.453680 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:41.453680 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:41.453680 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:41.453680 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:41.453680 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:41.453680 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:41.453680 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:41.453680 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:41.454681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:41.454681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:41.454681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:41.454681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:41.454681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:41.454681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:41.454681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:41.454681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:41.454681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:41.454681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:41.454681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:41.454681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:41.454681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:41.454681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:41.454681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:41.454681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:41.454681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:41.455703 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:41.455703 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:41.455703 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:41.455703 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:41.455703 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 407/824] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:41.456018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46439f70-8c68-425a-aaa8-e27d20889558 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:41.459076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143135b-4652-41aa-816a-75ae7a2e3bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:41.460077 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143135b-4652-41aa-816a-75ae7a2e3bbf None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:41.460653 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143135b-4652-41aa-816a-75ae7a2e3bbf None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:41.461118 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143135b-4652-41aa-816a-75ae7a2e3bbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:41.470897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143135b-4652-41aa-816a-75ae7a2e3bbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:41.472535 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143135b-4652-41aa-816a-75ae7a2e3bbf None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:41.487099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-9143135b-4652-41aa-816a-75ae7a2e3bbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:41.487099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:41.487099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:41.487099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:41.487099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:41.487099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:41.487099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:41.487099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:41.487099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:41.487099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:41.487099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:41.487099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:41.487099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:36:41.487099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:36:41.487099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:36:41.488225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:36:41.488225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:41.488225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:41.488225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:41.488225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:41.488225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:41.488225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:41.488225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:41.488225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:41.488225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:41.488225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:41.488225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:41.488225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:41.488225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:41.488225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:41.488225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:41.488225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:41.494705 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:36:41.494705 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:36:41.494705 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:36:41.494705 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:36:41.494705 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:36:41.494705 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:36:41.494705 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:41.494705 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:41.494705 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 418/825] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:41.494705 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143135b-4652-41aa-816a-75ae7a2e3bbf None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:41.505371 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:41.583576 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46439f70-8c68-425a-aaa8-e27d20889558 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:41.606269 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143135b-4652-41aa-816a-75ae7a2e3bbf None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:41.626641 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566a6a5-c6b7-4b69-841a-a5cfde37e386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:41.627589 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566a6a5-c6b7-4b69-841a-a5cfde37e386 None admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:41.628223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566a6a5-c6b7-4b69-841a-a5cfde37e386 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:41.628574 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566a6a5-c6b7-4b69-841a-a5cfde37e386 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:41.629396 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566a6a5-c6b7-4b69-841a-a5cfde37e386 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:41.631049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566a6a5-c6b7-4b69-841a-a5cfde37e386 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:41.642090 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c0129-8ed6-46e9-a97c-b635724f6f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:41.642857 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c0129-8ed6-46e9-a97c-b635724f6f6b None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:41.643144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c0129-8ed6-46e9-a97c-b635724f6f6b None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:41.643420 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c0129-8ed6-46e9-a97c-b635724f6f6b None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:41.644463 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c0129-8ed6-46e9-a97c-b635724f6f6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:41.644463 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c0129-8ed6-46e9-a97c-b635724f6f6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:41.645840 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c0129-8ed6-46e9-a97c-b635724f6f6b None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:41.664233 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 419/826] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:41.664233 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c0129-8ed6-46e9-a97c-b635724f6f6b None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:41.679461 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:41.733281 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 408/827] 10.222.0.119 () {60 vars in 1149 bytes} [Thu Jul 14 15:36:41 2022] POST /identity/v3/endpoints => generated 348 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:41.734356 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566a6a5-c6b7-4b69-841a-a5cfde37e386 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:41.790269 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c0129-8ed6-46e9-a97c-b635724f6f6b None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:41.837127 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3e66a-8e69-4d0b-85a1-da49aea8ecfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:41.838055 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3e66a-8e69-4d0b-85a1-da49aea8ecfe None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:41.838507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3e66a-8e69-4d0b-85a1-da49aea8ecfe None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:41.838929 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3e66a-8e69-4d0b-85a1-da49aea8ecfe None admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:41.839870 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3e66a-8e69-4d0b-85a1-da49aea8ecfe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:41.840369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3e66a-8e69-4d0b-85a1-da49aea8ecfe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:41.841970 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3e66a-8e69-4d0b-85a1-da49aea8ecfe None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:41.861024 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 420/828] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:36:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:41.862312 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3e66a-8e69-4d0b-85a1-da49aea8ecfe None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:41.947532 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:41.952573 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:41.962759 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566a6a5-c6b7-4b69-841a-a5cfde37e386 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:42.009087 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3e66a-8e69-4d0b-85a1-da49aea8ecfe None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:42.010185 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669a04d-818c-460d-ab9f-88758cacef12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:42.011148 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669a04d-818c-460d-ab9f-88758cacef12 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:42.011442 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669a04d-818c-460d-ab9f-88758cacef12 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:42.011718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669a04d-818c-460d-ab9f-88758cacef12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:42.020379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669a04d-818c-460d-ab9f-88758cacef12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:42.022254 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669a04d-818c-460d-ab9f-88758cacef12 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:42.041718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-7669a04d-818c-460d-ab9f-88758cacef12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:42.041718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:42.041718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:42.041718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:42.041718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:42.041718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:42.041718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:42.041718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:42.041718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:42.041718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:42.041718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:42.041718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:42.041718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:36:42.041718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:36:42.041718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:36:42.050866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:36:42.050866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:42.050866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:42.050866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:42.050866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:42.050866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:42.050866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:42.050866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:42.050866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:42.050866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:42.050866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:42.050866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:42.050866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:42.050866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:42.050866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:42.050866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:42.050866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:42.051831 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:36:42.051831 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:36:42.051831 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:36:42.051831 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:36:42.051831 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:36:42.051831 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:36:42.051831 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:42.051831 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:42.051831 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 409/829] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:42.052347 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933de251-4b7d-4b4d-9994-2546fda705cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:42.052347 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933de251-4b7d-4b4d-9994-2546fda705cc None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:42.052347 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933de251-4b7d-4b4d-9994-2546fda705cc None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:42.052347 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933de251-4b7d-4b4d-9994-2546fda705cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:42.052618 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669a04d-818c-460d-ab9f-88758cacef12 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:42.052688 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933de251-4b7d-4b4d-9994-2546fda705cc None admin] RBAC: Adding query filter params (role.id=07aaf007cde043318319928d151bdc75, scope.project.id=07652ced88cf4f069d1765176be5130b, user.id=a1e4c833a4684561ab52eda5734a7766) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:42.052688 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933de251-4b7d-4b4d-9994-2546fda705cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:42.052688 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933de251-4b7d-4b4d-9994-2546fda705cc None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:42.061350 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 421/830] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:36:41 2022] GET /identity/v3/role_assignments?user.id=a1e4c833a4684561ab52eda5734a7766&scope.project.id=07652ced88cf4f069d1765176be5130b&role.id=07aaf007cde043318319928d151bdc75 => generated 610 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:42.190678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669a04d-818c-460d-ab9f-88758cacef12 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:42.231004 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6706c2-4999-47ed-8da8-3c52b3ca47f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:42.231747 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6706c2-4999-47ed-8da8-3c52b3ca47f3 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:42.232162 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6706c2-4999-47ed-8da8-3c52b3ca47f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:42.232540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6706c2-4999-47ed-8da8-3c52b3ca47f3 None admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:42.233447 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6706c2-4999-47ed-8da8-3c52b3ca47f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:42.233857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6706c2-4999-47ed-8da8-3c52b3ca47f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:42.235400 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6706c2-4999-47ed-8da8-3c52b3ca47f3 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:42.248333 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 410/831] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:36:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:42.254126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933de251-4b7d-4b4d-9994-2546fda705cc None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:42.363007 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933de251-4b7d-4b4d-9994-2546fda705cc None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:42.393096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:42.399544 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6740e8-fdaa-4a20-8e15-4db3ec819d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:42.400486 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6740e8-fdaa-4a20-8e15-4db3ec819d19 None admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:42.400776 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6740e8-fdaa-4a20-8e15-4db3ec819d19 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:42.401062 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6740e8-fdaa-4a20-8e15-4db3ec819d19 None admin] PATH_INFO: `/v3/projects/07652ced88cf4f069d1765176be5130b/users/28a5c169576e432c8174a562ae358e8b/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:42.403364 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6740e8-fdaa-4a20-8e15-4db3ec819d19 None admin] RBAC: Authorizing `identity:create_grant(project_id=07652ced88cf4f069d1765176be5130b, user_id=28a5c169576e432c8174a562ae358e8b, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:42.407340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6740e8-fdaa-4a20-8e15-4db3ec819d19 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:42.494465 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 422/832] 10.222.0.119 () {58 vars in 1444 bytes} [Thu Jul 14 15:36:42 2022] PUT /identity/v3/projects/07652ced88cf4f069d1765176be5130b/users/28a5c169576e432c8174a562ae358e8b/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:36:43.405570 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ae385-e758-4eba-a94c-9a6f803d718e None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:43.406092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ae385-e758-4eba-a94c-9a6f803d718e None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:43.406202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ae385-e758-4eba-a94c-9a6f803d718e None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:43.407737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 411/833] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:43.413096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155ad36-0995-4b3c-af22-f03c633e906e None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:43.413484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155ad36-0995-4b3c-af22-f03c633e906e None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:43.413756 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155ad36-0995-4b3c-af22-f03c633e906e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:43.431154 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-d155ad36-0995-4b3c-af22-f03c633e906e None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:43.432396 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-d155ad36-0995-4b3c-af22-f03c633e906e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:43.504039 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 423/834] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:43 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:36:43.528135 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ae385-e758-4eba-a94c-9a6f803d718e None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:43.543571 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:43.639331 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ae385-e758-4eba-a94c-9a6f803d718e None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:43.679916 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cbdbe-48e1-4d74-9c50-00b17fc84d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:43.680678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cbdbe-48e1-4d74-9c50-00b17fc84d6a None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:43.680971 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cbdbe-48e1-4d74-9c50-00b17fc84d6a None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:43.681250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cbdbe-48e1-4d74-9c50-00b17fc84d6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:43.692727 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cbdbe-48e1-4d74-9c50-00b17fc84d6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:36:43.700815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-ad2cbdbe-48e1-4d74-9c50-00b17fc84d6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:43.700815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:43.700815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:43.700815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:43.700815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:43.700815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:43.700815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:43.700815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:43.700815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:43.700815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:43.700815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:43.700815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:43.700815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:36:43.700815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:36:43.700815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:36:43.700815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:36:43.701738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:36:43.701738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:36:43.701738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:36:43.701738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:36:43.701738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:43.701738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:43.701738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:43.701738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:43.701738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:43.701738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:43.701738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:43.701738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:43.701738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:43.701738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:43.701738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:43.701738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:43.702556 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:43.702556 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:43.702556 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:43.702556 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:43.702556 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:36:43.702556 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:36:43.702556 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:36:43.702556 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:36:43.702556 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:36:43.702556 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:36:43.702556 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:36:43.702556 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:43.702556 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 412/835] 10.222.0.119 () {56 vars in 1107 bytes} [Thu Jul 14 15:36:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:43.708406 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155ad36-0995-4b3c-af22-f03c633e906e None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:43.830058 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155ad36-0995-4b3c-af22-f03c633e906e None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:43.853890 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:43.868810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a16fd-f8fe-47ac-9614-2208ba228515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:43.869815 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a16fd-f8fe-47ac-9614-2208ba228515 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:43.870299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a16fd-f8fe-47ac-9614-2208ba228515 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:43.870798 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a16fd-f8fe-47ac-9614-2208ba228515 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:43.871738 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a16fd-f8fe-47ac-9614-2208ba228515 None admin] RBAC: Adding query filter params (name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:43.872278 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a16fd-f8fe-47ac-9614-2208ba228515 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:43.873865 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a16fd-f8fe-47ac-9614-2208ba228515 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:43.884474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 424/836] 10.222.0.119 () {56 vars in 1108 bytes} [Thu Jul 14 15:36:43 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:43.889852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cbdbe-48e1-4d74-9c50-00b17fc84d6a None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:43.968636 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:43.986162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c46e6-ba2c-4939-9956-bcb11558c6f2 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:43.986456 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c46e6-ba2c-4939-9956-bcb11558c6f2 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:43.986740 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c46e6-ba2c-4939-9956-bcb11558c6f2 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:43.988330 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 425/837] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:43.994363 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a660e-38fd-4d35-be63-7d3b80d629bf None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:43.994363 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a660e-38fd-4d35-be63-7d3b80d629bf None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:43.994363 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a660e-38fd-4d35-be63-7d3b80d629bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:44.008066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cbdbe-48e1-4d74-9c50-00b17fc84d6a None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:44.013158 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-446a660e-38fd-4d35-be63-7d3b80d629bf None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:44.014580 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-446a660e-38fd-4d35-be63-7d3b80d629bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:44.052966 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d661c15-1d69-4633-b9a9-28153f8d357c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:44.054316 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d661c15-1d69-4633-b9a9-28153f8d357c None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:44.054615 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d661c15-1d69-4633-b9a9-28153f8d357c None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:44.054902 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d661c15-1d69-4633-b9a9-28153f8d357c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:44.068275 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d661c15-1d69-4633-b9a9-28153f8d357c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:44.071373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d661c15-1d69-4633-b9a9-28153f8d357c None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:44.096132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-5d661c15-1d69-4633-b9a9-28153f8d357c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:44.096132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:44.096132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:44.096132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:44.096132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:44.096132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:44.096132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:44.096132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:44.096132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:44.096132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:44.096132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:44.096132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:44.096132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:44.096132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:44.096132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:44.097073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:44.097073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:44.097073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:44.097073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:44.097073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:44.097073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:44.097073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:44.097073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:44.097073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:44.097073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:44.097073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:44.097073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:44.097073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:44.097073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:44.097073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:44.097073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:44.097073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:44.097948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:44.097948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:44.097948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:44.097948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:44.097948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 413/838] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:44.098808 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 426/839] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:43 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:36:44.105061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d661c15-1d69-4633-b9a9-28153f8d357c None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:44.122052 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a660e-38fd-4d35-be63-7d3b80d629bf None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:44.223490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d661c15-1d69-4633-b9a9-28153f8d357c None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:44.248694 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:44.251923 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a660e-38fd-4d35-be63-7d3b80d629bf None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:44.261517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda0d9f-a116-46f5-9b7c-9b9b98b41596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:44.262468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda0d9f-a116-46f5-9b7c-9b9b98b41596 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:44.263268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda0d9f-a116-46f5-9b7c-9b9b98b41596 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:44.263766 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda0d9f-a116-46f5-9b7c-9b9b98b41596 None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:44.265028 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda0d9f-a116-46f5-9b7c-9b9b98b41596 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:44.269952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda0d9f-a116-46f5-9b7c-9b9b98b41596 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:44.269952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda0d9f-a116-46f5-9b7c-9b9b98b41596 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:44.270153 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:44.288824 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 414/840] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:44.290667 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda0d9f-a116-46f5-9b7c-9b9b98b41596 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:44.297479 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d245c-c261-41b2-b5f8-b238edfeb4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:44.298297 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d245c-c261-41b2-b5f8-b238edfeb4e4 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:44.298581 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d245c-c261-41b2-b5f8-b238edfeb4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:44.298858 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d245c-c261-41b2-b5f8-b238edfeb4e4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:44.299579 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d245c-c261-41b2-b5f8-b238edfeb4e4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:44.301057 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d245c-c261-41b2-b5f8-b238edfeb4e4 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:44.314941 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-7f3d245c-c261-41b2-b5f8-b238edfeb4e4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 15:36:44.314941 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:44.314941 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:36:44.314941 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:36:44.314941 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:36:44.314941 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:36:44.314941 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:36:44.314941 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:44.314941 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 15:36:44.314941 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:44.314941 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:36:44.314941 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:44.314941 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:44.314941 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:44.314941 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:44.314941 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:44.314941 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:44.315977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:44.315977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:44.315977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:44.315977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:44.315977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:44.315977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:44.315977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:36:44.315977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:36:44.315977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:36:44.315977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:36:44.315977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:44.315977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:44.315977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:44.315977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:44.315977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:44.315977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:44.317318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:44.317318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:44.317318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:44.317318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:44.317318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:44.317318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:44.317318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:44.317318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:44.317318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:44.317318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:44.317318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:36:44.317318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:44.317318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 15:36:44.317318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:44.321891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 427/841] 10.222.0.119 () {56 vars in 1119 bytes} [Thu Jul 14 15:36:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:36:44.324186 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d245c-c261-41b2-b5f8-b238edfeb4e4 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:44.405044 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda0d9f-a116-46f5-9b7c-9b9b98b41596 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:44.436437 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d245c-c261-41b2-b5f8-b238edfeb4e4 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:44.440117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f41a5-2aeb-4701-9023-7f5b29cf65bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:44.440942 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f41a5-2aeb-4701-9023-7f5b29cf65bd None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:44.441229 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f41a5-2aeb-4701-9023-7f5b29cf65bd None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:44.441508 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f41a5-2aeb-4701-9023-7f5b29cf65bd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:44.450534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f41a5-2aeb-4701-9023-7f5b29cf65bd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:44.451979 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f41a5-2aeb-4701-9023-7f5b29cf65bd None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:44.468738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-688f41a5-2aeb-4701-9023-7f5b29cf65bd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:36:44.468738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:44.468738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:44.468738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:44.468738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:44.468738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:44.468738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:44.468738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:44.468738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:44.468738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:44.468738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:44.468738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:44.468738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:36:44.468738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:36:44.468738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:36:44.468738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:36:44.469684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:44.469684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:44.469684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:44.469684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:44.469684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:44.469684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:44.469684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:44.469684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:44.469684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:44.469684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:44.469684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:44.469684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:44.469684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:44.469684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:44.469684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:44.469684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:44.469684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:44.469684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:44.470606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:44.470606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:44.470606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:36:44.470606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:36:44.470606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:36:44.470606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:36:44.470606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:36:44.470606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:36:44.470606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:36:44.470606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:44.470606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 415/842] 10.222.0.119 () {56 vars in 1122 bytes} [Thu Jul 14 15:36:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:36:44.471211 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ad42e-4f8c-4002-aec9-02f331f9d16f None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:44.471844 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ad42e-4f8c-4002-aec9-02f331f9d16f None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:44.471844 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ad42e-4f8c-4002-aec9-02f331f9d16f None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:44.476253 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 416/843] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:44.476253 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ad42e-4f8c-4002-aec9-02f331f9d16f None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:44.478119 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09b95c-5cd4-4f2b-ba55-f78aaef17a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:44.478959 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09b95c-5cd4-4f2b-ba55-f78aaef17a54 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:44.479402 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09b95c-5cd4-4f2b-ba55-f78aaef17a54 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:44.479826 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09b95c-5cd4-4f2b-ba55-f78aaef17a54 None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:44.480997 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09b95c-5cd4-4f2b-ba55-f78aaef17a54 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:44.481469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09b95c-5cd4-4f2b-ba55-f78aaef17a54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:44.483635 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09b95c-5cd4-4f2b-ba55-f78aaef17a54 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:44.491651 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 428/844] 10.222.0.119 () {56 vars in 1119 bytes} [Thu Jul 14 15:36:44 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:44.494003 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3ab6f-e679-4f6a-9fea-3285b7779b25 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:44.494776 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3ab6f-e679-4f6a-9fea-3285b7779b25 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:44.495529 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3ab6f-e679-4f6a-9fea-3285b7779b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:44.521757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-d8d3ab6f-e679-4f6a-9fea-3285b7779b25 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:44.523432 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-d8d3ab6f-e679-4f6a-9fea-3285b7779b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:44.544549 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:44.564557 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:44.608122 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 429/845] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:44 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:36:44.608122 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3ab6f-e679-4f6a-9fea-3285b7779b25 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:44.612728 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ad42e-4f8c-4002-aec9-02f331f9d16f None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:44.650819 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86748f72-6859-4664-bf4d-2fb703a9842a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:44.651498 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86748f72-6859-4664-bf4d-2fb703a9842a None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:44.651782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86748f72-6859-4664-bf4d-2fb703a9842a None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:44.652061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86748f72-6859-4664-bf4d-2fb703a9842a None admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:44.653383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86748f72-6859-4664-bf4d-2fb703a9842a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:44.653699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86748f72-6859-4664-bf4d-2fb703a9842a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:44.655806 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86748f72-6859-4664-bf4d-2fb703a9842a None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:44.675227 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 417/846] 10.222.0.119 () {56 vars in 1154 bytes} [Thu Jul 14 15:36:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:44.676482 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86748f72-6859-4664-bf4d-2fb703a9842a None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:44.720869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3ab6f-e679-4f6a-9fea-3285b7779b25 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:44.754568 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801061ad-f0be-4a5c-b387-b8be0dd09d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:44.755168 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801061ad-f0be-4a5c-b387-b8be0dd09d1d None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:44.755457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801061ad-f0be-4a5c-b387-b8be0dd09d1d None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:44.755742 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801061ad-f0be-4a5c-b387-b8be0dd09d1d None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:44.756487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801061ad-f0be-4a5c-b387-b8be0dd09d1d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:44.757536 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801061ad-f0be-4a5c-b387-b8be0dd09d1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:44.758921 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801061ad-f0be-4a5c-b387-b8be0dd09d1d None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:44.763353 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 430/847] 10.222.0.119 () {56 vars in 1119 bytes} [Thu Jul 14 15:36:44 2022] GET /identity/v3/services?type=volumev3 => generated 126 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:44.771194 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801061ad-f0be-4a5c-b387-b8be0dd09d1d None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:44.778419 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86748f72-6859-4664-bf4d-2fb703a9842a None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:44.780367 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:44.812682 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:44.817205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737362d-92ed-438a-92c7-a244466de3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:44.818052 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737362d-92ed-438a-92c7-a244466de3ad None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:44.818338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737362d-92ed-438a-92c7-a244466de3ad None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:44.818618 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737362d-92ed-438a-92c7-a244466de3ad None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:44.819845 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737362d-92ed-438a-92c7-a244466de3ad None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:44.821461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737362d-92ed-438a-92c7-a244466de3ad None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:44.835718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-a737362d-92ed-438a-92c7-a244466de3ad None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 15:36:44.835718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:44.835718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:36:44.835718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:36:44.835718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:36:44.835718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:36:44.835718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:36:44.835718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:44.835718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 15:36:44.835718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:44.835718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:36:44.835718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:44.835718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:44.835718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:44.835718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:44.835718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:44.837153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:44.837153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:44.837153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:44.837153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:44.837153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:44.837153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:44.837153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:44.837153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:36:44.837153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:36:44.837153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:36:44.837153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:36:44.837153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:44.837153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:44.837153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:44.837153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:44.837153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:44.838018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:44.838018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:44.838018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:44.838018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:44.838018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:44.838018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:44.838018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:44.838018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:44.838018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:44.838018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:44.838018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:44.838018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:36:44.838018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:44.838018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 15:36:44.838018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:44.838018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 418/848] 10.222.0.119 () {56 vars in 1137 bytes} [Thu Jul 14 15:36:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:44.838872 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90130f-5be7-4997-adce-b7f63bdebfc6 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:44.839487 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90130f-5be7-4997-adce-b7f63bdebfc6 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:44.839647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90130f-5be7-4997-adce-b7f63bdebfc6 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:44.844323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 419/849] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:44 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:44.846310 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90130f-5be7-4997-adce-b7f63bdebfc6 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:44.912259 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801061ad-f0be-4a5c-b387-b8be0dd09d1d None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:44.951002 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6b658-9ce7-4534-9df4-a96ef1f7abfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:44.951657 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6b658-9ce7-4534-9df4-a96ef1f7abfc None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:44.951946 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6b658-9ce7-4534-9df4-a96ef1f7abfc None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:44.952269 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6b658-9ce7-4534-9df4-a96ef1f7abfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:44.974246 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90130f-5be7-4997-adce-b7f63bdebfc6 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:45.011446 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feafbcf-6f7d-4982-857d-8792a394345c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:45.012021 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feafbcf-6f7d-4982-857d-8792a394345c None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:45.012335 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feafbcf-6f7d-4982-857d-8792a394345c None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:45.012616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feafbcf-6f7d-4982-857d-8792a394345c None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:45.013318 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feafbcf-6f7d-4982-857d-8792a394345c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:45.013626 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feafbcf-6f7d-4982-857d-8792a394345c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:45.014992 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feafbcf-6f7d-4982-857d-8792a394345c None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:45.020261 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 420/850] 10.222.0.119 () {56 vars in 1131 bytes} [Thu Jul 14 15:36:44 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:45.021751 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17176592-35b0-48d5-8c92-2c718d8fca4f None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:45.022044 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17176592-35b0-48d5-8c92-2c718d8fca4f None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:45.022555 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17176592-35b0-48d5-8c92-2c718d8fca4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:45.028153 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6b658-9ce7-4534-9df4-a96ef1f7abfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:45.029855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6b658-9ce7-4534-9df4-a96ef1f7abfc None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:45.040945 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-17176592-35b0-48d5-8c92-2c718d8fca4f None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:45.042156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-17176592-35b0-48d5-8c92-2c718d8fca4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:45.067938 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:45.071045 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:45.115771 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 421/851] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:45 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:36:45.117194 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17176592-35b0-48d5-8c92-2c718d8fca4f None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:45.151020 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 431/852] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:36:44 2022] GET /identity/v3/auth/tokens => generated 1153 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:36:45.151787 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6b658-9ce7-4534-9df4-a96ef1f7abfc None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:45.247853 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17176592-35b0-48d5-8c92-2c718d8fca4f None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:45.265331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6b658-9ce7-4534-9df4-a96ef1f7abfc None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:45.284985 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f713b-5f0f-4837-aacf-548eabf6b617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:45.285805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f713b-5f0f-4837-aacf-548eabf6b617 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:45.286189 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f713b-5f0f-4837-aacf-548eabf6b617 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:45.286582 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f713b-5f0f-4837-aacf-548eabf6b617 None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:45.287389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f713b-5f0f-4837-aacf-548eabf6b617 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:45.287932 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f713b-5f0f-4837-aacf-548eabf6b617 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:45.290350 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f713b-5f0f-4837-aacf-548eabf6b617 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:45.295746 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 422/853] 10.222.0.119 () {56 vars in 1131 bytes} [Thu Jul 14 15:36:45 2022] GET /identity/v3/services?type=compute_legacy => generated 132 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:45.296389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f713b-5f0f-4837-aacf-548eabf6b617 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:45.314600 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df9c1e-f905-43fc-9f7b-cebf5742cab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:45.316043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df9c1e-f905-43fc-9f7b-cebf5742cab8 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:45.316546 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df9c1e-f905-43fc-9f7b-cebf5742cab8 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:45.317231 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df9c1e-f905-43fc-9f7b-cebf5742cab8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:45.320470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:45.327142 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:45.336896 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df9c1e-f905-43fc-9f7b-cebf5742cab8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:36:45.347153 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-65df9c1e-f905-43fc-9f7b-cebf5742cab8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:36:45.347153 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:45.347153 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:45.347153 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:45.347153 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:45.347153 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:45.347153 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:45.347153 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:45.347153 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:45.347153 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:45.347153 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:45.347153 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:45.347153 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:36:45.347153 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:36:45.347153 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:36:45.347153 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:36:45.348222 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:36:45.348222 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:36:45.348222 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:36:45.348222 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:36:45.348222 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:45.348222 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:45.348222 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:45.348222 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:45.348222 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:45.348222 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:45.348222 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:45.348222 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:45.348222 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:45.348222 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:45.348222 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:45.348222 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:45.349054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:45.349054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:45.349054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:45.349054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:45.349054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:36:45.349054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:36:45.349054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:36:45.349054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:36:45.349054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:36:45.349054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:36:45.349054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:36:45.349054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:45.356753 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 432/854] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:36:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:45.360137 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df9c1e-f905-43fc-9f7b-cebf5742cab8 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:45.427909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f713b-5f0f-4837-aacf-548eabf6b617 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:45.477039 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014ea34-43bb-4dd8-87fe-b7f4f83dcb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:45.477853 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014ea34-43bb-4dd8-87fe-b7f4f83dcb5d None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:45.478708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014ea34-43bb-4dd8-87fe-b7f4f83dcb5d None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:45.478995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014ea34-43bb-4dd8-87fe-b7f4f83dcb5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:45.491618 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df9c1e-f905-43fc-9f7b-cebf5742cab8 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:45.493233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014ea34-43bb-4dd8-87fe-b7f4f83dcb5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:45.494900 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014ea34-43bb-4dd8-87fe-b7f4f83dcb5d None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:45.523622 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-f014ea34-43bb-4dd8-87fe-b7f4f83dcb5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:45.523622 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:45.523622 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:45.523622 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:45.523622 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:45.523622 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:45.523622 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:45.523622 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:45.523622 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:45.523622 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:45.523622 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:45.523622 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:45.523622 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:45.523622 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:45.523622 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:45.524750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:45.524750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:45.524750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:45.524750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:45.524750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:45.524750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:45.524750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:45.524750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:45.524750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:45.524750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:45.524750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:45.524750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:45.524750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:45.524750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:45.524750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:45.524750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:45.524750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:45.525869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:45.525869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:45.525869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:45.525869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:45.527457 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 423/855] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:45.532784 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014ea34-43bb-4dd8-87fe-b7f4f83dcb5d None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:45.543751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d70e1-cf0a-45b5-9deb-682ef7db616f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:45.545134 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d70e1-cf0a-45b5-9deb-682ef7db616f None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:45.545574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d70e1-cf0a-45b5-9deb-682ef7db616f None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:45.545996 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d70e1-cf0a-45b5-9deb-682ef7db616f None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:45.547502 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d70e1-cf0a-45b5-9deb-682ef7db616f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:45.547988 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d70e1-cf0a-45b5-9deb-682ef7db616f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:45.549703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d70e1-cf0a-45b5-9deb-682ef7db616f None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:45.565983 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 433/856] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:36:45 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:45.568329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d70e1-cf0a-45b5-9deb-682ef7db616f None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:45.627444 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:45.634139 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:45.658759 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014ea34-43bb-4dd8-87fe-b7f4f83dcb5d None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:45.694659 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d70e1-cf0a-45b5-9deb-682ef7db616f None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:45.699045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba7c88-8036-4f82-adc4-f02bac32cf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:45.699699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba7c88-8036-4f82-adc4-f02bac32cf92 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:45.700053 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba7c88-8036-4f82-adc4-f02bac32cf92 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:45.700421 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba7c88-8036-4f82-adc4-f02bac32cf92 None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:45.701218 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba7c88-8036-4f82-adc4-f02bac32cf92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:45.701596 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba7c88-8036-4f82-adc4-f02bac32cf92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:45.703036 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba7c88-8036-4f82-adc4-f02bac32cf92 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:45.720522 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 424/857] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:45.723142 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba7c88-8036-4f82-adc4-f02bac32cf92 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:45.740832 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80073193-846a-4388-afff-854b892bb529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:45.742773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80073193-846a-4388-afff-854b892bb529 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:45.743732 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80073193-846a-4388-afff-854b892bb529 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:45.744204 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80073193-846a-4388-afff-854b892bb529 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:45.759292 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80073193-846a-4388-afff-854b892bb529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:45.761968 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80073193-846a-4388-afff-854b892bb529 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:45.784772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-80073193-846a-4388-afff-854b892bb529 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:45.784772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:45.784772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:45.784772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:45.784772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:45.784772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:45.784772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:45.784772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:45.784772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:45.784772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:45.784772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:45.784772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:45.784772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:45.784772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:45.784772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:45.785864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:45.785864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:45.785864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:45.785864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:45.785864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:45.785864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:45.785864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:45.785864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:45.785864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:45.785864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:45.785864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:45.785864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:45.785864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:45.785864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:45.785864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:45.785864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:45.785864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:45.786972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:45.786972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:45.786972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:45.786972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:45.790111 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 434/858] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:45.795359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80073193-846a-4388-afff-854b892bb529 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:45.852192 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba7c88-8036-4f82-adc4-f02bac32cf92 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:45.894373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71457da-cbb5-4c9f-8229-7ac4d86fa5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:45.895184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71457da-cbb5-4c9f-8229-7ac4d86fa5ac None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:45.895465 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71457da-cbb5-4c9f-8229-7ac4d86fa5ac None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:45.895737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71457da-cbb5-4c9f-8229-7ac4d86fa5ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:45.903347 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:45.909244 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71457da-cbb5-4c9f-8229-7ac4d86fa5ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:45.911051 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71457da-cbb5-4c9f-8229-7ac4d86fa5ac None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:45.928076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80073193-846a-4388-afff-854b892bb529 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:45.932436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-e71457da-cbb5-4c9f-8229-7ac4d86fa5ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:45.932436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:45.932436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:45.932436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:45.932436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:45.932436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:45.932436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:45.932436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:45.932436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:45.932436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:45.932436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:45.932436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:45.932436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:36:45.932436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:36:45.932436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:36:45.933308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:36:45.933308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:45.933308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:45.933308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:45.933308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:45.933308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:45.933308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:45.933308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:45.933308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:45.933308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:45.933308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:45.933308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:45.933308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:45.933308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:45.933308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:45.933308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:45.933308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:45.934224 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:36:45.934224 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:36:45.934224 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:36:45.934224 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:36:45.934224 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:36:45.934224 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:36:45.934224 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:45.934224 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:45.938413 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 425/859] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:45.939271 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71457da-cbb5-4c9f-8229-7ac4d86fa5ac None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:45.956484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:45.970143 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1e895-1b66-464c-b4d8-21049df75b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:45.971256 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1e895-1b66-464c-b4d8-21049df75b4a None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:45.972324 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1e895-1b66-464c-b4d8-21049df75b4a None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:45.972826 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1e895-1b66-464c-b4d8-21049df75b4a None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:45.973859 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1e895-1b66-464c-b4d8-21049df75b4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:45.974538 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1e895-1b66-464c-b4d8-21049df75b4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:45.976232 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1e895-1b66-464c-b4d8-21049df75b4a None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:45.994243 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 435/860] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:45.995577 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1e895-1b66-464c-b4d8-21049df75b4a None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:46.113622 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1e895-1b66-464c-b4d8-21049df75b4a None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:46.157916 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6dd5a7-9014-4f22-ab16-f0f9aecc9401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:46.158713 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dd5a7-9014-4f22-ab16-f0f9aecc9401 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.158997 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dd5a7-9014-4f22-ab16-f0f9aecc9401 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.159274 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dd5a7-9014-4f22-ab16-f0f9aecc9401 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.169166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6dd5a7-9014-4f22-ab16-f0f9aecc9401 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:46.170985 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6dd5a7-9014-4f22-ab16-f0f9aecc9401 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:46.174617 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71457da-cbb5-4c9f-8229-7ac4d86fa5ac None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:46.188980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-bb6dd5a7-9014-4f22-ab16-f0f9aecc9401 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:36:46.188980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:46.188980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:46.188980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:46.188980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:46.188980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:46.188980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:46.188980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:46.188980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:46.188980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:46.188980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:46.188980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:46.188980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:36:46.188980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:36:46.188980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:36:46.188980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:36:46.190023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:46.190023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:46.190023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:46.190023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:46.190023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:46.190023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:46.190023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:46.190023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:46.190023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:46.190023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:46.190023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:46.190023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:46.190023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:46.190023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:46.190023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:46.190023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:46.190023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:46.190023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:46.190967 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:46.190967 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:46.190967 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:36:46.190967 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:36:46.190967 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:36:46.190967 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:36:46.190967 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:36:46.190967 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:36:46.190967 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:36:46.190967 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:46.195329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 436/861] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:36:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:46.196189 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6dd5a7-9014-4f22-ab16-f0f9aecc9401 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:46.218411 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bfb80-71c1-40a6-a501-44181d917ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:46.219837 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bfb80-71c1-40a6-a501-44181d917ec2 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.220675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bfb80-71c1-40a6-a501-44181d917ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.221209 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bfb80-71c1-40a6-a501-44181d917ec2 None admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.222202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bfb80-71c1-40a6-a501-44181d917ec2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:46.222708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bfb80-71c1-40a6-a501-44181d917ec2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:46.224753 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bfb80-71c1-40a6-a501-44181d917ec2 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:46.234162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:46.247244 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 426/862] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:36:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:46.252196 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bfb80-71c1-40a6-a501-44181d917ec2 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:46.309522 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:46.324625 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6dd5a7-9014-4f22-ab16-f0f9aecc9401 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:46.363543 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bfb80-71c1-40a6-a501-44181d917ec2 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:46.369880 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a65cd-28cb-40da-bef2-74de63c6f00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:46.370497 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a65cd-28cb-40da-bef2-74de63c6f00c None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.370784 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a65cd-28cb-40da-bef2-74de63c6f00c None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.371061 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a65cd-28cb-40da-bef2-74de63c6f00c None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.371906 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a65cd-28cb-40da-bef2-74de63c6f00c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:46.372245 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a65cd-28cb-40da-bef2-74de63c6f00c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:46.374333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a65cd-28cb-40da-bef2-74de63c6f00c None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:46.396482 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 437/863] 10.222.0.119 () {56 vars in 1140 bytes} [Thu Jul 14 15:36:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:46.401797 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a65cd-28cb-40da-bef2-74de63c6f00c None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:46.414072 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f9b5a-dddd-4700-8ed4-fa33a4cfb9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:46.414730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f9b5a-dddd-4700-8ed4-fa33a4cfb9b5 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.415019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f9b5a-dddd-4700-8ed4-fa33a4cfb9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.415298 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f9b5a-dddd-4700-8ed4-fa33a4cfb9b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.416736 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f9b5a-dddd-4700-8ed4-fa33a4cfb9b5 None admin] RBAC: Adding query filter params (role.id=92c47f3813b04366b3019ba2a56337eb, scope.project.id=07652ced88cf4f069d1765176be5130b, user.id=4a1474b39e0b477daff5833491cd6df5) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:46.417048 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f9b5a-dddd-4700-8ed4-fa33a4cfb9b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:46.419156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f9b5a-dddd-4700-8ed4-fa33a4cfb9b5 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:46.426825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 427/864] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:36:46 2022] GET /identity/v3/role_assignments?user.id=4a1474b39e0b477daff5833491cd6df5&scope.project.id=07652ced88cf4f069d1765176be5130b&role.id=92c47f3813b04366b3019ba2a56337eb => generated 610 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:46.519631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:46.538803 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a65cd-28cb-40da-bef2-74de63c6f00c None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:46.577139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb54e5e-0596-491c-8765-dca3de7dfa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:46.578062 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb54e5e-0596-491c-8765-dca3de7dfa9a None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.578680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb54e5e-0596-491c-8765-dca3de7dfa9a None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.579106 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb54e5e-0596-491c-8765-dca3de7dfa9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.652171 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb54e5e-0596-491c-8765-dca3de7dfa9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:46.653838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb54e5e-0596-491c-8765-dca3de7dfa9a None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:46.742133 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:46.758776 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 438/865] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:36:46 2022] GET /identity/v3/auth/tokens => generated 1153 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:36:46.764322 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f9b5a-dddd-4700-8ed4-fa33a4cfb9b5 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:46.865116 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382a099-3922-4ad7-9d84-5f75a01b9e70 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.865448 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382a099-3922-4ad7-9d84-5f75a01b9e70 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.865694 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382a099-3922-4ad7-9d84-5f75a01b9e70 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.868942 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 439/866] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:36:46.871600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f9b5a-dddd-4700-8ed4-fa33a4cfb9b5 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:46.873110 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b601106-2e81-46da-9142-50332957b701 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.873402 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b601106-2e81-46da-9142-50332957b701 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.873692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b601106-2e81-46da-9142-50332957b701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.891332 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-9b601106-2e81-46da-9142-50332957b701 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:46.892600 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-9b601106-2e81-46da-9142-50332957b701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:46.900537 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:46.916986 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86f0d4-c623-469c-9755-d9a927cbcf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:46.918547 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86f0d4-c623-469c-9755-d9a927cbcf9d None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:46.919194 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86f0d4-c623-469c-9755-d9a927cbcf9d None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:46.919591 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86f0d4-c623-469c-9755-d9a927cbcf9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:46.934980 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86f0d4-c623-469c-9755-d9a927cbcf9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:46.936487 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86f0d4-c623-469c-9755-d9a927cbcf9d None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:46.961106 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-fc86f0d4-c623-469c-9755-d9a927cbcf9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:46.961106 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:46.961106 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:46.961106 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:46.961106 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:46.961106 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:46.961106 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:46.961106 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:46.961106 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:46.961106 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:46.961106 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:46.961106 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:46.961106 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:46.961106 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:46.961106 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:46.962202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:46.962202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:46.962202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:46.962202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:46.962202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:46.962202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:46.962202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:46.962202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:46.962202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:46.962202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:46.962202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:46.962202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:46.962202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:46.962202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:46.962202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:46.962202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:46.962202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:46.963267 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:46.963267 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:46.963267 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:46.963267 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:46.963267 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 428/867] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:46.968342 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86f0d4-c623-469c-9755-d9a927cbcf9d None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:46.970638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 440/868] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:46 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:36:46.993976 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b601106-2e81-46da-9142-50332957b701 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:47.097938 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86f0d4-c623-469c-9755-d9a927cbcf9d None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:47.111440 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b601106-2e81-46da-9142-50332957b701 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:47.131066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:47.139887 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea2137-7bc5-4803-8ee5-17e32593699f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:47.140771 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea2137-7bc5-4803-8ee5-17e32593699f None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.141200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea2137-7bc5-4803-8ee5-17e32593699f None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.141679 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea2137-7bc5-4803-8ee5-17e32593699f None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.142637 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea2137-7bc5-4803-8ee5-17e32593699f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:47.143092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea2137-7bc5-4803-8ee5-17e32593699f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:47.144753 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea2137-7bc5-4803-8ee5-17e32593699f None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:47.151104 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba6491-a259-46d6-af24-c320797cc326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:47.151845 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba6491-a259-46d6-af24-c320797cc326 None admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.153162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba6491-a259-46d6-af24-c320797cc326 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.153162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba6491-a259-46d6-af24-c320797cc326 None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.153916 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba6491-a259-46d6-af24-c320797cc326 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:47.155172 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba6491-a259-46d6-af24-c320797cc326 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:47.159287 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 429/869] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:47.167375 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea2137-7bc5-4803-8ee5-17e32593699f None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:47.199175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:47.228647 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 441/870] 10.222.0.119 () {60 vars in 1146 bytes} [Thu Jul 14 15:36:46 2022] POST /identity/v3/services => generated 252 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:36:47.279184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea2137-7bc5-4803-8ee5-17e32593699f None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:47.325972 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91dd3db-1900-4010-aabd-4396abf3872b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:47.326918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dd3db-1900-4010-aabd-4396abf3872b None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.327200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dd3db-1900-4010-aabd-4396abf3872b None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.327477 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dd3db-1900-4010-aabd-4396abf3872b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.336022 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91dd3db-1900-4010-aabd-4396abf3872b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:47.337677 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91dd3db-1900-4010-aabd-4396abf3872b None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:47.353470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-a91dd3db-1900-4010-aabd-4396abf3872b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:47.353470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:47.353470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:47.353470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:47.353470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:47.353470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:47.353470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:47.353470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:47.353470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:47.353470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:47.353470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:47.353470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:47.353470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:36:47.353470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:36:47.353470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:36:47.354451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:36:47.354451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:47.354451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:47.354451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:47.354451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:47.354451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:47.354451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:47.354451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:47.354451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:47.354451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:47.354451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:47.354451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:47.354451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:47.354451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:47.354451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:47.354451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:47.354451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:47.355563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:36:47.355563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:36:47.355563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:36:47.355563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:36:47.355563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:36:47.355563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:36:47.355563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:47.355563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:47.355563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 430/871] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:36:47.360587 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba6491-a259-46d6-af24-c320797cc326 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:47.421572 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eda483-2ca0-4779-bb2d-de0f28c7abf1 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.421869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eda483-2ca0-4779-bb2d-de0f28c7abf1 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.422053 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eda483-2ca0-4779-bb2d-de0f28c7abf1 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.423436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 431/872] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:47.429180 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfc674-9bb3-48a6-9aad-4c794f01c0ef None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.429467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfc674-9bb3-48a6-9aad-4c794f01c0ef None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.429750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfc674-9bb3-48a6-9aad-4c794f01c0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.448425 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-8ccfc674-9bb3-48a6-9aad-4c794f01c0ef None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:47.449722 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-8ccfc674-9bb3-48a6-9aad-4c794f01c0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:47.476967 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba6491-a259-46d6-af24-c320797cc326 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:47.524180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5748d2f-5395-438d-9421-96abb2eaa2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:47.525157 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5748d2f-5395-438d-9421-96abb2eaa2d9 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.525157 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5748d2f-5395-438d-9421-96abb2eaa2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.525578 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5748d2f-5395-438d-9421-96abb2eaa2d9 None admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.526177 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5748d2f-5395-438d-9421-96abb2eaa2d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:47.526487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5748d2f-5395-438d-9421-96abb2eaa2d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:47.529146 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5748d2f-5395-438d-9421-96abb2eaa2d9 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:47.544686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 442/873] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:36:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:47.551155 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5748d2f-5395-438d-9421-96abb2eaa2d9 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:47.559209 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 432/874] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:47 2022] POST /identity/v3/auth/tokens => generated 1254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:36:47.582544 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfc674-9bb3-48a6-9aad-4c794f01c0ef None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:47.608136 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:47.620487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:47.670096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5748d2f-5395-438d-9421-96abb2eaa2d9 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:47.711268 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11598c-f481-49e0-a1af-40cea63ad731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:47.711862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11598c-f481-49e0-a1af-40cea63ad731 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.712188 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11598c-f481-49e0-a1af-40cea63ad731 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.712471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11598c-f481-49e0-a1af-40cea63ad731 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.713308 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11598c-f481-49e0-a1af-40cea63ad731 None admin] RBAC: Adding query filter params (role.id=07aaf007cde043318319928d151bdc75, scope.project.id=07652ced88cf4f069d1765176be5130b, user.id=28a5c169576e432c8174a562ae358e8b) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:47.713625 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11598c-f481-49e0-a1af-40cea63ad731 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:47.714445 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfc674-9bb3-48a6-9aad-4c794f01c0ef None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:47.715059 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11598c-f481-49e0-a1af-40cea63ad731 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:47.723147 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 443/875] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:36:47 2022] GET /identity/v3/role_assignments?user.id=28a5c169576e432c8174a562ae358e8b&scope.project.id=07652ced88cf4f069d1765176be5130b&role.id=07aaf007cde043318319928d151bdc75 => generated 610 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:47.756577 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1d58b-1ce6-4f00-995b-9e1db98afc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:47.757581 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1d58b-1ce6-4f00-995b-9e1db98afc30 None admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:47.757978 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1d58b-1ce6-4f00-995b-9e1db98afc30 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:47.758364 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1d58b-1ce6-4f00-995b-9e1db98afc30 None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:47.759239 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1d58b-1ce6-4f00-995b-9e1db98afc30 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:47.760859 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1d58b-1ce6-4f00-995b-9e1db98afc30 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:47.889993 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 433/876] 10.222.0.119 () {60 vars in 1146 bytes} [Thu Jul 14 15:36:47 2022] POST /identity/v3/services => generated 270 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:36:48.782709 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967fbd2-4f00-4569-8696-3c50a0feaf81 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:48.783722 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967fbd2-4f00-4569-8696-3c50a0feaf81 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:48.784273 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967fbd2-4f00-4569-8696-3c50a0feaf81 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:48.786256 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 444/877] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:48 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:48.792159 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3a15c-5a36-4e22-a03e-c175ac04ba0a None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:48.792686 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3a15c-5a36-4e22-a03e-c175ac04ba0a None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:48.793167 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3a15c-5a36-4e22-a03e-c175ac04ba0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:48.811750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-d1b3a15c-5a36-4e22-a03e-c175ac04ba0a None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:48.813272 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-d1b3a15c-5a36-4e22-a03e-c175ac04ba0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:48.891388 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 434/878] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:48 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:36:48.916638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967fbd2-4f00-4569-8696-3c50a0feaf81 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:49.030254 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:49.036263 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967fbd2-4f00-4569-8696-3c50a0feaf81 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:49.076717 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8138408-9c99-489e-b27e-792ac56b793a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:49.078192 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8138408-9c99-489e-b27e-792ac56b793a None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:49.078758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8138408-9c99-489e-b27e-792ac56b793a None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:49.079242 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8138408-9c99-489e-b27e-792ac56b793a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:49.090882 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8138408-9c99-489e-b27e-792ac56b793a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:36:49.099767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-b8138408-9c99-489e-b27e-792ac56b793a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:36:49.099767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:49.099767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:49.099767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:49.099767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:49.099767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:49.099767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:49.099767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:49.099767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:49.099767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:49.099767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:49.099767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:49.099767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:36:49.099767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:36:49.099767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:36:49.099767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:36:49.100858 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:36:49.100858 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:36:49.100858 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:36:49.100858 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:36:49.100858 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:49.100858 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:49.100858 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:49.100858 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:49.100858 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:49.100858 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:49.100858 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:49.100858 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:49.100858 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:49.100858 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:49.100858 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:49.100858 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:49.101698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:49.101698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:49.101698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:49.101698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:49.101698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:36:49.101698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:36:49.101698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:36:49.101698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:36:49.101698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:36:49.101698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:36:49.101698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:36:49.101698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:49.108460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 445/879] 10.222.0.119 () {56 vars in 1125 bytes} [Thu Jul 14 15:36:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:49.110597 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3a15c-5a36-4e22-a03e-c175ac04ba0a None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:49.114007 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:49.213794 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3a15c-5a36-4e22-a03e-c175ac04ba0a None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:49.249721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e111f1-9358-4d0a-a2c1-a374d5bb624d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:49.250735 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e111f1-9358-4d0a-a2c1-a374d5bb624d None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:49.251224 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e111f1-9358-4d0a-a2c1-a374d5bb624d None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:49.251699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e111f1-9358-4d0a-a2c1-a374d5bb624d None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:49.252681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e111f1-9358-4d0a-a2c1-a374d5bb624d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:49.253215 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e111f1-9358-4d0a-a2c1-a374d5bb624d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:49.254937 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e111f1-9358-4d0a-a2c1-a374d5bb624d None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:49.264653 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 435/880] 10.222.0.119 () {56 vars in 1120 bytes} [Thu Jul 14 15:36:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:49.270535 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8138408-9c99-489e-b27e-792ac56b793a None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:49.379987 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8138408-9c99-489e-b27e-792ac56b793a None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:49.409633 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967fcda-f723-4d1b-81fb-58b1d3272e37 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:49.409957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967fcda-f723-4d1b-81fb-58b1d3272e37 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:49.410126 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967fcda-f723-4d1b-81fb-58b1d3272e37 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:49.411760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 436/881] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:49.417807 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0e316-f1b5-4463-a805-3e17c7ed2f31 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:49.418117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0e316-f1b5-4463-a805-3e17c7ed2f31 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:49.418377 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0e316-f1b5-4463-a805-3e17c7ed2f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:49.419175 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0cff9f-fa52-4230-8e02-6ba406784b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:49.420345 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cff9f-fa52-4230-8e02-6ba406784b11 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:49.420835 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cff9f-fa52-4230-8e02-6ba406784b11 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:49.421333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cff9f-fa52-4230-8e02-6ba406784b11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:49.433590 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0cff9f-fa52-4230-8e02-6ba406784b11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:49.435444 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-cdf0e316-f1b5-4463-a805-3e17c7ed2f31 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:49.435580 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0cff9f-fa52-4230-8e02-6ba406784b11 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:49.436741 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-cdf0e316-f1b5-4463-a805-3e17c7ed2f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:49.455556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-cb0cff9f-fa52-4230-8e02-6ba406784b11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:49.455556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:49.455556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:49.455556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:49.455556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:49.455556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:49.455556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:49.455556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:49.455556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:49.455556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:49.455556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:49.455556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:49.455556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:49.455556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:49.455556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:49.456519 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:49.456519 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:49.456519 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:49.456519 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:49.456519 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:49.456519 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:49.456519 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:49.456519 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:49.456519 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:49.456519 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:49.456519 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:49.456519 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:49.456519 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:49.456519 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:49.456519 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:49.456519 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:49.456519 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:49.457403 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:49.457403 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:49.457403 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:49.457403 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:49.459817 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 446/882] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:49.466046 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0cff9f-fa52-4230-8e02-6ba406784b11 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:49.482720 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:49.504459 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:49.513025 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 437/883] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:49 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:36:49.535991 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0e316-f1b5-4463-a805-3e17c7ed2f31 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:49.579432 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0cff9f-fa52-4230-8e02-6ba406784b11 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:49.617229 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bd31c-3b01-407d-aeec-7ea7cb77a89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:49.618016 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bd31c-3b01-407d-aeec-7ea7cb77a89e None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:49.618387 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bd31c-3b01-407d-aeec-7ea7cb77a89e None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:49.618826 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bd31c-3b01-407d-aeec-7ea7cb77a89e None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:49.620405 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bd31c-3b01-407d-aeec-7ea7cb77a89e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:49.620405 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bd31c-3b01-407d-aeec-7ea7cb77a89e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:49.621510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bd31c-3b01-407d-aeec-7ea7cb77a89e None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:49.639759 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 447/884] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:49.640994 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bd31c-3b01-407d-aeec-7ea7cb77a89e None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:49.652773 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0e316-f1b5-4463-a805-3e17c7ed2f31 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:49.693534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69c6c9-810a-4461-baea-caa6c6cbbf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:49.695044 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69c6c9-810a-4461-baea-caa6c6cbbf72 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:49.695688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69c6c9-810a-4461-baea-caa6c6cbbf72 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:49.696278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69c6c9-810a-4461-baea-caa6c6cbbf72 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:49.697245 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69c6c9-810a-4461-baea-caa6c6cbbf72 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:49.698876 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69c6c9-810a-4461-baea-caa6c6cbbf72 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:49.712525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-db69c6c9-810a-4461-baea-caa6c6cbbf72 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 15:36:49.712525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:49.712525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:36:49.712525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:36:49.712525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:36:49.712525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:36:49.712525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:36:49.712525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:49.712525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 15:36:49.712525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:49.712525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:36:49.712525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:49.712525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:49.712525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:49.712525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:49.712525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:49.712525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:49.713528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:49.713528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:49.713528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:49.713528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:49.713528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:49.713528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:49.713528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:36:49.713528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:36:49.713528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:36:49.713528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:36:49.713528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:49.713528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:49.713528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:49.713528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:49.713528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:49.713528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:49.714361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:49.714361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:49.714361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:49.714361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:49.714361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:49.714361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:49.714361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:49.714361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:49.714361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:49.714361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:49.714361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:36:49.714361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:49.714361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 15:36:49.714361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:49.717550 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 438/885] 10.222.0.119 () {56 vars in 1119 bytes} [Thu Jul 14 15:36:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:49.728124 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69c6c9-810a-4461-baea-caa6c6cbbf72 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:49.730509 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:49.756232 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bd31c-3b01-407d-aeec-7ea7cb77a89e None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:49.798609 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:49.805659 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2083823-7134-407b-93f3-087838ab0821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:49.807192 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2083823-7134-407b-93f3-087838ab0821 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:49.807666 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2083823-7134-407b-93f3-087838ab0821 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:49.808621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2083823-7134-407b-93f3-087838ab0821 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:49.818216 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2083823-7134-407b-93f3-087838ab0821 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:49.820464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2083823-7134-407b-93f3-087838ab0821 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:49.840836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-a2083823-7134-407b-93f3-087838ab0821 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:36:49.840836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:49.840836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:49.840836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:49.840836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:49.840836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:49.840836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:49.840836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:49.840836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:49.840836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:49.840836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:49.840836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:49.840836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:36:49.840836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:36:49.840836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:36:49.840836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:36:49.842082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:49.842082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:49.842082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:49.842082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:49.842082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:49.842082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:49.842082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:49.842082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:49.842082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:49.842082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:49.842082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:49.842082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:49.842082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:49.842082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:49.842082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:49.842082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:49.842082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:49.842082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:49.843529 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:49.843529 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:49.843529 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:36:49.843529 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:36:49.843529 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:36:49.843529 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:36:49.843529 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:36:49.843529 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:36:49.843529 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:36:49.843529 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:49.849811 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 448/886] 10.222.0.119 () {56 vars in 1122 bytes} [Thu Jul 14 15:36:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:49.850964 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2083823-7134-407b-93f3-087838ab0821 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:49.852900 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69c6c9-810a-4461-baea-caa6c6cbbf72 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:49.907543 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0c3bd-e9cc-43d8-992b-7bc2df575af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:49.909179 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0c3bd-e9cc-43d8-992b-7bc2df575af9 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:49.909622 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0c3bd-e9cc-43d8-992b-7bc2df575af9 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:49.910320 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0c3bd-e9cc-43d8-992b-7bc2df575af9 None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:49.911713 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0c3bd-e9cc-43d8-992b-7bc2df575af9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:49.912231 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0c3bd-e9cc-43d8-992b-7bc2df575af9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:49.915262 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0c3bd-e9cc-43d8-992b-7bc2df575af9 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:49.926521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 439/887] 10.222.0.119 () {56 vars in 1119 bytes} [Thu Jul 14 15:36:49 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:49.927678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0c3bd-e9cc-43d8-992b-7bc2df575af9 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:49.977324 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2083823-7134-407b-93f3-087838ab0821 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:50.008127 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:50.013085 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7b1a3-4d73-4a66-87d0-67f374fad55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:50.013769 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7b1a3-4d73-4a66-87d0-67f374fad55a None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:50.014055 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7b1a3-4d73-4a66-87d0-67f374fad55a None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:50.014346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7b1a3-4d73-4a66-87d0-67f374fad55a None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:50.015177 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7b1a3-4d73-4a66-87d0-67f374fad55a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:50.015485 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7b1a3-4d73-4a66-87d0-67f374fad55a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:50.017002 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7b1a3-4d73-4a66-87d0-67f374fad55a None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:50.033917 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 449/888] 10.222.0.119 () {56 vars in 1154 bytes} [Thu Jul 14 15:36:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:50.035163 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0b01f-4777-4f2a-a39b-99930c5b4fc6 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:50.035458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0b01f-4777-4f2a-a39b-99930c5b4fc6 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:50.035738 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0b01f-4777-4f2a-a39b-99930c5b4fc6 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:50.037302 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 450/889] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:50.038551 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2283bf-e292-4417-b018-fe2e69615db9 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:50.038845 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2283bf-e292-4417-b018-fe2e69615db9 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:50.039062 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2283bf-e292-4417-b018-fe2e69615db9 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:50.041167 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 451/890] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:50.041888 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2283bf-e292-4417-b018-fe2e69615db9 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:50.042672 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0c3bd-e9cc-43d8-992b-7bc2df575af9 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:50.066269 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:50.077776 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f16db-5f4a-45a9-a17d-b4f5a15f6181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:50.078444 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f16db-5f4a-45a9-a17d-b4f5a15f6181 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:50.078734 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f16db-5f4a-45a9-a17d-b4f5a15f6181 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:50.079005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f16db-5f4a-45a9-a17d-b4f5a15f6181 None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:50.079708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f16db-5f4a-45a9-a17d-b4f5a15f6181 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:50.080014 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f16db-5f4a-45a9-a17d-b4f5a15f6181 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:50.081391 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f16db-5f4a-45a9-a17d-b4f5a15f6181 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:50.086445 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 440/891] 10.222.0.119 () {56 vars in 1119 bytes} [Thu Jul 14 15:36:49 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:50.087618 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1879820-6680-41da-8df3-3681b5ea361a None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:50.087904 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1879820-6680-41da-8df3-3681b5ea361a None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:50.088200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1879820-6680-41da-8df3-3681b5ea361a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:50.105218 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-b1879820-6680-41da-8df3-3681b5ea361a None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:50.106395 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b1879820-6680-41da-8df3-3681b5ea361a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:50.150487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2283bf-e292-4417-b018-fe2e69615db9 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:50.172663 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 441/892] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:50 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:36:50.173861 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffc29b-5493-458e-8723-de22a9c55637 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:50.174147 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffc29b-5493-458e-8723-de22a9c55637 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:50.174420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffc29b-5493-458e-8723-de22a9c55637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:50.191579 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97ea79-e8bd-4d78-8070-b8b3f9d8f705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:50.192594 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97ea79-e8bd-4d78-8070-b8b3f9d8f705 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:50.193029 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97ea79-e8bd-4d78-8070-b8b3f9d8f705 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:50.193454 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97ea79-e8bd-4d78-8070-b8b3f9d8f705 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:50.200816 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-c8ffc29b-5493-458e-8723-de22a9c55637 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:50.202484 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-c8ffc29b-5493-458e-8723-de22a9c55637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:50.250860 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:50.261515 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97ea79-e8bd-4d78-8070-b8b3f9d8f705 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:50.263044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97ea79-e8bd-4d78-8070-b8b3f9d8f705 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:50.268557 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 442/893] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:50 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:36:50.269383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffc29b-5493-458e-8723-de22a9c55637 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:50.331842 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:50.366128 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 452/894] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:36:50 2022] GET /identity/v3/auth/tokens => generated 1364 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:36:50.367054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97ea79-e8bd-4d78-8070-b8b3f9d8f705 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:50.379983 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffc29b-5493-458e-8723-de22a9c55637 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:50.414499 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652cc75e-ff63-49a2-ba4a-09b01996236f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:50.415153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cc75e-ff63-49a2-ba4a-09b01996236f None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:50.415442 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cc75e-ff63-49a2-ba4a-09b01996236f None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:50.415721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cc75e-ff63-49a2-ba4a-09b01996236f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:50.416537 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652cc75e-ff63-49a2-ba4a-09b01996236f None admin] RBAC: Adding query filter params (interface=public, service_id=5d06f362ff7043f6be978887a676b6ad, region_id=RegionOne) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:50.416848 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652cc75e-ff63-49a2-ba4a-09b01996236f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:50.418207 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652cc75e-ff63-49a2-ba4a-09b01996236f None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:50.425647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 443/895] 10.222.0.119 () {56 vars in 1256 bytes} [Thu Jul 14 15:36:50 2022] GET /identity/v3/endpoints?service_id=5d06f362ff7043f6be978887a676b6ad&interface=public®ion_id=RegionOne => generated 195 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:50.426362 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652cc75e-ff63-49a2-ba4a-09b01996236f None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:50.460270 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:50.469940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97ea79-e8bd-4d78-8070-b8b3f9d8f705 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:50.504065 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe97549-99b8-4f9e-a840-954bb139202e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:50.504901 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe97549-99b8-4f9e-a840-954bb139202e None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:50.505188 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe97549-99b8-4f9e-a840-954bb139202e None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:50.505473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe97549-99b8-4f9e-a840-954bb139202e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:50.506129 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe97549-99b8-4f9e-a840-954bb139202e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:50.508272 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe97549-99b8-4f9e-a840-954bb139202e None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:50.521142 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-bbe97549-99b8-4f9e-a840-954bb139202e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 15:36:50.521142 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:50.521142 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:36:50.521142 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:36:50.521142 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:36:50.521142 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:36:50.521142 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:36:50.521142 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:50.521142 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 15:36:50.521142 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:50.521142 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:36:50.521142 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:50.521142 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:50.521142 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:50.521142 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:50.521142 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:50.522126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:50.522126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:50.522126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:50.522126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:50.522126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:50.522126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:50.522126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:50.522126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:36:50.522126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:36:50.522126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:36:50.522126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:36:50.522126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:50.522126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:50.522126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:50.522126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:50.522126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:50.523066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:50.523066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:50.523066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:50.523066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:50.523066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:50.523066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:50.523066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:50.523066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:50.523066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:50.523066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:50.523066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:50.523066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:36:50.523066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:50.523066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 15:36:50.523066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:50.523066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 453/896] 10.222.0.119 () {56 vars in 1137 bytes} [Thu Jul 14 15:36:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:50.523988 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe97549-99b8-4f9e-a840-954bb139202e None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:50.526754 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652cc75e-ff63-49a2-ba4a-09b01996236f None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:50.539670 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:50.561291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87d951-2fd8-4348-8c0a-be91879ab99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:50.562090 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87d951-2fd8-4348-8c0a-be91879ab99a None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:50.562423 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87d951-2fd8-4348-8c0a-be91879ab99a None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:50.562697 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87d951-2fd8-4348-8c0a-be91879ab99a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:50.563412 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87d951-2fd8-4348-8c0a-be91879ab99a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:50.564806 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87d951-2fd8-4348-8c0a-be91879ab99a None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:50.577782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-5d87d951-2fd8-4348-8c0a-be91879ab99a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:36:50.577782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:50.577782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:36:50.577782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:36:50.577782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:36:50.577782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:36:50.577782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:36:50.577782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:50.577782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:36:50.577782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:50.577782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:36:50.577782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:50.577782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:50.577782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:50.577782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:50.577782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:50.577782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:50.578906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:50.578906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:50.578906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:50.578906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:50.578906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:50.578906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:50.578906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:36:50.578906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:36:50.578906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:36:50.578906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:36:50.578906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:50.578906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:50.578906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:50.578906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:50.578906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:50.578906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:50.579825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:50.579825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:50.579825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:50.579825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:50.579825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:50.579825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:50.579825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:50.579825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:50.579825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:50.579825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:50.579825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:36:50.579825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:50.579825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:36:50.579825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:50.579825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 444/897] 10.222.0.119 () {56 vars in 1131 bytes} [Thu Jul 14 15:36:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:50.580826 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87d951-2fd8-4348-8c0a-be91879ab99a None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:50.632902 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe97549-99b8-4f9e-a840-954bb139202e None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:50.666597 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910459c-994d-4995-8cdc-99591f77fbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:50.667491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910459c-994d-4995-8cdc-99591f77fbb3 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:50.667780 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910459c-994d-4995-8cdc-99591f77fbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:50.668063 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910459c-994d-4995-8cdc-99591f77fbb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:50.680912 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910459c-994d-4995-8cdc-99591f77fbb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:50.682656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910459c-994d-4995-8cdc-99591f77fbb3 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:50.683539 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87d951-2fd8-4348-8c0a-be91879ab99a None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:50.702627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-f910459c-994d-4995-8cdc-99591f77fbb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:50.702627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:50.702627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:50.702627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:50.702627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:50.702627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:50.702627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:50.702627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:50.702627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:50.702627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:50.702627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:50.702627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:50.702627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:50.702627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:50.702627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:50.703830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:50.703830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:50.703830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:50.703830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:50.703830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:50.703830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:50.703830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:50.703830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:50.703830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:50.703830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:50.703830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:50.703830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:50.703830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:50.703830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:50.703830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:50.703830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:50.703830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:50.704845 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:50.704845 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:50.704845 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:50.704845 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:50.704845 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 454/898] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:50.705161 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910459c-994d-4995-8cdc-99591f77fbb3 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:50.713965 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:50.723490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5742c-c7ba-4ee6-9de5-6b07618f897e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:50.724251 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5742c-c7ba-4ee6-9de5-6b07618f897e None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:50.724456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5742c-c7ba-4ee6-9de5-6b07618f897e None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:50.724729 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5742c-c7ba-4ee6-9de5-6b07618f897e None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:50.725440 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5742c-c7ba-4ee6-9de5-6b07618f897e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:50.726922 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5742c-c7ba-4ee6-9de5-6b07618f897e None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:50.732513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 445/899] 10.222.0.119 () {56 vars in 1092 bytes} [Thu Jul 14 15:36:50 2022] GET /identity/v3/services => generated 1274 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:36:50.733275 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5742c-c7ba-4ee6-9de5-6b07618f897e None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:50.782473 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:50.813737 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910459c-994d-4995-8cdc-99591f77fbb3 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:50.848735 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5742c-c7ba-4ee6-9de5-6b07618f897e None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:50.856789 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c7f16-5317-4528-8618-1023b85d6085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:50.857483 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c7f16-5317-4528-8618-1023b85d6085 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:50.857772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c7f16-5317-4528-8618-1023b85d6085 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:50.858052 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c7f16-5317-4528-8618-1023b85d6085 None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:50.858782 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c7f16-5317-4528-8618-1023b85d6085 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:50.859096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c7f16-5317-4528-8618-1023b85d6085 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:50.860524 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c7f16-5317-4528-8618-1023b85d6085 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:50.867046 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 455/900] 10.222.0.119 () {56 vars in 1131 bytes} [Thu Jul 14 15:36:50 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:50.868049 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c7f16-5317-4528-8618-1023b85d6085 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:50.894962 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49e526-e28d-4af2-a221-805d43dff9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:50.896268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49e526-e28d-4af2-a221-805d43dff9c0 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:50.896268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49e526-e28d-4af2-a221-805d43dff9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:50.896268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49e526-e28d-4af2-a221-805d43dff9c0 None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:50.896894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c49e526-e28d-4af2-a221-805d43dff9c0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:50.897197 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c49e526-e28d-4af2-a221-805d43dff9c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:50.899346 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c49e526-e28d-4af2-a221-805d43dff9c0 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:50.910806 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 446/901] 10.222.0.119 () {56 vars in 1127 bytes} [Thu Jul 14 15:36:50 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:50.910806 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49e526-e28d-4af2-a221-805d43dff9c0 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:50.949718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:50.983687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c7f16-5317-4528-8618-1023b85d6085 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:51.013534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49e526-e28d-4af2-a221-805d43dff9c0 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:51.016154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:51.019267 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265cd89-c99f-4ab1-a665-2e3c03bcbe26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:51.019940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265cd89-c99f-4ab1-a665-2e3c03bcbe26 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:51.020273 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265cd89-c99f-4ab1-a665-2e3c03bcbe26 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:51.020555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265cd89-c99f-4ab1-a665-2e3c03bcbe26 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:51.021282 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265cd89-c99f-4ab1-a665-2e3c03bcbe26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:51.021597 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265cd89-c99f-4ab1-a665-2e3c03bcbe26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:51.023016 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265cd89-c99f-4ab1-a665-2e3c03bcbe26 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:51.039896 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 456/902] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:51.039896 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265cd89-c99f-4ab1-a665-2e3c03bcbe26 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:51.056981 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4bce90-1a4d-46a1-8854-c7dd6bb53b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:51.057740 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bce90-1a4d-46a1-8854-c7dd6bb53b4e None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:51.058090 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bce90-1a4d-46a1-8854-c7dd6bb53b4e None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:51.058375 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bce90-1a4d-46a1-8854-c7dd6bb53b4e None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:51.059083 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4bce90-1a4d-46a1-8854-c7dd6bb53b4e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:51.059392 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4bce90-1a4d-46a1-8854-c7dd6bb53b4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:51.061033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4bce90-1a4d-46a1-8854-c7dd6bb53b4e None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:51.071652 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 447/903] 10.222.0.119 () {56 vars in 1131 bytes} [Thu Jul 14 15:36:50 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:51.072438 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4bce90-1a4d-46a1-8854-c7dd6bb53b4e None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:51.146450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265cd89-c99f-4ab1-a665-2e3c03bcbe26 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:51.181408 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4bce90-1a4d-46a1-8854-c7dd6bb53b4e None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:51.183267 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:51.189331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46603f4e-7558-4e23-9468-e1ed4e005bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:51.190044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46603f4e-7558-4e23-9468-e1ed4e005bd0 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:51.190390 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46603f4e-7558-4e23-9468-e1ed4e005bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:51.190702 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46603f4e-7558-4e23-9468-e1ed4e005bd0 None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:51.191486 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46603f4e-7558-4e23-9468-e1ed4e005bd0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:51.191825 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46603f4e-7558-4e23-9468-e1ed4e005bd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:51.193405 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46603f4e-7558-4e23-9468-e1ed4e005bd0 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:51.198556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 457/904] 10.222.0.119 () {56 vars in 1127 bytes} [Thu Jul 14 15:36:51 2022] GET /identity/v3/services?type=object-store => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:51.199367 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46603f4e-7558-4e23-9468-e1ed4e005bd0 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:51.233262 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa40fc-989f-44b2-9d42-ead7db7edd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:51.234096 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa40fc-989f-44b2-9d42-ead7db7edd50 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:51.234430 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa40fc-989f-44b2-9d42-ead7db7edd50 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:51.234709 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa40fc-989f-44b2-9d42-ead7db7edd50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:51.243289 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa40fc-989f-44b2-9d42-ead7db7edd50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:51.244979 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa40fc-989f-44b2-9d42-ead7db7edd50 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:51.262191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-29aa40fc-989f-44b2-9d42-ead7db7edd50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:51.262191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:51.262191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:51.262191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:51.262191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:51.262191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:51.262191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:51.262191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:51.262191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:51.262191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:51.262191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:51.262191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:51.262191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:36:51.262191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:36:51.262191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:36:51.263184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:36:51.263184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:51.263184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:51.263184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:51.263184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:51.263184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:51.263184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:51.263184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:51.263184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:51.263184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:51.263184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:51.263184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:51.263184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:51.263184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:51.263184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:51.263184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:51.263184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:51.264073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:36:51.264073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:36:51.264073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:36:51.264073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:36:51.264073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:36:51.264073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:36:51.264073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:51.264073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:51.268591 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 448/905] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:51.270156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa40fc-989f-44b2-9d42-ead7db7edd50 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:51.305442 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:51.346086 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46603f4e-7558-4e23-9468-e1ed4e005bd0 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:51.395771 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3a235-90de-4ef4-b3a8-aa59c8bde6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:51.396467 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3a235-90de-4ef4-b3a8-aa59c8bde6b9 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:51.396752 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3a235-90de-4ef4-b3a8-aa59c8bde6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:51.397027 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3a235-90de-4ef4-b3a8-aa59c8bde6b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:51.397235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa40fc-989f-44b2-9d42-ead7db7edd50 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:51.397851 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3a235-90de-4ef4-b3a8-aa59c8bde6b9 None admin] RBAC: Adding query filter params (interface=public, service_id=739cc67c859343c79c19f3c041b46390, region_id=RegionOne) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:51.398198 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3a235-90de-4ef4-b3a8-aa59c8bde6b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:51.399544 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3a235-90de-4ef4-b3a8-aa59c8bde6b9 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:51.408561 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 458/906] 10.222.0.119 () {56 vars in 1256 bytes} [Thu Jul 14 15:36:51 2022] GET /identity/v3/endpoints?service_id=739cc67c859343c79c19f3c041b46390&interface=public®ion_id=RegionOne => generated 195 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:51.414972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3a235-90de-4ef4-b3a8-aa59c8bde6b9 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:51.434947 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7e7eb-0bf5-45a8-90c1-6b98b4eefd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:51.435762 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7e7eb-0bf5-45a8-90c1-6b98b4eefd76 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:51.436248 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7e7eb-0bf5-45a8-90c1-6b98b4eefd76 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:51.436534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7e7eb-0bf5-45a8-90c1-6b98b4eefd76 None admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:51.437327 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7e7eb-0bf5-45a8-90c1-6b98b4eefd76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:51.437637 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7e7eb-0bf5-45a8-90c1-6b98b4eefd76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:51.439176 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7e7eb-0bf5-45a8-90c1-6b98b4eefd76 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:51.454411 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 449/907] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:36:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:51.460535 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7e7eb-0bf5-45a8-90c1-6b98b4eefd76 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:51.480134 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:51.528896 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3a235-90de-4ef4-b3a8-aa59c8bde6b9 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:51.566179 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f36da-7165-4e01-a538-348a759f8b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:51.566857 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f36da-7165-4e01-a538-348a759f8b64 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:51.567146 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f36da-7165-4e01-a538-348a759f8b64 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:51.567427 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f36da-7165-4e01-a538-348a759f8b64 None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:51.568127 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f36da-7165-4e01-a538-348a759f8b64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:51.570532 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f36da-7165-4e01-a538-348a759f8b64 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:51.573840 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:51.578307 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 459/908] 10.222.0.119 () {56 vars in 1092 bytes} [Thu Jul 14 15:36:51 2022] GET /identity/v3/services => generated 1274 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:36:51.591717 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7e7eb-0bf5-45a8-90c1-6b98b4eefd76 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:51.633165 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516e3ae-85c2-45e5-a451-0e08a766c113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:51.633855 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516e3ae-85c2-45e5-a451-0e08a766c113 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:51.634145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516e3ae-85c2-45e5-a451-0e08a766c113 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:51.634429 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516e3ae-85c2-45e5-a451-0e08a766c113 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:51.635286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516e3ae-85c2-45e5-a451-0e08a766c113 None admin] RBAC: Adding query filter params (role.id=d9b93606a9bb4ff7a13f81af237b9009, scope.project.id=07652ced88cf4f069d1765176be5130b, user.id=4a1474b39e0b477daff5833491cd6df5) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:51.635604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516e3ae-85c2-45e5-a451-0e08a766c113 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:51.637131 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516e3ae-85c2-45e5-a451-0e08a766c113 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:51.644241 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 450/909] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:36:51 2022] GET /identity/v3/role_assignments?user.id=4a1474b39e0b477daff5833491cd6df5&scope.project.id=07652ced88cf4f069d1765176be5130b&role.id=d9b93606a9bb4ff7a13f81af237b9009 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:52.828608 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c77596-6534-466e-b070-589f6beede4a None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:52.829480 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c77596-6534-466e-b070-589f6beede4a None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:52.829903 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c77596-6534-466e-b070-589f6beede4a None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:52.831636 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 460/910] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:52 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:52.837614 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa18b7-ed62-4c6f-b81b-cdb1c0584fcd None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:52.838473 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa18b7-ed62-4c6f-b81b-cdb1c0584fcd None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:52.838952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa18b7-ed62-4c6f-b81b-cdb1c0584fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:52.856088 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-9dfa18b7-ed62-4c6f-b81b-cdb1c0584fcd None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:52.857567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-9dfa18b7-ed62-4c6f-b81b-cdb1c0584fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:52.925175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 451/911] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:52 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:36:52.948645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c77596-6534-466e-b070-589f6beede4a None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:53.053445 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c77596-6534-466e-b070-589f6beede4a None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:53.077502 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:53.095333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5640dd-f08e-4310-8b0a-35445d696c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:53.095333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5640dd-f08e-4310-8b0a-35445d696c31 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:53.095333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5640dd-f08e-4310-8b0a-35445d696c31 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:53.095333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5640dd-f08e-4310-8b0a-35445d696c31 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:53.095782 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5640dd-f08e-4310-8b0a-35445d696c31 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:53.095782 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5640dd-f08e-4310-8b0a-35445d696c31 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:53.105481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-1e5640dd-f08e-4310-8b0a-35445d696c31 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 15:36:53.105481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:53.105481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:36:53.105481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:36:53.105481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:36:53.105481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:36:53.105481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:36:53.105481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:53.105481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 15:36:53.105481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:53.105481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:36:53.105481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:53.105481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:53.105481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:53.105481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:53.105481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:53.105481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:53.106523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:53.106523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:53.106523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:53.106523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:53.106523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:53.106523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:53.106523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:36:53.106523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:36:53.106523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:36:53.106523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:36:53.106523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:53.106523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:53.106523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:53.106523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:53.106523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:53.106523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:53.107360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:53.107360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:53.107360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:53.107360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:53.107360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:53.107360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:53.107360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:53.107360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:53.107360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:53.107360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:53.107360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:36:53.107360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:53.107360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 15:36:53.107360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:53.107360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 461/912] 10.222.0.119 () {56 vars in 1119 bytes} [Thu Jul 14 15:36:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:53.114575 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa18b7-ed62-4c6f-b81b-cdb1c0584fcd None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:53.197353 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:53.216259 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa18b7-ed62-4c6f-b81b-cdb1c0584fcd None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:53.251314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d51e8-d47d-49a0-aa3c-d177c3142b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:53.251978 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d51e8-d47d-49a0-aa3c-d177c3142b52 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:53.252292 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d51e8-d47d-49a0-aa3c-d177c3142b52 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:53.252567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d51e8-d47d-49a0-aa3c-d177c3142b52 None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:53.253286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d51e8-d47d-49a0-aa3c-d177c3142b52 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:53.253590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d51e8-d47d-49a0-aa3c-d177c3142b52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:53.255330 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d51e8-d47d-49a0-aa3c-d177c3142b52 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:53.261612 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 452/913] 10.222.0.119 () {56 vars in 1119 bytes} [Thu Jul 14 15:36:53 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:53.267172 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5640dd-f08e-4310-8b0a-35445d696c31 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:53.371532 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5640dd-f08e-4310-8b0a-35445d696c31 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:53.385731 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c605d-f0a3-46e1-83a5-fbcdd79753e7 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:53.386024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c605d-f0a3-46e1-83a5-fbcdd79753e7 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:53.386288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c605d-f0a3-46e1-83a5-fbcdd79753e7 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:53.387765 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 453/914] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:36:53.396147 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a4665-6887-4809-a8ab-44c4d2dd911a None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:53.396147 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a4665-6887-4809-a8ab-44c4d2dd911a None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:53.396147 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a4665-6887-4809-a8ab-44c4d2dd911a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:53.412710 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-375a4665-6887-4809-a8ab-44c4d2dd911a None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:53.414126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36703e-87b1-4c67-b79b-2e1411900323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:53.414586 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-375a4665-6887-4809-a8ab-44c4d2dd911a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:53.415230 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36703e-87b1-4c67-b79b-2e1411900323 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:53.415699 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36703e-87b1-4c67-b79b-2e1411900323 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:53.416174 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36703e-87b1-4c67-b79b-2e1411900323 None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:53.417086 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36703e-87b1-4c67-b79b-2e1411900323 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:53.417582 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36703e-87b1-4c67-b79b-2e1411900323 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:53.419134 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36703e-87b1-4c67-b79b-2e1411900323 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:53.424879 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 462/915] 10.222.0.119 () {56 vars in 1119 bytes} [Thu Jul 14 15:36:53 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:53.431206 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36703e-87b1-4c67-b79b-2e1411900323 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:53.486224 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:53.490474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 454/916] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:53 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:36:53.517197 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a4665-6887-4809-a8ab-44c4d2dd911a None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:53.556214 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36703e-87b1-4c67-b79b-2e1411900323 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:53.596646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29aaa9c-439f-4096-a123-707b3a207a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:53.597316 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29aaa9c-439f-4096-a123-707b3a207a87 None admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:53.597602 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29aaa9c-439f-4096-a123-707b3a207a87 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:53.597881 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29aaa9c-439f-4096-a123-707b3a207a87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:53.598626 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29aaa9c-439f-4096-a123-707b3a207a87 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:53.600187 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29aaa9c-439f-4096-a123-707b3a207a87 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:53.612521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:53.635883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a4665-6887-4809-a8ab-44c4d2dd911a None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:53.671456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291297c4-63b2-40ed-842f-fab1d861b624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:53.672480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291297c4-63b2-40ed-842f-fab1d861b624 None admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:53.672953 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291297c4-63b2-40ed-842f-fab1d861b624 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:53.673416 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291297c4-63b2-40ed-842f-fab1d861b624 None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:53.674421 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291297c4-63b2-40ed-842f-fab1d861b624 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:53.675999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291297c4-63b2-40ed-842f-fab1d861b624 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:53.697847 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 463/917] 10.222.0.119 () {60 vars in 1149 bytes} [Thu Jul 14 15:36:53 2022] POST /identity/v3/endpoints => generated 348 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:36:53.715285 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aef5aa-aebe-4463-888b-290830304449 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:53.715624 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aef5aa-aebe-4463-888b-290830304449 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:53.715862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aef5aa-aebe-4463-888b-290830304449 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:53.717342 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 464/918] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:36:53.723617 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ece196-68ec-4638-bf7f-6b6d2e494970 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:53.723907 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ece196-68ec-4638-bf7f-6b6d2e494970 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:53.724346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ece196-68ec-4638-bf7f-6b6d2e494970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:53.743907 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-69ece196-68ec-4638-bf7f-6b6d2e494970 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:53.745185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-69ece196-68ec-4638-bf7f-6b6d2e494970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:53.758416 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 455/919] 10.222.0.119 () {60 vars in 1146 bytes} [Thu Jul 14 15:36:53 2022] POST /identity/v3/services => generated 242 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:53.804022 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c09d1a-eb3f-44a5-a60c-1507e450db2e None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:53.804371 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c09d1a-eb3f-44a5-a60c-1507e450db2e None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:53.804616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c09d1a-eb3f-44a5-a60c-1507e450db2e None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:53.806591 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 456/920] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:53.814315 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80cc8e-b5c8-4603-98e1-8401cf08063d None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:53.814549 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80cc8e-b5c8-4603-98e1-8401cf08063d None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:53.814842 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80cc8e-b5c8-4603-98e1-8401cf08063d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:53.833819 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-bb80cc8e-b5c8-4603-98e1-8401cf08063d None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:53.835249 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-bb80cc8e-b5c8-4603-98e1-8401cf08063d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:53.854839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 465/921] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:53 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:36:53.880174 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ece196-68ec-4638-bf7f-6b6d2e494970 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:53.917130 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:53.929171 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 457/922] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:53 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:36:53.955504 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80cc8e-b5c8-4603-98e1-8401cf08063d None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:54.006348 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ece196-68ec-4638-bf7f-6b6d2e494970 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:54.044905 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5cf42b-8157-470c-afd7-e54444ed8a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:54.045480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:54.045733 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cf42b-8157-470c-afd7-e54444ed8a54 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:54.046021 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cf42b-8157-470c-afd7-e54444ed8a54 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:54.046537 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cf42b-8157-470c-afd7-e54444ed8a54 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:54.059033 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5cf42b-8157-470c-afd7-e54444ed8a54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:36:54.067367 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-4a5cf42b-8157-470c-afd7-e54444ed8a54 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:36:54.067367 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:54.067367 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:54.067367 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:54.067367 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:54.067367 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:54.067367 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:54.067367 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:54.067367 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:54.067367 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:54.067367 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:54.067367 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:54.067367 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:36:54.067367 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:36:54.067367 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:36:54.067367 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:36:54.068506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:36:54.068506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:36:54.068506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:36:54.068506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:36:54.068506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:54.068506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:54.068506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:54.068506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:54.068506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:54.068506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:54.068506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:54.068506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:54.068506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:54.068506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:54.068506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:54.068506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:54.069869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:54.069869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:54.069869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:54.069869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:54.069869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:36:54.069869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:36:54.069869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:36:54.069869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:36:54.069869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:36:54.069869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:36:54.069869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:36:54.069869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:54.069869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 466/923] 10.222.0.119 () {56 vars in 1125 bytes} [Thu Jul 14 15:36:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:36:54.075724 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5cf42b-8157-470c-afd7-e54444ed8a54 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:54.090175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80cc8e-b5c8-4603-98e1-8401cf08063d None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:54.137560 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995e8c4-52cc-4059-8f18-a3c032b979e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:54.139009 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995e8c4-52cc-4059-8f18-a3c032b979e6 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:54.139546 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995e8c4-52cc-4059-8f18-a3c032b979e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:54.139952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995e8c4-52cc-4059-8f18-a3c032b979e6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:54.140680 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995e8c4-52cc-4059-8f18-a3c032b979e6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:54.142842 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995e8c4-52cc-4059-8f18-a3c032b979e6 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:54.160304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-2995e8c4-52cc-4059-8f18-a3c032b979e6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 15:36:54.160304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:54.160304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:36:54.160304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:36:54.160304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:36:54.160304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:36:54.160304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:36:54.160304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:54.160304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 15:36:54.160304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:54.160304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:36:54.160304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:54.160304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:54.160304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:54.160304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:54.160304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:54.161497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:54.161497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:54.161497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:54.161497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:54.161497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:54.161497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:54.161497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:54.161497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:36:54.161497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:36:54.161497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:36:54.161497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:36:54.161497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:54.161497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:54.161497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:54.161497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:54.161497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:54.162425 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:54.162425 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:54.162425 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:54.162425 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:54.162425 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:54.162425 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:54.162425 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:54.162425 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:54.162425 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:54.162425 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:54.162425 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:54.162425 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:36:54.162425 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:54.162425 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 15:36:54.162425 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:54.162425 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 458/924] 10.222.0.119 () {56 vars in 1137 bytes} [Thu Jul 14 15:36:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:36:54.173783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995e8c4-52cc-4059-8f18-a3c032b979e6 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:54.180503 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:54.187359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5cf42b-8157-470c-afd7-e54444ed8a54 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:54.224458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32106a27-66fd-4400-aad4-0006256fd2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:54.225596 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32106a27-66fd-4400-aad4-0006256fd2da None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:54.226160 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32106a27-66fd-4400-aad4-0006256fd2da None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:54.226755 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32106a27-66fd-4400-aad4-0006256fd2da None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:54.227770 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32106a27-66fd-4400-aad4-0006256fd2da None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:54.228349 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32106a27-66fd-4400-aad4-0006256fd2da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:54.229923 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32106a27-66fd-4400-aad4-0006256fd2da None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:54.240824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 467/925] 10.222.0.119 () {56 vars in 1120 bytes} [Thu Jul 14 15:36:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:54.247223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32106a27-66fd-4400-aad4-0006256fd2da None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:54.306229 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995e8c4-52cc-4059-8f18-a3c032b979e6 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:54.347069 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:54.356348 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32de86d-a66d-48fa-8f99-a3d4c1e49c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:54.362918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32de86d-a66d-48fa-8f99-a3d4c1e49c16 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:54.362918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32de86d-a66d-48fa-8f99-a3d4c1e49c16 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:54.362918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32de86d-a66d-48fa-8f99-a3d4c1e49c16 None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:54.362918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32de86d-a66d-48fa-8f99-a3d4c1e49c16 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:54.362918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32de86d-a66d-48fa-8f99-a3d4c1e49c16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:54.362918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32de86d-a66d-48fa-8f99-a3d4c1e49c16 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:54.363425 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32106a27-66fd-4400-aad4-0006256fd2da None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:54.373757 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 459/926] 10.222.0.119 () {56 vars in 1131 bytes} [Thu Jul 14 15:36:54 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:54.377751 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32de86d-a66d-48fa-8f99-a3d4c1e49c16 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:54.416292 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ceb38-d242-4da9-b8d5-c64566616db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:54.417102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ceb38-d242-4da9-b8d5-c64566616db9 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:54.417388 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ceb38-d242-4da9-b8d5-c64566616db9 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:54.417668 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ceb38-d242-4da9-b8d5-c64566616db9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:54.429900 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ceb38-d242-4da9-b8d5-c64566616db9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:54.431066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ceb38-d242-4da9-b8d5-c64566616db9 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:54.450952 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-5b2ceb38-d242-4da9-b8d5-c64566616db9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:54.450952 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:54.450952 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:54.450952 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:54.450952 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:54.450952 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:54.450952 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:54.450952 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:54.450952 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:54.450952 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:54.450952 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:54.450952 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:54.450952 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:54.450952 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:54.450952 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:54.451919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:54.451919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:54.451919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:54.451919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:54.451919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:54.451919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:54.451919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:54.451919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:54.451919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:54.451919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:54.451919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:54.451919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:54.451919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:54.451919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:54.451919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:54.451919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:54.451919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:54.452867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:54.452867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:54.452867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:54.452867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:54.457096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 468/927] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:36:54.458502 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ceb38-d242-4da9-b8d5-c64566616db9 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:54.469264 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:54.516597 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32de86d-a66d-48fa-8f99-a3d4c1e49c16 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:54.557310 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572b629-b64d-4e75-b13a-5882188284e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:54.558085 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572b629-b64d-4e75-b13a-5882188284e3 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:54.558471 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572b629-b64d-4e75-b13a-5882188284e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:54.558824 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572b629-b64d-4e75-b13a-5882188284e3 None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:54.559532 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572b629-b64d-4e75-b13a-5882188284e3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:54.559895 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572b629-b64d-4e75-b13a-5882188284e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:54.561544 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572b629-b64d-4e75-b13a-5882188284e3 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:54.567156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 460/928] 10.222.0.119 () {56 vars in 1131 bytes} [Thu Jul 14 15:36:54 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:54.573522 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572b629-b64d-4e75-b13a-5882188284e3 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:54.581677 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ceb38-d242-4da9-b8d5-c64566616db9 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:54.628868 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66d8eb-35a6-4977-a162-d9226a9e4b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:54.629553 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66d8eb-35a6-4977-a162-d9226a9e4b66 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:54.630165 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66d8eb-35a6-4977-a162-d9226a9e4b66 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:54.630450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66d8eb-35a6-4977-a162-d9226a9e4b66 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:54.631474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66d8eb-35a6-4977-a162-d9226a9e4b66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:54.631835 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66d8eb-35a6-4977-a162-d9226a9e4b66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:54.633879 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66d8eb-35a6-4977-a162-d9226a9e4b66 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:54.648934 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:54.653386 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 469/929] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:54.654629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66d8eb-35a6-4977-a162-d9226a9e4b66 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:54.697893 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572b629-b64d-4e75-b13a-5882188284e3 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:54.726402 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:54.736724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c262f-1384-46b6-9b60-a5323c6ae75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:54.737395 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c262f-1384-46b6-9b60-a5323c6ae75b None admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:54.741048 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c262f-1384-46b6-9b60-a5323c6ae75b None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:54.741048 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c262f-1384-46b6-9b60-a5323c6ae75b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:54.741048 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c262f-1384-46b6-9b60-a5323c6ae75b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:54.741048 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c262f-1384-46b6-9b60-a5323c6ae75b None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:54.775193 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66d8eb-35a6-4977-a162-d9226a9e4b66 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:54.817391 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c13dc-8ee3-4606-8bca-1b6cdc4ee268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:54.818222 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c13dc-8ee3-4606-8bca-1b6cdc4ee268 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:54.818506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c13dc-8ee3-4606-8bca-1b6cdc4ee268 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:54.818783 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c13dc-8ee3-4606-8bca-1b6cdc4ee268 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:54.827852 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c13dc-8ee3-4606-8bca-1b6cdc4ee268 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:54.829390 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c13dc-8ee3-4606-8bca-1b6cdc4ee268 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:54.845076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-649c13dc-8ee3-4606-8bca-1b6cdc4ee268 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:36:54.845076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:54.845076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:54.845076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:54.845076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:54.845076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:54.845076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:54.845076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:54.845076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:54.845076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:54.845076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:54.845076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:54.845076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:36:54.845076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:36:54.845076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:36:54.845076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:36:54.847166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:54.847166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:54.847166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:54.847166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:54.847166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:54.847166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:54.847166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:54.847166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:54.847166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:54.847166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:54.847166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:54.847166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:54.847166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:54.847166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:54.847166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:54.847166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:54.847166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:54.847166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:54.849380 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:54.849380 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:54.849380 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:36:54.849380 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:36:54.849380 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:36:54.849380 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:36:54.849380 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:36:54.849380 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:36:54.849380 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:36:54.849380 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:54.849380 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 470/930] 10.222.0.119 () {56 vars in 1122 bytes} [Thu Jul 14 15:36:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:36:54.852709 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c13dc-8ee3-4606-8bca-1b6cdc4ee268 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:54.912566 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 461/931] 10.222.0.119 () {60 vars in 1149 bytes} [Thu Jul 14 15:36:54 2022] POST /identity/v3/endpoints => generated 349 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:36:54.968940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c13dc-8ee3-4606-8bca-1b6cdc4ee268 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:55.000828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:55.017533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cffc6-5e47-4279-bd0d-c2bd41e80191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:55.020824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cffc6-5e47-4279-bd0d-c2bd41e80191 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:55.020824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cffc6-5e47-4279-bd0d-c2bd41e80191 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:55.020824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cffc6-5e47-4279-bd0d-c2bd41e80191 None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:55.020824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506cffc6-5e47-4279-bd0d-c2bd41e80191 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:55.020824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506cffc6-5e47-4279-bd0d-c2bd41e80191 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:55.021564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506cffc6-5e47-4279-bd0d-c2bd41e80191 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:55.043913 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 471/932] 10.222.0.119 () {56 vars in 1154 bytes} [Thu Jul 14 15:36:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:55.050015 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c262f-1384-46b6-9b60-a5323c6ae75b None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:55.186740 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c262f-1384-46b6-9b60-a5323c6ae75b None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:55.202239 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:55.223947 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a295de6-e861-491a-afef-c867a4755dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:55.225090 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a295de6-e861-491a-afef-c867a4755dae None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:55.225732 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a295de6-e861-491a-afef-c867a4755dae None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:55.226303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a295de6-e861-491a-afef-c867a4755dae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:55.238322 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a295de6-e861-491a-afef-c867a4755dae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:55.240002 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a295de6-e861-491a-afef-c867a4755dae None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:55.266349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-1a295de6-e861-491a-afef-c867a4755dae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:55.266349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:55.266349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:55.266349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:55.266349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:55.266349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:55.266349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:55.266349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:55.266349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:55.266349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:55.266349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:55.266349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:55.266349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:55.266349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:55.266349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:55.267414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:55.267414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:55.267414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:55.267414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:55.267414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:55.267414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:55.267414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:55.267414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:55.267414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:55.267414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:55.267414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:55.267414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:55.267414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:55.267414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:55.267414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:55.267414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:55.267414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:55.268335 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:55.268335 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:55.268335 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:55.268335 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:55.270592 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 462/933] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:55.281454 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cffc6-5e47-4279-bd0d-c2bd41e80191 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:55.408469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cffc6-5e47-4279-bd0d-c2bd41e80191 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:55.451319 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa258a-ae89-4671-8913-0b04519df0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:55.452408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa258a-ae89-4671-8913-0b04519df0f8 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:55.452898 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa258a-ae89-4671-8913-0b04519df0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:55.453405 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa258a-ae89-4671-8913-0b04519df0f8 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:55.454340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa258a-ae89-4671-8913-0b04519df0f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:55.454852 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa258a-ae89-4671-8913-0b04519df0f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:55.456492 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa258a-ae89-4671-8913-0b04519df0f8 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:55.472781 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 472/934] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:55.481837 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a295de6-e861-491a-afef-c867a4755dae None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:55.622300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a295de6-e861-491a-afef-c867a4755dae None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:55.663412 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b452a-293c-4212-b6b6-aa14708408ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:55.664628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b452a-293c-4212-b6b6-aa14708408ad None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:55.665186 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b452a-293c-4212-b6b6-aa14708408ad None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:55.665674 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b452a-293c-4212-b6b6-aa14708408ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:55.676345 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b452a-293c-4212-b6b6-aa14708408ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:55.680642 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b452a-293c-4212-b6b6-aa14708408ad None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:55.697521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-d33b452a-293c-4212-b6b6-aa14708408ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:55.697521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:55.697521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:55.697521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:55.697521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:55.697521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:55.697521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:55.697521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:55.697521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:55.697521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:55.697521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:55.697521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:55.697521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:36:55.697521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:36:55.697521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:36:55.698468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:36:55.698468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:55.698468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:55.698468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:55.698468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:55.698468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:55.698468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:55.698468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:55.698468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:55.698468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:55.698468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:55.698468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:55.698468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:55.698468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:55.698468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:55.698468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:55.698468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:55.699544 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:36:55.699544 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:36:55.699544 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:36:55.699544 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:36:55.699544 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:36:55.699544 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:36:55.699544 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:55.699544 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:55.702135 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 463/935] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:36:55.708305 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa258a-ae89-4671-8913-0b04519df0f8 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:55.769384 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:55.829818 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa258a-ae89-4671-8913-0b04519df0f8 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:55.872296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f1f0a-c60a-4be2-a247-cbca571ef64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:55.873406 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f1f0a-c60a-4be2-a247-cbca571ef64c None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:55.873941 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f1f0a-c60a-4be2-a247-cbca571ef64c None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:55.875822 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f1f0a-c60a-4be2-a247-cbca571ef64c None admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:55.876923 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f1f0a-c60a-4be2-a247-cbca571ef64c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:55.877464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f1f0a-c60a-4be2-a247-cbca571ef64c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:55.879129 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f1f0a-c60a-4be2-a247-cbca571ef64c None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:55.900034 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 473/936] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:36:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:55.906536 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b452a-293c-4212-b6b6-aa14708408ad None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:55.939931 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:56.034005 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e2c6a-d8df-4394-9167-e349b2909e28 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:56.034500 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e2c6a-d8df-4394-9167-e349b2909e28 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:56.034500 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e2c6a-d8df-4394-9167-e349b2909e28 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:56.036074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 474/937] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:36:56.039898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b452a-293c-4212-b6b6-aa14708408ad None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:56.043017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e410c86-e423-43de-a9bc-fceb46ac6d11 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:56.043556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e410c86-e423-43de-a9bc-fceb46ac6d11 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:56.044042 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e410c86-e423-43de-a9bc-fceb46ac6d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:56.062613 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-4e410c86-e423-43de-a9bc-fceb46ac6d11 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:56.064908 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-4e410c86-e423-43de-a9bc-fceb46ac6d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:56.087906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba9fc5-300e-4241-9c97-a202d7dd9e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:56.089561 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba9fc5-300e-4241-9c97-a202d7dd9e35 None admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:56.090034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba9fc5-300e-4241-9c97-a202d7dd9e35 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:56.090513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba9fc5-300e-4241-9c97-a202d7dd9e35 None admin] PATH_INFO: `/v3/projects/07652ced88cf4f069d1765176be5130b/users/4a1474b39e0b477daff5833491cd6df5/roles/d9b93606a9bb4ff7a13f81af237b9009` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:56.094577 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba9fc5-300e-4241-9c97-a202d7dd9e35 None admin] RBAC: Authorizing `identity:create_grant(project_id=07652ced88cf4f069d1765176be5130b, user_id=4a1474b39e0b477daff5833491cd6df5, role_id=d9b93606a9bb4ff7a13f81af237b9009)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:56.096342 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba9fc5-300e-4241-9c97-a202d7dd9e35 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:56.147504 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 475/938] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:56 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:36:56.149030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8c7fb-989d-4205-ba6e-da4cfc59b08c None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:56.149327 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8c7fb-989d-4205-ba6e-da4cfc59b08c None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:56.149607 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8c7fb-989d-4205-ba6e-da4cfc59b08c None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:56.151000 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 476/939] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:56.157437 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc6b41-5b84-4935-adf9-6702cdce8783 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:56.157731 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc6b41-5b84-4935-adf9-6702cdce8783 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:56.158011 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc6b41-5b84-4935-adf9-6702cdce8783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:56.182843 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-4abc6b41-5b84-4935-adf9-6702cdce8783 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:56.184517 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-4abc6b41-5b84-4935-adf9-6702cdce8783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:56.211573 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:56.211925 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 464/940] 10.222.0.119 () {58 vars in 1444 bytes} [Thu Jul 14 15:36:55 2022] PUT /identity/v3/projects/07652ced88cf4f069d1765176be5130b/users/4a1474b39e0b477daff5833491cd6df5/roles/d9b93606a9bb4ff7a13f81af237b9009 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:36:56.213101 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba9fc5-300e-4241-9c97-a202d7dd9e35 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:56.266980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 477/941] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:56 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:36:56.293252 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc6b41-5b84-4935-adf9-6702cdce8783 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:56.331518 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:56.349984 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba9fc5-300e-4241-9c97-a202d7dd9e35 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:56.396442 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac21422-4957-4f88-b0aa-cc77b45258c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:56.397275 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac21422-4957-4f88-b0aa-cc77b45258c5 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:56.397611 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac21422-4957-4f88-b0aa-cc77b45258c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:56.397890 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac21422-4957-4f88-b0aa-cc77b45258c5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:56.398549 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac21422-4957-4f88-b0aa-cc77b45258c5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:56.400400 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac21422-4957-4f88-b0aa-cc77b45258c5 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:56.419731 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-bac21422-4957-4f88-b0aa-cc77b45258c5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:36:56.419731 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:56.419731 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:36:56.419731 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:36:56.419731 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:36:56.419731 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:36:56.419731 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:36:56.419731 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:56.419731 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:36:56.419731 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:56.419731 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:36:56.419731 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:56.419731 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:56.419731 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:56.419731 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:56.419731 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:56.419731 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:56.421125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:56.421125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:56.421125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:56.421125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:56.421125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:56.421125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:56.421125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:36:56.421125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:36:56.421125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:36:56.421125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:36:56.421125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:56.421125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:56.421125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:56.421125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:56.421125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:56.421125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:56.422206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:56.422206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:56.422206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:56.422206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:56.422206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:56.422206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:56.422206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:56.422206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:56.422206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:56.422206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:56.422206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:36:56.422206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:56.422206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:36:56.422206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:56.422206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 465/942] 10.222.0.119 () {56 vars in 1131 bytes} [Thu Jul 14 15:36:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:56.425741 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc6b41-5b84-4935-adf9-6702cdce8783 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:56.429580 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac21422-4957-4f88-b0aa-cc77b45258c5 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:56.474056 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ec30d-774f-4501-b0a0-ebfb0b6d5960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:56.474889 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ec30d-774f-4501-b0a0-ebfb0b6d5960 None admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:56.475279 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ec30d-774f-4501-b0a0-ebfb0b6d5960 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:56.476343 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ec30d-774f-4501-b0a0-ebfb0b6d5960 None admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:56.477254 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ec30d-774f-4501-b0a0-ebfb0b6d5960 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:56.478876 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ec30d-774f-4501-b0a0-ebfb0b6d5960 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:56.480416 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: WARNING keystone.server.flask.common [None req-af1ec30d-774f-4501-b0a0-ebfb0b6d5960 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 14 15:36:56.526938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.sql.core [None req-af1ec30d-774f-4501-b0a0-ebfb0b6d5960 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 15:36:56.526938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 15:36:56.526938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [parameters: {'id': '02c0c496b87a41f883d68244db2715d5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 15:36:56.526938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86978) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 15:36:56.535162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-af1ec30d-774f-4501-b0a0-ebfb0b6d5960 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 02c0c496b87a41f883d68244db2715d5.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 02c0c496b87a41f883d68244db2715d5. Jul 14 15:36:56.535162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:56.535162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 15:36:56.535162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 15:36:56.535162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 15:36:56.535162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 15:36:56.535162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 15:36:56.535162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 15:36:56.535162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 15:36:56.535162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application conn.query(q) Jul 14 15:36:56.535162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 15:36:56.535162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 15:36:56.535162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 15:36:56.535971 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application result.read() Jul 14 15:36:56.535971 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 15:36:56.535971 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 15:36:56.535971 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 15:36:56.535971 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 15:36:56.535971 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 15:36:56.535971 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 15:36:56.535971 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 15:36:56.535971 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 15:36:56.535971 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 15:36:56.535971 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:56.535971 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 15:36:56.535971 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:56.535971 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:56.535971 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 15:36:56.535971 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 15:36:56.535971 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 14 15:36:56.535971 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 14 15:36:56.536983 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 15:36:56.536983 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application next(self.gen) Jul 14 15:36:56.536983 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 15:36:56.536983 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application yield resource Jul 14 15:36:56.536983 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 15:36:56.536983 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application next(self.gen) Jul 14 15:36:56.536983 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 15:36:56.536983 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 15:36:56.536983 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 15:36:56.536983 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 15:36:56.536983 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 15:36:56.536983 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise self.value Jul 14 15:36:56.536983 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 15:36:56.536983 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 15:36:56.536983 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 15:36:56.536983 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application session.commit() Jul 14 15:36:56.536983 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 15:36:56.537884 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 15:36:56.537884 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 15:36:56.537884 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 15:36:56.537884 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 15:36:56.537884 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self.session.flush() Jul 14 15:36:56.537884 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 15:36:56.537884 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 15:36:56.537884 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 15:36:56.537884 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 15:36:56.537884 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 15:36:56.537884 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application compat.raise_( Jul 14 15:36:56.537884 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 15:36:56.537884 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception Jul 14 15:36:56.537884 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 15:36:56.537884 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 15:36:56.537884 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 15:36:56.537884 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 15:36:56.539697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 15:36:56.539697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 15:36:56.539697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 15:36:56.539697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 15:36:56.539697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 15:36:56.539697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 15:36:56.539697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 15:36:56.539697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 15:36:56.539697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 15:36:56.539697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 15:36:56.539697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 15:36:56.539697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 15:36:56.539697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 15:36:56.539697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 15:36:56.539697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 15:36:56.540538 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 15:36:56.540538 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 15:36:56.540538 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception Jul 14 15:36:56.540538 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 15:36:56.540538 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 15:36:56.540538 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 15:36:56.540538 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 15:36:56.540538 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 15:36:56.540538 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 15:36:56.540538 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 15:36:56.540538 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application conn.query(q) Jul 14 15:36:56.540538 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 15:36:56.540538 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 15:36:56.540538 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 15:36:56.540538 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application result.read() Jul 14 15:36:56.540538 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 15:36:56.540538 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 15:36:56.541419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 15:36:56.541419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 15:36:56.541419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 15:36:56.541419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 15:36:56.541419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 15:36:56.541419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 15:36:56.541419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 15:36:56.541419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 15:36:56.541419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [parameters: {'id': '02c0c496b87a41f883d68244db2715d5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 15:36:56.541419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 15:36:56.541419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:56.541419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:36:56.541419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:56.541419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:56.541419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 14 15:36:56.542212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 14 15:36:56.542212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 15:36:56.542212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 15:36:56.542212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 14 15:36:56.542212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:56.542212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:36:56.542212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:56.542212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:56.542212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:56.542212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:56.542212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:56.542212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:56.542212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:56.542212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:56.542212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:56.542212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:56.542212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:56.543121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:56.543121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 14 15:36:56.543121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 14 15:36:56.543121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:56.543121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:56.543121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 14 15:36:56.543121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 14 15:36:56.543121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 02c0c496b87a41f883d68244db2715d5. Jul 14 15:36:56.543121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:56.546745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 478/943] 10.222.0.119 () {60 vars in 1145 bytes} [Thu Jul 14 15:36:56 2022] POST /identity/v3/projects => generated 262 bytes in 254 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:36:56.552596 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ec30d-774f-4501-b0a0-ebfb0b6d5960 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:56.560274 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac21422-4957-4f88-b0aa-cc77b45258c5 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:56.584615 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:56.598608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc50d39-1847-4bc3-a999-f7daef513f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:56.599530 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc50d39-1847-4bc3-a999-f7daef513f8c None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:56.600060 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc50d39-1847-4bc3-a999-f7daef513f8c None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:56.601357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc50d39-1847-4bc3-a999-f7daef513f8c None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:56.602211 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc50d39-1847-4bc3-a999-f7daef513f8c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:56.602681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc50d39-1847-4bc3-a999-f7daef513f8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:56.604284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc50d39-1847-4bc3-a999-f7daef513f8c None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:56.616224 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 466/944] 10.222.0.119 () {56 vars in 1127 bytes} [Thu Jul 14 15:36:56 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:56.621314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc50d39-1847-4bc3-a999-f7daef513f8c None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:56.643783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:56.688402 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ec30d-774f-4501-b0a0-ebfb0b6d5960 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:56.727881 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a4dfe-4ac1-4e49-81bd-2a55a20cf1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:56.728734 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a4dfe-4ac1-4e49-81bd-2a55a20cf1e7 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:56.729022 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a4dfe-4ac1-4e49-81bd-2a55a20cf1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:56.729297 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a4dfe-4ac1-4e49-81bd-2a55a20cf1e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:56.737125 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a4dfe-4ac1-4e49-81bd-2a55a20cf1e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:56.738786 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a4dfe-4ac1-4e49-81bd-2a55a20cf1e7 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:56.754220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-6c5a4dfe-4ac1-4e49-81bd-2a55a20cf1e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:56.754220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:56.754220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:56.754220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:56.754220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:56.754220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:56.754220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:56.754220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:56.754220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:56.754220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:56.754220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:56.754220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:56.754220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:36:56.754220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:36:56.754220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:36:56.755108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:36:56.755108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:56.755108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:56.755108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:56.755108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:56.755108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:56.755108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:56.755108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:56.755108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:56.755108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:56.755108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:56.755108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:56.755108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:56.755108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:56.755108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:56.755108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:56.755108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:56.755994 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:36:56.755994 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:36:56.755994 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:36:56.755994 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:36:56.755994 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:36:56.755994 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:36:56.755994 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:36:56.755994 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:56.757038 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc50d39-1847-4bc3-a999-f7daef513f8c None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:56.760619 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 479/945] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:56.761940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a4dfe-4ac1-4e49-81bd-2a55a20cf1e7 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:56.803031 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fdc58-2051-4ef8-a019-eaa2d7d70752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:56.803660 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fdc58-2051-4ef8-a019-eaa2d7d70752 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:56.803951 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fdc58-2051-4ef8-a019-eaa2d7d70752 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:56.804260 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fdc58-2051-4ef8-a019-eaa2d7d70752 None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:56.804982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fdc58-2051-4ef8-a019-eaa2d7d70752 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:56.805299 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fdc58-2051-4ef8-a019-eaa2d7d70752 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:56.806722 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fdc58-2051-4ef8-a019-eaa2d7d70752 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:56.816178 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 467/946] 10.222.0.119 () {56 vars in 1127 bytes} [Thu Jul 14 15:36:56 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:56.819020 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fdc58-2051-4ef8-a019-eaa2d7d70752 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:56.858247 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:56.882828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a4dfe-4ac1-4e49-81bd-2a55a20cf1e7 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:56.924395 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fa340-f137-44a0-a6bc-e8868b54824f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:56.925119 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fa340-f137-44a0-a6bc-e8868b54824f None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:56.925407 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fa340-f137-44a0-a6bc-e8868b54824f None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:56.925686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fa340-f137-44a0-a6bc-e8868b54824f None admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:56.926449 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53fa340-f137-44a0-a6bc-e8868b54824f None admin] RBAC: Adding query filter params (name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:56.926760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53fa340-f137-44a0-a6bc-e8868b54824f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:56.928216 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53fa340-f137-44a0-a6bc-e8868b54824f None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:56.937597 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:56.956468 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 480/947] 10.222.0.119 () {56 vars in 1117 bytes} [Thu Jul 14 15:36:56 2022] GET /identity/v3/projects?name=service => generated 413 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:56.965810 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fdc58-2051-4ef8-a019-eaa2d7d70752 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:57.009008 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af19865-6e36-441c-bc00-ccb7c650737d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:57.010113 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af19865-6e36-441c-bc00-ccb7c650737d None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:57.010620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af19865-6e36-441c-bc00-ccb7c650737d None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:57.011125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af19865-6e36-441c-bc00-ccb7c650737d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:57.012262 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af19865-6e36-441c-bc00-ccb7c650737d None admin] RBAC: Adding query filter params (interface=public, service_id=7c02495ffe0140a7a0bf3705a647a425, region_id=RegionOne) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:57.012841 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af19865-6e36-441c-bc00-ccb7c650737d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:57.014563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af19865-6e36-441c-bc00-ccb7c650737d None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:57.021302 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 468/948] 10.222.0.119 () {56 vars in 1256 bytes} [Thu Jul 14 15:36:56 2022] GET /identity/v3/endpoints?service_id=7c02495ffe0140a7a0bf3705a647a425&interface=public®ion_id=RegionOne => generated 195 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:57.028142 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fa340-f137-44a0-a6bc-e8868b54824f None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:57.147131 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fa340-f137-44a0-a6bc-e8868b54824f None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:57.187787 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87513a3a-0449-43a0-a3fa-3e52484caa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:57.188762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87513a3a-0449-43a0-a3fa-3e52484caa87 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:57.189225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87513a3a-0449-43a0-a3fa-3e52484caa87 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:57.189504 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87513a3a-0449-43a0-a3fa-3e52484caa87 None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:57.190183 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87513a3a-0449-43a0-a3fa-3e52484caa87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:57.191550 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87513a3a-0449-43a0-a3fa-3e52484caa87 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:57.193795 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:57.198907 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 481/949] 10.222.0.119 () {56 vars in 1092 bytes} [Thu Jul 14 15:36:57 2022] GET /identity/v3/services => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:36:57.315527 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea91c9-8bbf-45ec-8c97-c2371a8f54d1 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:57.316050 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea91c9-8bbf-45ec-8c97-c2371a8f54d1 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:57.316152 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea91c9-8bbf-45ec-8c97-c2371a8f54d1 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:57.317756 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 469/950] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:57.323990 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fe673-50f3-4cac-9dcd-87b43b5cfc5f None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:57.324336 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fe673-50f3-4cac-9dcd-87b43b5cfc5f None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:57.324606 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fe673-50f3-4cac-9dcd-87b43b5cfc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:57.344851 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-2f7fe673-50f3-4cac-9dcd-87b43b5cfc5f None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:57.346424 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-2f7fe673-50f3-4cac-9dcd-87b43b5cfc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:57.424800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 482/951] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:57 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:36:57.447911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea91c9-8bbf-45ec-8c97-c2371a8f54d1 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:57.558466 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea91c9-8bbf-45ec-8c97-c2371a8f54d1 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:57.593748 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b46c54-2b8b-44e6-9fa9-b6382908a8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:57.594554 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b46c54-2b8b-44e6-9fa9-b6382908a8b0 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:57.594844 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b46c54-2b8b-44e6-9fa9-b6382908a8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:57.595125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b46c54-2b8b-44e6-9fa9-b6382908a8b0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:57.595782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b46c54-2b8b-44e6-9fa9-b6382908a8b0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:57.597239 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b46c54-2b8b-44e6-9fa9-b6382908a8b0 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:57.610205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-99b46c54-2b8b-44e6-9fa9-b6382908a8b0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 15:36:57.610205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:57.610205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:36:57.610205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:36:57.610205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:36:57.610205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:36:57.610205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:36:57.610205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:57.610205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 15:36:57.610205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:57.610205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:36:57.610205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:57.610205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:57.610205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:57.610205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:57.610205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:57.610205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:57.611310 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:57.611310 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:57.611310 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:57.611310 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:57.611310 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:57.611310 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:57.611310 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:36:57.611310 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:36:57.611310 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:36:57.611310 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:36:57.611310 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:57.611310 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:57.611310 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:57.611310 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:57.611310 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:57.611310 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:57.612214 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:57.612214 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:57.612214 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:57.612214 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:57.612214 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:57.612214 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:57.612214 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:57.612214 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:57.612214 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:57.612214 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:57.612214 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:36:57.612214 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:36:57.612214 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 15:36:57.612214 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:57.612214 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 470/952] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:36:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:57.617788 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fe673-50f3-4cac-9dcd-87b43b5cfc5f None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:57.726248 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fe673-50f3-4cac-9dcd-87b43b5cfc5f None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:57.755916 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:57.762822 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612e2f9-cb15-4f33-ad57-ef225fc078f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:57.765340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612e2f9-cb15-4f33-ad57-ef225fc078f0 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:57.765340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612e2f9-cb15-4f33-ad57-ef225fc078f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:57.765340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612e2f9-cb15-4f33-ad57-ef225fc078f0 None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:57.765340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612e2f9-cb15-4f33-ad57-ef225fc078f0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:57.765829 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612e2f9-cb15-4f33-ad57-ef225fc078f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:57.767493 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612e2f9-cb15-4f33-ad57-ef225fc078f0 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:57.773606 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 483/953] 10.222.0.119 () {56 vars in 1117 bytes} [Thu Jul 14 15:36:57 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:57.784124 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b46c54-2b8b-44e6-9fa9-b6382908a8b0 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:57.794324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:57.890599 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b46c54-2b8b-44e6-9fa9-b6382908a8b0 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:57.927180 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedcdd7-82c3-459e-ab90-73dc009c5b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:57.927895 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedcdd7-82c3-459e-ab90-73dc009c5b07 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:57.928280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedcdd7-82c3-459e-ab90-73dc009c5b07 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:57.928577 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedcdd7-82c3-459e-ab90-73dc009c5b07 None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:57.930075 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beedcdd7-82c3-459e-ab90-73dc009c5b07 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:57.930439 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beedcdd7-82c3-459e-ab90-73dc009c5b07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:57.931821 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beedcdd7-82c3-459e-ab90-73dc009c5b07 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:57.937210 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 471/954] 10.222.0.119 () {56 vars in 1117 bytes} [Thu Jul 14 15:36:57 2022] GET /identity/v3/services?type=compute => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:58.374900 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f227c2f-1d58-4e3b-92ba-447aee27b10f None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:58.376769 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f227c2f-1d58-4e3b-92ba-447aee27b10f None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:58.376769 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f227c2f-1d58-4e3b-92ba-447aee27b10f None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:58.377131 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 484/955] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:58.383148 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16afac-f3a5-4818-82d0-e959a56f632c None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:58.383699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16afac-f3a5-4818-82d0-e959a56f632c None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:58.383699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16afac-f3a5-4818-82d0-e959a56f632c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:58.400452 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-ab16afac-f3a5-4818-82d0-e959a56f632c None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:58.401632 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-ab16afac-f3a5-4818-82d0-e959a56f632c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:58.472265 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:58.477799 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 472/956] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:58 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:36:58.501060 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f227c2f-1d58-4e3b-92ba-447aee27b10f None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:58.619064 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f227c2f-1d58-4e3b-92ba-447aee27b10f None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:58.653986 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caceb72-55bd-4ce4-a1bb-2187507dea37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:58.654719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caceb72-55bd-4ce4-a1bb-2187507dea37 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:58.655002 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caceb72-55bd-4ce4-a1bb-2187507dea37 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:58.655286 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caceb72-55bd-4ce4-a1bb-2187507dea37 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:58.666686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caceb72-55bd-4ce4-a1bb-2187507dea37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:36:58.674874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-3caceb72-55bd-4ce4-a1bb-2187507dea37 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:36:58.674874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:58.674874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:58.674874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:58.674874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:58.674874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:58.674874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:58.674874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:58.674874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:58.674874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:58.674874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:58.674874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:58.674874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:36:58.674874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:36:58.674874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:36:58.674874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:36:58.675760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:36:58.675760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:36:58.675760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:36:58.675760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:36:58.675760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:58.675760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:58.675760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:58.675760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:58.675760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:58.675760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:58.675760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:58.675760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:58.675760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:58.675760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:58.675760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:58.675760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:58.676703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:58.676703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:58.676703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:58.676703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:58.676703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:36:58.676703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:36:58.676703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:36:58.676703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:36:58.676703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:36:58.676703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:36:58.676703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:36:58.676703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:58.680473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 485/957] 10.222.0.119 () {56 vars in 1125 bytes} [Thu Jul 14 15:36:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:58.685237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16afac-f3a5-4818-82d0-e959a56f632c None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:58.793470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16afac-f3a5-4818-82d0-e959a56f632c None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:58.828907 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f862d-74f2-4065-aa3a-7c3cb01ec1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:58.829590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f862d-74f2-4065-aa3a-7c3cb01ec1d2 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:58.829883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f862d-74f2-4065-aa3a-7c3cb01ec1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:58.830165 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f862d-74f2-4065-aa3a-7c3cb01ec1d2 None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:58.830921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f862d-74f2-4065-aa3a-7c3cb01ec1d2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:58.831234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f862d-74f2-4065-aa3a-7c3cb01ec1d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:58.832633 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f862d-74f2-4065-aa3a-7c3cb01ec1d2 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:58.841910 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 473/958] 10.222.0.119 () {56 vars in 1120 bytes} [Thu Jul 14 15:36:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:58.847706 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caceb72-55bd-4ce4-a1bb-2187507dea37 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:58.907966 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:58.954293 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caceb72-55bd-4ce4-a1bb-2187507dea37 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:58.990492 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db0ba5-97f4-46c8-9411-ff2c5c5e7aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:58.991394 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db0ba5-97f4-46c8-9411-ff2c5c5e7aca None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:58.991736 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db0ba5-97f4-46c8-9411-ff2c5c5e7aca None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:58.992077 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db0ba5-97f4-46c8-9411-ff2c5c5e7aca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:59.003331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db0ba5-97f4-46c8-9411-ff2c5c5e7aca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:59.004820 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db0ba5-97f4-46c8-9411-ff2c5c5e7aca None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:59.022266 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-33db0ba5-97f4-46c8-9411-ff2c5c5e7aca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:59.022266 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:59.022266 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:59.022266 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:59.022266 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:59.022266 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:59.022266 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:59.022266 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:59.022266 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:59.022266 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:59.022266 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:59.022266 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:59.022266 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:36:59.022266 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:36:59.022266 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:36:59.023816 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:36:59.023816 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:59.023816 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:59.023816 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:59.023816 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:59.023816 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:59.023816 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:59.023816 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:59.023816 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:59.023816 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:59.023816 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:59.023816 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:59.023816 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:59.023816 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:59.023816 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:59.023816 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:59.023816 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:59.024745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:36:59.024745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:36:59.024745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:36:59.024745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:59.028393 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 486/959] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:59.030162 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f862d-74f2-4065-aa3a-7c3cb01ec1d2 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:59.097616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:59.141376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f862d-74f2-4065-aa3a-7c3cb01ec1d2 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:59.177533 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428d6a7-8375-43d4-a438-b91f6aef66ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:59.178552 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428d6a7-8375-43d4-a438-b91f6aef66ed None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:59.179665 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428d6a7-8375-43d4-a438-b91f6aef66ed None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:59.180269 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428d6a7-8375-43d4-a438-b91f6aef66ed None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:59.181231 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428d6a7-8375-43d4-a438-b91f6aef66ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:59.181746 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428d6a7-8375-43d4-a438-b91f6aef66ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:59.183318 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428d6a7-8375-43d4-a438-b91f6aef66ed None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:59.196799 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 474/960] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:36:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:36:59.202244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db0ba5-97f4-46c8-9411-ff2c5c5e7aca None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:59.221744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe461b-bbe4-45f7-ba5e-64c159497cc2 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:59.222357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe461b-bbe4-45f7-ba5e-64c159497cc2 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:59.222842 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe461b-bbe4-45f7-ba5e-64c159497cc2 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:59.224728 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 475/961] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:59 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:36:59.229922 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff785696-e68d-42a5-939f-4a44660820a6 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:59.230445 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff785696-e68d-42a5-939f-4a44660820a6 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:59.230965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff785696-e68d-42a5-939f-4a44660820a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:59.249482 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-ff785696-e68d-42a5-939f-4a44660820a6 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:59.251045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-ff785696-e68d-42a5-939f-4a44660820a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:59.315901 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db0ba5-97f4-46c8-9411-ff2c5c5e7aca None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:59.324084 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 476/962] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:59 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:36:59.332454 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:59.349715 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff785696-e68d-42a5-939f-4a44660820a6 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:59.358629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb79f8-fe82-4df9-b919-f12a4132fff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:59.359877 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb79f8-fe82-4df9-b919-f12a4132fff5 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:59.360468 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb79f8-fe82-4df9-b919-f12a4132fff5 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:59.360947 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb79f8-fe82-4df9-b919-f12a4132fff5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:59.370036 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb79f8-fe82-4df9-b919-f12a4132fff5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:59.371877 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb79f8-fe82-4df9-b919-f12a4132fff5 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:59.389874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-2fdb79f8-fe82-4df9-b919-f12a4132fff5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:36:59.389874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:59.389874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:59.389874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:59.389874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:59.389874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:59.389874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:59.389874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:59.389874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:59.389874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:59.389874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:59.389874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:59.389874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:36:59.389874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:36:59.389874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:36:59.389874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:36:59.391249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:59.391249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:59.391249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:59.391249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:59.391249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:59.391249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:59.391249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:59.391249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:59.391249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:59.391249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:59.391249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:59.391249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:59.391249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:59.391249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:59.391249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:59.391249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:59.391249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:59.391249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:59.392244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:59.392244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:59.392244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:36:59.392244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:36:59.392244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:36:59.392244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:36:59.392244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:36:59.392244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:36:59.392244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:36:59.392244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:36:59.394972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 487/963] 10.222.0.119 () {56 vars in 1122 bytes} [Thu Jul 14 15:36:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:59.401439 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb79f8-fe82-4df9-b919-f12a4132fff5 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:59.417492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:59.472459 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff785696-e68d-42a5-939f-4a44660820a6 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:59.513221 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a14e7f-6a4b-4964-87e0-ceda14381cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:59.513400 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb79f8-fe82-4df9-b919-f12a4132fff5 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:59.513937 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a14e7f-6a4b-4964-87e0-ceda14381cd0 None admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:59.514275 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a14e7f-6a4b-4964-87e0-ceda14381cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:59.514592 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a14e7f-6a4b-4964-87e0-ceda14381cd0 None admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:59.515361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a14e7f-6a4b-4964-87e0-ceda14381cd0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:59.517093 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a14e7f-6a4b-4964-87e0-ceda14381cd0 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:59.518163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: WARNING keystone.server.flask.common [None req-d9a14e7f-6a4b-4964-87e0-ceda14381cd0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 14 15:36:59.548528 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba5d33-00c9-4faa-a7c9-2f1d030649af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:59.549258 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba5d33-00c9-4faa-a7c9-2f1d030649af None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:59.557600 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba5d33-00c9-4faa-a7c9-2f1d030649af None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:59.557600 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba5d33-00c9-4faa-a7c9-2f1d030649af None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:59.557600 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba5d33-00c9-4faa-a7c9-2f1d030649af None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:36:59.557600 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba5d33-00c9-4faa-a7c9-2f1d030649af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:59.557600 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba5d33-00c9-4faa-a7c9-2f1d030649af None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:59.571404 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 488/964] 10.222.0.119 () {56 vars in 1154 bytes} [Thu Jul 14 15:36:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:36:59.573487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecef781-7839-465f-8dd8-544ed28f860a None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:59.573782 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecef781-7839-465f-8dd8-544ed28f860a None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:59.574124 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecef781-7839-465f-8dd8-544ed28f860a None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:59.575618 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 489/965] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:36:59 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:36:59.576273 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.sql.core [None req-d9a14e7f-6a4b-4964-87e0-ceda14381cd0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 15:36:59.576273 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 15:36:59.576273 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [parameters: {'user_id': 'c35eea8d23074ffdb2fddb86ad37374e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 15:36:59.576273 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86979) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 15:36:59.577625 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecef781-7839-465f-8dd8-544ed28f860a None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:59.597517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-d9a14e7f-6a4b-4964-87e0-ceda14381cd0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 15:36:59.597517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:59.597517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 15:36:59.597517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 15:36:59.597517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 15:36:59.597517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 15:36:59.597517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 15:36:59.597517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 15:36:59.597517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 15:36:59.597517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application conn.query(q) Jul 14 15:36:59.597517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 15:36:59.597517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 15:36:59.597517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 15:36:59.597517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application result.read() Jul 14 15:36:59.597517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 15:36:59.602174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 15:36:59.602174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 15:36:59.602174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 15:36:59.602174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 15:36:59.602174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 15:36:59.602174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 15:36:59.602174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 15:36:59.602174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 15:36:59.602174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:59.602174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 15:36:59.602174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:59.602174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:59.602174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 15:36:59.602174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 15:36:59.602174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 14 15:36:59.602174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 14 15:36:59.602174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 15:36:59.602174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application next(self.gen) Jul 14 15:36:59.603314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 15:36:59.603314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application yield resource Jul 14 15:36:59.603314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 15:36:59.603314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application next(self.gen) Jul 14 15:36:59.603314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 15:36:59.603314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 15:36:59.603314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 15:36:59.603314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 15:36:59.603314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 15:36:59.603314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise self.value Jul 14 15:36:59.603314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 15:36:59.603314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 15:36:59.603314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 15:36:59.603314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application session.commit() Jul 14 15:36:59.603314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 15:36:59.603314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 15:36:59.603314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 15:36:59.604291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 15:36:59.604291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 15:36:59.604291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self.session.flush() Jul 14 15:36:59.604291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 15:36:59.604291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 15:36:59.604291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 15:36:59.604291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 15:36:59.604291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 15:36:59.604291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application compat.raise_( Jul 14 15:36:59.604291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 15:36:59.604291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception Jul 14 15:36:59.604291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 15:36:59.604291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 15:36:59.604291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 15:36:59.604291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 15:36:59.604291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 15:36:59.604291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 15:36:59.606791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 15:36:59.606791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 15:36:59.606791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 14 15:36:59.606791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 14 15:36:59.606791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 15:36:59.606791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 15:36:59.606791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 15:36:59.606791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 15:36:59.606791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 15:36:59.606791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 15:36:59.606791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 15:36:59.606791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 15:36:59.606791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 15:36:59.606791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 15:36:59.606791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 15:36:59.606791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception Jul 14 15:36:59.608085 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 15:36:59.608085 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 15:36:59.608085 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 15:36:59.608085 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 15:36:59.608085 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 15:36:59.608085 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 15:36:59.608085 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 15:36:59.608085 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application conn.query(q) Jul 14 15:36:59.608085 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 15:36:59.608085 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 15:36:59.608085 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 15:36:59.608085 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application result.read() Jul 14 15:36:59.608085 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 15:36:59.608085 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 15:36:59.608085 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 15:36:59.608085 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 15:36:59.610250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 15:36:59.610250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 15:36:59.610250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 15:36:59.610250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 15:36:59.610250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 15:36:59.610250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 15:36:59.610250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c35eea8d23074ffdb2fddb86ad37374e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 15:36:59.610250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 15:36:59.610250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:59.610250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:36:59.610250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:59.610250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:59.610250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:59.610250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:59.610250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:59.611675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:59.611675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:59.611675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:59.611675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:59.611675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:59.611675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:59.611675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:59.611675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 14 15:36:59.611675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 14 15:36:59.611675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:59.611675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:59.611675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:59.611675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:59.611675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:59.611675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:59.611675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 14 15:36:59.611675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 14 15:36:59.613369 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 14 15:36:59.613369 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 14 15:36:59.613369 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 15:36:59.613369 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 15:36:59.613369 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 15:36:59.613369 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:59.613369 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 477/966] 10.222.0.119 () {60 vars in 1136 bytes} [Thu Jul 14 15:36:59 2022] POST /identity/v3/users => generated 160 bytes in 251 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:59.613369 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead21d44-1081-482c-b91b-84d1afd4be24 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:59.613369 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead21d44-1081-482c-b91b-84d1afd4be24 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:59.613369 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead21d44-1081-482c-b91b-84d1afd4be24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:59.616952 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:59.626853 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-ead21d44-1081-482c-b91b-84d1afd4be24 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:59.628576 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-ead21d44-1081-482c-b91b-84d1afd4be24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:59.703273 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecef781-7839-465f-8dd8-544ed28f860a None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:59.706945 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 478/967] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:36:59 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:36:59.708043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead21d44-1081-482c-b91b-84d1afd4be24 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:59.743480 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95670255-96b0-4ded-892f-7f263326049e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:59.744267 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95670255-96b0-4ded-892f-7f263326049e None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:59.744660 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95670255-96b0-4ded-892f-7f263326049e None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:59.745024 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95670255-96b0-4ded-892f-7f263326049e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:59.761791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:59.821460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95670255-96b0-4ded-892f-7f263326049e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:59.822918 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95670255-96b0-4ded-892f-7f263326049e None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:59.823035 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead21d44-1081-482c-b91b-84d1afd4be24 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:59.848857 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:59.858590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c109f-fbce-45ec-98fd-29c98ac5d70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:59.859445 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c109f-fbce-45ec-98fd-29c98ac5d70b None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:59.860355 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c109f-fbce-45ec-98fd-29c98ac5d70b None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:59.860355 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c109f-fbce-45ec-98fd-29c98ac5d70b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:59.867980 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c109f-fbce-45ec-98fd-29c98ac5d70b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:59.869712 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c109f-fbce-45ec-98fd-29c98ac5d70b None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:59.887737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-127c109f-fbce-45ec-98fd-29c98ac5d70b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 15:36:59.887737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:36:59.887737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:36:59.887737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:36:59.887737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:36:59.887737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:36:59.887737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:36:59.887737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:36:59.887737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:36:59.887737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:36:59.887737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:36:59.887737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:36:59.887737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:36:59.887737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:36:59.887737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:36:59.887737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:36:59.889024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:36:59.889024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:36:59.889024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:36:59.889024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:59.889024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:36:59.889024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:36:59.889024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:36:59.889024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:36:59.889024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:36:59.889024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:36:59.889024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:36:59.889024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:36:59.889024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:36:59.889024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:36:59.889024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:36:59.889024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:36:59.889024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:36:59.889024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:36:59.891490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:36:59.891490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:36:59.891490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:36:59.891490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:36:59.891490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:36:59.891490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:36:59.891490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:36:59.891490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:36:59.891490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 15:36:59.891490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:36:59.891490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 479/968] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:36:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:36:59.891490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c109f-fbce-45ec-98fd-29c98ac5d70b None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:59.947475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 490/969] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:36:59 2022] GET /identity/v3/auth/tokens => generated 1466 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:36:59.948792 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95670255-96b0-4ded-892f-7f263326049e None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:00.001505 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c109f-fbce-45ec-98fd-29c98ac5d70b None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:00.003731 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:00.041053 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a814ca-f6af-4108-b080-92ed13d6e94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:00.041899 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a814ca-f6af-4108-b080-92ed13d6e94b None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:00.042187 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a814ca-f6af-4108-b080-92ed13d6e94b None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:00.042468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a814ca-f6af-4108-b080-92ed13d6e94b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:00.043124 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a814ca-f6af-4108-b080-92ed13d6e94b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:00.044543 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a814ca-f6af-4108-b080-92ed13d6e94b None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:00.056849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-c6a814ca-f6af-4108-b080-92ed13d6e94b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:37:00.056849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:00.056849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:37:00.056849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:37:00.056849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:37:00.056849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:37:00.056849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:37:00.056849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:37:00.056849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:37:00.056849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:00.056849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:37:00.056849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:00.056849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:00.056849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:00.056849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:00.056849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:00.056849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:00.057869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:00.057869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:00.057869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:00.057869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:00.057869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:00.057869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:00.057869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:37:00.057869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:37:00.057869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:37:00.057869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:37:00.057869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:00.057869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:00.057869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:00.057869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:00.057869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:00.057869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:00.058701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:00.058701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:00.058701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:00.058701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:00.058701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:00.058701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:00.058701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:00.058701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:00.058701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:00.058701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:00.058701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:37:00.058701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:37:00.058701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:37:00.058701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:00.058701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 480/970] 10.222.0.119 () {56 vars in 1131 bytes} [Thu Jul 14 15:36:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:37:00.059489 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a814ca-f6af-4108-b080-92ed13d6e94b None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:00.070636 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95670255-96b0-4ded-892f-7f263326049e None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:00.097204 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:00.108396 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74af12-9ce8-40d8-8cc5-d3a0b154612e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:00.109079 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74af12-9ce8-40d8-8cc5-d3a0b154612e None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:00.109366 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74af12-9ce8-40d8-8cc5-d3a0b154612e None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:00.109645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74af12-9ce8-40d8-8cc5-d3a0b154612e None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:00.110459 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74af12-9ce8-40d8-8cc5-d3a0b154612e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:00.111890 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74af12-9ce8-40d8-8cc5-d3a0b154612e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:00.112209 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74af12-9ce8-40d8-8cc5-d3a0b154612e None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:00.147544 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 491/971] 10.222.0.119 () {56 vars in 1106 bytes} [Thu Jul 14 15:36:59 2022] GET /identity/v3/users?name=cinder => generated 356 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:00.149139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74af12-9ce8-40d8-8cc5-d3a0b154612e None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:00.186573 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a814ca-f6af-4108-b080-92ed13d6e94b None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:00.227590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf263779-e846-4a0b-90d9-5bf4e75d4101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:00.228453 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf263779-e846-4a0b-90d9-5bf4e75d4101 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:00.228734 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf263779-e846-4a0b-90d9-5bf4e75d4101 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:00.229013 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf263779-e846-4a0b-90d9-5bf4e75d4101 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:00.245145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf263779-e846-4a0b-90d9-5bf4e75d4101 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:00.246675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf263779-e846-4a0b-90d9-5bf4e75d4101 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:00.275857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-bf263779-e846-4a0b-90d9-5bf4e75d4101 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:37:00.275857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:00.275857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:00.275857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:00.275857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:00.275857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:00.275857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:00.275857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:00.275857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:00.275857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:00.275857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:00.275857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:00.275857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:37:00.275857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:37:00.275857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:37:00.277019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:37:00.277019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:00.277019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:00.277019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:00.277019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:00.277019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:00.277019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:00.277019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:00.277019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:00.277019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:00.277019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:00.277019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:00.277019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:00.277019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:00.277019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:00.277019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:00.277019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:00.277926 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:37:00.277926 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:37:00.277926 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:37:00.277926 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:00.278149 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74af12-9ce8-40d8-8cc5-d3a0b154612e None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:00.280518 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 481/972] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:37:00.281714 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230c5bf-1dfc-4e04-ba37-c8e345b27098 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:00.281998 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230c5bf-1dfc-4e04-ba37-c8e345b27098 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:00.282277 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230c5bf-1dfc-4e04-ba37-c8e345b27098 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:00.286453 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 482/973] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:00 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:00.287250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230c5bf-1dfc-4e04-ba37-c8e345b27098 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:00.316853 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:00.322325 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b89d1-5f51-46bf-bce1-9648fd484e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:00.323012 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b89d1-5f51-46bf-bce1-9648fd484e64 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:00.323299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b89d1-5f51-46bf-bce1-9648fd484e64 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:00.323579 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b89d1-5f51-46bf-bce1-9648fd484e64 None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:00.324336 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b89d1-5f51-46bf-bce1-9648fd484e64 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:00.325648 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b89d1-5f51-46bf-bce1-9648fd484e64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:00.333089 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b89d1-5f51-46bf-bce1-9648fd484e64 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:00.333089 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 492/974] 10.222.0.119 () {56 vars in 1127 bytes} [Thu Jul 14 15:37:00 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:00.333480 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443e164-6d56-487d-840c-0829908416ef None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:00.333732 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443e164-6d56-487d-840c-0829908416ef None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:00.333991 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443e164-6d56-487d-840c-0829908416ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:00.352428 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-3443e164-6d56-487d-840c-0829908416ef None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:00.353644 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-3443e164-6d56-487d-840c-0829908416ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:00.407303 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:00.424424 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230c5bf-1dfc-4e04-ba37-c8e345b27098 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:00.435237 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 493/975] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:00 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:37:00.435895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443e164-6d56-487d-840c-0829908416ef None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:00.462811 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3bd79-99c5-4666-8c2b-a219e0fa444b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:00.463479 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3bd79-99c5-4666-8c2b-a219e0fa444b None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:00.463764 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3bd79-99c5-4666-8c2b-a219e0fa444b None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:00.464043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3bd79-99c5-4666-8c2b-a219e0fa444b None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:00.464795 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3bd79-99c5-4666-8c2b-a219e0fa444b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:00.465103 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3bd79-99c5-4666-8c2b-a219e0fa444b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:00.466460 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3bd79-99c5-4666-8c2b-a219e0fa444b None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:00.479079 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 483/976] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:37:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:00.479872 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3bd79-99c5-4666-8c2b-a219e0fa444b None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:00.546914 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443e164-6d56-487d-840c-0829908416ef None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:00.561218 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:00.580741 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3bd79-99c5-4666-8c2b-a219e0fa444b None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:00.582275 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659181c-b8c7-4524-9ddb-47c3ebde30bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:00.582957 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659181c-b8c7-4524-9ddb-47c3ebde30bc None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:00.583240 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659181c-b8c7-4524-9ddb-47c3ebde30bc None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:00.583528 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659181c-b8c7-4524-9ddb-47c3ebde30bc None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:00.584272 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659181c-b8c7-4524-9ddb-47c3ebde30bc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:00.584587 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659181c-b8c7-4524-9ddb-47c3ebde30bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:00.586095 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659181c-b8c7-4524-9ddb-47c3ebde30bc None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:00.590969 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 494/977] 10.222.0.119 () {56 vars in 1127 bytes} [Thu Jul 14 15:37:00 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:00.591803 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659181c-b8c7-4524-9ddb-47c3ebde30bc None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:00.621569 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e01a2a-d541-419f-84d3-7464f4f6c730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:00.622254 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e01a2a-d541-419f-84d3-7464f4f6c730 None admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:00.622546 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e01a2a-d541-419f-84d3-7464f4f6c730 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:00.622827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e01a2a-d541-419f-84d3-7464f4f6c730 None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:00.623557 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e01a2a-d541-419f-84d3-7464f4f6c730 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:00.624970 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e01a2a-d541-419f-84d3-7464f4f6c730 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:00.639246 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:00.697434 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 484/978] 10.222.0.119 () {60 vars in 1146 bytes} [Thu Jul 14 15:37:00 2022] POST /identity/v3/services => generated 243 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:00.698262 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e01a2a-d541-419f-84d3-7464f4f6c730 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:00.702453 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659181c-b8c7-4524-9ddb-47c3ebde30bc None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:00.753158 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4aa5b-8a40-4b2a-b2d0-779d59cc535e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:00.753999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4aa5b-8a40-4b2a-b2d0-779d59cc535e None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:00.754288 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4aa5b-8a40-4b2a-b2d0-779d59cc535e None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:00.754692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4aa5b-8a40-4b2a-b2d0-779d59cc535e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:00.763114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4aa5b-8a40-4b2a-b2d0-779d59cc535e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:00.764656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4aa5b-8a40-4b2a-b2d0-779d59cc535e None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:00.780677 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-a5f4aa5b-8a40-4b2a-b2d0-779d59cc535e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:37:00.780677 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:00.780677 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:00.780677 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:00.780677 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:00.780677 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:00.780677 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:00.780677 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:00.780677 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:00.780677 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:00.780677 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:00.780677 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:00.780677 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:37:00.780677 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:37:00.780677 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:37:00.781646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:37:00.781646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:00.781646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:00.781646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:00.781646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:00.781646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:00.781646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:00.781646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:00.781646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:00.781646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:00.781646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:00.781646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:00.781646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:00.781646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:00.781646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:00.781646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:00.781646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:00.782536 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:37:00.782536 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:37:00.782536 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:37:00.782536 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:37:00.782536 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:37:00.782536 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:37:00.782536 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:37:00.782536 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:37:00.782536 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 495/979] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:37:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:37:00.789410 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4aa5b-8a40-4b2a-b2d0-779d59cc535e None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:00.817238 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e01a2a-d541-419f-84d3-7464f4f6c730 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:00.857186 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52909b-82e4-42a0-9d00-ea8f53ba9d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:00.857861 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52909b-82e4-42a0-9d00-ea8f53ba9d65 None admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:00.858149 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52909b-82e4-42a0-9d00-ea8f53ba9d65 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:00.858433 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52909b-82e4-42a0-9d00-ea8f53ba9d65 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:00.859188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52909b-82e4-42a0-9d00-ea8f53ba9d65 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:00.860619 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52909b-82e4-42a0-9d00-ea8f53ba9d65 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:00.870422 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:00.900892 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:00.906723 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4aa5b-8a40-4b2a-b2d0-779d59cc535e None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:00.940110 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77557424-a302-4369-8a56-e2eb4e0f73bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:00.940806 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77557424-a302-4369-8a56-e2eb4e0f73bc None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:00.941105 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77557424-a302-4369-8a56-e2eb4e0f73bc None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:00.941370 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77557424-a302-4369-8a56-e2eb4e0f73bc None admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:00.942161 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77557424-a302-4369-8a56-e2eb4e0f73bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:00.942500 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77557424-a302-4369-8a56-e2eb4e0f73bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:00.943928 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77557424-a302-4369-8a56-e2eb4e0f73bc None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:00.956067 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 496/980] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:37:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:00.962634 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77557424-a302-4369-8a56-e2eb4e0f73bc None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:01.008239 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 485/981] 10.222.0.119 () {60 vars in 1149 bytes} [Thu Jul 14 15:37:00 2022] POST /identity/v3/endpoints => generated 351 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:01.084376 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77557424-a302-4369-8a56-e2eb4e0f73bc None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:01.130030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e717c90-4832-496e-945d-e532cd89c04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:01.130703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e717c90-4832-496e-945d-e532cd89c04f None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:01.130984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e717c90-4832-496e-945d-e532cd89c04f None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:01.131256 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e717c90-4832-496e-945d-e532cd89c04f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:01.132283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e717c90-4832-496e-945d-e532cd89c04f None admin] RBAC: Adding query filter params (role.id=d9b93606a9bb4ff7a13f81af237b9009, scope.project.id=07652ced88cf4f069d1765176be5130b, user.id=4a1474b39e0b477daff5833491cd6df5) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:01.132600 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e717c90-4832-496e-945d-e532cd89c04f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:01.134182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e717c90-4832-496e-945d-e532cd89c04f None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:01.141043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 497/982] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:37:00 2022] GET /identity/v3/role_assignments?user.id=4a1474b39e0b477daff5833491cd6df5&scope.project.id=07652ced88cf4f069d1765176be5130b&role.id=d9b93606a9bb4ff7a13f81af237b9009 => generated 610 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:37:02.813798 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068f5ed-a22a-4c70-9af1-0d7541e07124 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:02.814292 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068f5ed-a22a-4c70-9af1-0d7541e07124 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:02.814292 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068f5ed-a22a-4c70-9af1-0d7541e07124 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:02.815781 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 486/983] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:02.821741 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d154f58-1691-4dfe-850c-d8172478ad9b None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:02.822409 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d154f58-1691-4dfe-850c-d8172478ad9b None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:02.822409 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d154f58-1691-4dfe-850c-d8172478ad9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:02.839474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-6d154f58-1691-4dfe-850c-d8172478ad9b None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:02.840695 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-6d154f58-1691-4dfe-850c-d8172478ad9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:02.852579 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:02.910172 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 498/984] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:02 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:37:02.933256 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068f5ed-a22a-4c70-9af1-0d7541e07124 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:03.037211 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068f5ed-a22a-4c70-9af1-0d7541e07124 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:03.071010 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f811287-1b77-4619-9ccb-011d64ac2a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:03.071729 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f811287-1b77-4619-9ccb-011d64ac2a06 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:03.072012 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f811287-1b77-4619-9ccb-011d64ac2a06 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:03.072316 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f811287-1b77-4619-9ccb-011d64ac2a06 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:03.072964 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f811287-1b77-4619-9ccb-011d64ac2a06 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:03.074324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f811287-1b77-4619-9ccb-011d64ac2a06 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:03.086886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-4f811287-1b77-4619-9ccb-011d64ac2a06 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 15:37:03.086886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:03.086886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:37:03.086886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:37:03.086886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:37:03.086886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:37:03.086886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:37:03.086886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:37:03.086886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 15:37:03.086886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:03.086886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:37:03.086886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:03.086886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:03.086886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:03.086886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:03.086886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:03.086886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:03.087886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:03.087886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:03.087886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:03.087886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:03.087886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:03.087886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:03.087886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:37:03.087886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:37:03.087886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:37:03.087886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:37:03.087886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:03.087886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:03.087886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:03.087886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:03.087886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:03.087886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:03.094394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:03.094394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:03.094394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:03.094394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:03.094394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:03.094394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:03.094394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:03.094394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:03.094394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:03.094394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:03.094394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:37:03.094394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:37:03.094394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 15:37:03.094394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:03.094394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 487/985] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:37:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:37:03.096871 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d154f58-1691-4dfe-850c-d8172478ad9b None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:03.140144 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b51539-335b-42e7-b5e4-9883048888c1 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:03.140549 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b51539-335b-42e7-b5e4-9883048888c1 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:03.140803 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b51539-335b-42e7-b5e4-9883048888c1 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:03.144290 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 488/986] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:37:03.147485 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0e785-cae6-4340-be12-522196c7b7e6 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:03.148552 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0e785-cae6-4340-be12-522196c7b7e6 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:03.148897 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0e785-cae6-4340-be12-522196c7b7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:03.166483 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-e1a0e785-cae6-4340-be12-522196c7b7e6 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:03.167772 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-e1a0e785-cae6-4340-be12-522196c7b7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:03.202429 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d154f58-1691-4dfe-850c-d8172478ad9b None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:03.228584 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:03.239160 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 489/987] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:03 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:37:03.239781 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff832823-e452-4cb7-b3bc-fd7da6490a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:03.240434 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63a557-186f-494b-9d50-1f111459c299 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:03.240640 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff832823-e452-4cb7-b3bc-fd7da6490a7e None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:03.240755 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63a557-186f-494b-9d50-1f111459c299 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:03.240928 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff832823-e452-4cb7-b3bc-fd7da6490a7e None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:03.241031 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63a557-186f-494b-9d50-1f111459c299 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:03.241209 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff832823-e452-4cb7-b3bc-fd7da6490a7e None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:03.242453 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff832823-e452-4cb7-b3bc-fd7da6490a7e None admin] RBAC: Adding query filter params (name=compute) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:03.242951 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 490/988] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:03.243054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff832823-e452-4cb7-b3bc-fd7da6490a7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:03.244250 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff832823-e452-4cb7-b3bc-fd7da6490a7e None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:03.247941 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34680d42-3a6f-4b42-b2c6-5569df9b9969 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:03.248264 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34680d42-3a6f-4b42-b2c6-5569df9b9969 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:03.248549 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34680d42-3a6f-4b42-b2c6-5569df9b9969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:03.255670 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 499/989] 10.222.0.119 () {56 vars in 1117 bytes} [Thu Jul 14 15:37:03 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:03.256700 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff832823-e452-4cb7-b3bc-fd7da6490a7e None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:03.266093 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-34680d42-3a6f-4b42-b2c6-5569df9b9969 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:03.267275 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-34680d42-3a6f-4b42-b2c6-5569df9b9969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:03.269507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:03.334485 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 491/990] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:03 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:37:03.335571 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34680d42-3a6f-4b42-b2c6-5569df9b9969 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:03.362218 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff832823-e452-4cb7-b3bc-fd7da6490a7e None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:03.397305 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44cf7d-8bfe-4f1f-ad9c-ac47aa5d4ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:03.398468 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44cf7d-8bfe-4f1f-ad9c-ac47aa5d4ffc None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:03.398757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44cf7d-8bfe-4f1f-ad9c-ac47aa5d4ffc None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:03.399049 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44cf7d-8bfe-4f1f-ad9c-ac47aa5d4ffc None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:03.399767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44cf7d-8bfe-4f1f-ad9c-ac47aa5d4ffc None admin] RBAC: Adding query filter params (type=compute) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:03.400180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44cf7d-8bfe-4f1f-ad9c-ac47aa5d4ffc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:03.401493 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44cf7d-8bfe-4f1f-ad9c-ac47aa5d4ffc None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:03.406376 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 500/991] 10.222.0.119 () {56 vars in 1117 bytes} [Thu Jul 14 15:37:03 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:03.407154 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44cf7d-8bfe-4f1f-ad9c-ac47aa5d4ffc None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:03.436892 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34680d42-3a6f-4b42-b2c6-5569df9b9969 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:03.457052 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:03.471913 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2c21e-a650-41dc-afe1-7041e6ed2fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:03.472750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2c21e-a650-41dc-afe1-7041e6ed2fad None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:03.473038 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2c21e-a650-41dc-afe1-7041e6ed2fad None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:03.473321 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2c21e-a650-41dc-afe1-7041e6ed2fad None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:03.473970 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2c21e-a650-41dc-afe1-7041e6ed2fad None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:03.475334 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2c21e-a650-41dc-afe1-7041e6ed2fad None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:03.483451 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:03.487761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-6cf2c21e-a650-41dc-afe1-7041e6ed2fad None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:37:03.487761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:03.487761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:37:03.487761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:37:03.487761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:37:03.487761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:37:03.487761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:37:03.487761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:37:03.487761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:37:03.487761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:03.487761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:37:03.487761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:03.487761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:03.487761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:03.487761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:03.487761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:03.487761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:03.494852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:03.494852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:03.494852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:03.494852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:03.494852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:03.494852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:03.494852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:37:03.494852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:37:03.494852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:37:03.494852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:37:03.494852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:03.494852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:03.494852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:03.494852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:03.494852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:03.494852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:03.498888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:03.498888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:03.498888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:03.498888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:03.498888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:03.498888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:03.498888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:03.498888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:03.498888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:03.498888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:03.498888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:37:03.498888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:37:03.498888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:37:03.498888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:03.498888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 492/992] 10.222.0.119 () {56 vars in 1131 bytes} [Thu Jul 14 15:37:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:37:03.499689 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2c21e-a650-41dc-afe1-7041e6ed2fad None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:03.509929 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44cf7d-8bfe-4f1f-ad9c-ac47aa5d4ffc None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:03.546267 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c56039-a352-44d6-beb6-de1431552047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:03.547089 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c56039-a352-44d6-beb6-de1431552047 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:03.547383 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c56039-a352-44d6-beb6-de1431552047 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:03.547666 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c56039-a352-44d6-beb6-de1431552047 None admin] PATH_INFO: `/v3/services/image` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:03.548358 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c56039-a352-44d6-beb6-de1431552047 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:03.549744 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c56039-a352-44d6-beb6-de1431552047 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:03.562507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-e2c56039-a352-44d6-beb6-de1431552047 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 15:37:03.562507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:03.562507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:37:03.562507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:37:03.562507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:37:03.562507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:37:03.562507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:37:03.562507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:37:03.562507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 15:37:03.562507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:37:03.562507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:37:03.562507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:37:03.562507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:03.562507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:03.562507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:03.562507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:03.562507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:03.563489 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:03.563489 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:03.563489 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:03.563489 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:03.563489 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:03.563489 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:03.563489 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:37:03.563489 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:37:03.563489 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:37:03.563489 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:37:03.563489 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:03.563489 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:03.563489 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:03.563489 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:03.563489 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:03.563489 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:03.564984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:03.564984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:03.564984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:03.564984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:03.564984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:03.564984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:03.564984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:03.564984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:03.564984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:03.564984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:03.564984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:37:03.564984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:37:03.564984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 15:37:03.564984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:37:03.564984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 501/993] 10.222.0.119 () {56 vars in 1110 bytes} [Thu Jul 14 15:37:03 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:37:03.565960 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c56039-a352-44d6-beb6-de1431552047 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:03.592532 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2c21e-a650-41dc-afe1-7041e6ed2fad None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:03.626660 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbccbe5-0234-4561-a6ca-6255eb093c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:03.627327 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbccbe5-0234-4561-a6ca-6255eb093c4a None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:03.627612 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbccbe5-0234-4561-a6ca-6255eb093c4a None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:03.627893 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbccbe5-0234-4561-a6ca-6255eb093c4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:03.628860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbccbe5-0234-4561-a6ca-6255eb093c4a None admin] RBAC: Adding query filter params (interface=public, service_id=ad390e01a90540e28bc15d440f3d7191, region_id=RegionOne) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:03.629175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbccbe5-0234-4561-a6ca-6255eb093c4a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:03.630538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbccbe5-0234-4561-a6ca-6255eb093c4a None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:03.635838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 493/994] 10.222.0.119 () {56 vars in 1256 bytes} [Thu Jul 14 15:37:03 2022] GET /identity/v3/endpoints?service_id=ad390e01a90540e28bc15d440f3d7191&interface=public®ion_id=RegionOne => generated 195 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:03.636658 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbccbe5-0234-4561-a6ca-6255eb093c4a None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:03.669207 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c56039-a352-44d6-beb6-de1431552047 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:03.686381 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:03.703764 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe9bee-b9c5-4155-8f78-1d0e195e4a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:03.704466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe9bee-b9c5-4155-8f78-1d0e195e4a69 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:03.704758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe9bee-b9c5-4155-8f78-1d0e195e4a69 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:03.705044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe9bee-b9c5-4155-8f78-1d0e195e4a69 None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:03.705757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe9bee-b9c5-4155-8f78-1d0e195e4a69 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:03.706070 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe9bee-b9c5-4155-8f78-1d0e195e4a69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:03.707454 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe9bee-b9c5-4155-8f78-1d0e195e4a69 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:03.713360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 502/995] 10.222.0.119 () {56 vars in 1127 bytes} [Thu Jul 14 15:37:03 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:03.713918 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe9bee-b9c5-4155-8f78-1d0e195e4a69 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:03.716615 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:03.738468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbccbe5-0234-4561-a6ca-6255eb093c4a None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:03.772714 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a60bd3-5669-4e4c-a607-c8f2442ac3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:03.773833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a60bd3-5669-4e4c-a607-c8f2442ac3b7 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:03.774333 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a60bd3-5669-4e4c-a607-c8f2442ac3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:03.774837 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a60bd3-5669-4e4c-a607-c8f2442ac3b7 None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:03.776172 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a60bd3-5669-4e4c-a607-c8f2442ac3b7 None admin] RBAC: Adding query filter params (name=image) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:03.776732 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a60bd3-5669-4e4c-a607-c8f2442ac3b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:03.778545 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a60bd3-5669-4e4c-a607-c8f2442ac3b7 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:03.784083 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 494/996] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:37:03 2022] GET /identity/v3/services?name=image => generated 123 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:03.785160 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a60bd3-5669-4e4c-a607-c8f2442ac3b7 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:03.825670 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe9bee-b9c5-4155-8f78-1d0e195e4a69 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:03.860331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d63ad-e20e-438a-94dc-8ea41f13e8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:03.860932 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d63ad-e20e-438a-94dc-8ea41f13e8bf None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:03.861207 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d63ad-e20e-438a-94dc-8ea41f13e8bf None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:03.861481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d63ad-e20e-438a-94dc-8ea41f13e8bf None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:03.862159 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d63ad-e20e-438a-94dc-8ea41f13e8bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:03.863696 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d63ad-e20e-438a-94dc-8ea41f13e8bf None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:03.870573 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 503/997] 10.222.0.119 () {56 vars in 1092 bytes} [Thu Jul 14 15:37:03 2022] GET /identity/v3/services => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:03.871486 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d63ad-e20e-438a-94dc-8ea41f13e8bf None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:03.907545 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a60bd3-5669-4e4c-a607-c8f2442ac3b7 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:03.923375 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:03.946844 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce0b50-d5c4-459f-b27b-27a3d391505f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:03.947696 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce0b50-d5c4-459f-b27b-27a3d391505f None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:03.948052 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce0b50-d5c4-459f-b27b-27a3d391505f None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:03.948456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce0b50-d5c4-459f-b27b-27a3d391505f None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:03.948897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:03.949376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce0b50-d5c4-459f-b27b-27a3d391505f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:03.949703 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce0b50-d5c4-459f-b27b-27a3d391505f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:03.951112 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce0b50-d5c4-459f-b27b-27a3d391505f None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:03.962810 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 495/998] 10.222.0.119 () {56 vars in 1127 bytes} [Thu Jul 14 15:37:03 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:03.965084 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce0b50-d5c4-459f-b27b-27a3d391505f None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:03.992159 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d63ad-e20e-438a-94dc-8ea41f13e8bf None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:04.032411 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6349a01-109c-4006-905f-1c3030d574b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:04.033192 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6349a01-109c-4006-905f-1c3030d574b9 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:04.033479 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6349a01-109c-4006-905f-1c3030d574b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:04.033853 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6349a01-109c-4006-905f-1c3030d574b9 None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:04.034565 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6349a01-109c-4006-905f-1c3030d574b9 None admin] RBAC: Adding query filter params (type=image) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:04.034874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6349a01-109c-4006-905f-1c3030d574b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:04.036271 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6349a01-109c-4006-905f-1c3030d574b9 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:04.043449 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 504/999] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:37:03 2022] GET /identity/v3/services?type=image => generated 123 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:04.098644 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce0b50-d5c4-459f-b27b-27a3d391505f None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:04.150929 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222f62e-0582-4bfc-bd0b-30737c0790f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:04.151974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222f62e-0582-4bfc-bd0b-30737c0790f5 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:04.152516 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222f62e-0582-4bfc-bd0b-30737c0790f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:04.152995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222f62e-0582-4bfc-bd0b-30737c0790f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:04.154057 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222f62e-0582-4bfc-bd0b-30737c0790f5 None admin] RBAC: Adding query filter params (interface=admin, service_id=7c02495ffe0140a7a0bf3705a647a425, region_id=RegionOne) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:04.154581 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222f62e-0582-4bfc-bd0b-30737c0790f5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:04.156205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222f62e-0582-4bfc-bd0b-30737c0790f5 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:04.162350 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 496/1000] 10.222.0.119 () {56 vars in 1254 bytes} [Thu Jul 14 15:37:03 2022] GET /identity/v3/endpoints?service_id=7c02495ffe0140a7a0bf3705a647a425&interface=admin®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:04.168601 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6349a01-109c-4006-905f-1c3030d574b9 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:04.278705 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6349a01-109c-4006-905f-1c3030d574b9 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:04.308453 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:04.314916 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c619c76-36a8-4dd9-ab4a-649e3ba1348c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:04.315669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c619c76-36a8-4dd9-ab4a-649e3ba1348c None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:04.315959 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c619c76-36a8-4dd9-ab4a-649e3ba1348c None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:04.316269 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c619c76-36a8-4dd9-ab4a-649e3ba1348c None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:04.317080 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c619c76-36a8-4dd9-ab4a-649e3ba1348c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:04.318473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c619c76-36a8-4dd9-ab4a-649e3ba1348c None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:04.332126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 505/1001] 10.222.0.119 () {56 vars in 1092 bytes} [Thu Jul 14 15:37:04 2022] GET /identity/v3/services => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:06.015255 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9519172-a87b-406b-836a-bb915b367b48 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:06.015781 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9519172-a87b-406b-836a-bb915b367b48 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:06.015863 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9519172-a87b-406b-836a-bb915b367b48 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:06.017264 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 497/1002] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:06.022377 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82969b57-1a40-4d1f-b57c-94dcfbebb20c None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:06.022806 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82969b57-1a40-4d1f-b57c-94dcfbebb20c None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:06.023482 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82969b57-1a40-4d1f-b57c-94dcfbebb20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:06.041539 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-82969b57-1a40-4d1f-b57c-94dcfbebb20c None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:06.042748 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-82969b57-1a40-4d1f-b57c-94dcfbebb20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:06.115623 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 506/1003] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:06 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:37:06.120560 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628717c-077a-45f9-8923-cd0552fd38e2 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:06.120860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628717c-077a-45f9-8923-cd0552fd38e2 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:06.121146 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628717c-077a-45f9-8923-cd0552fd38e2 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:06.122638 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 498/1004] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:06.127829 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f93dc-c89d-4508-8ec7-07d309900b47 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:06.128149 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f93dc-c89d-4508-8ec7-07d309900b47 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:06.128484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f93dc-c89d-4508-8ec7-07d309900b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:06.139866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628717c-077a-45f9-8923-cd0552fd38e2 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:06.147604 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-888f93dc-c89d-4508-8ec7-07d309900b47 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:06.149562 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-888f93dc-c89d-4508-8ec7-07d309900b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:06.189303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:06.223120 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 507/1005] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:06 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:37:06.246995 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f93dc-c89d-4508-8ec7-07d309900b47 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:06.255203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628717c-077a-45f9-8923-cd0552fd38e2 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:06.293641 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e590f-087a-4744-b571-d6346211f88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:06.294449 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e590f-087a-4744-b571-d6346211f88e None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:06.294778 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e590f-087a-4744-b571-d6346211f88e None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:06.295064 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e590f-087a-4744-b571-d6346211f88e None admin] PATH_INFO: `/v3/services/compute` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:06.295799 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e590f-087a-4744-b571-d6346211f88e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:06.297225 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e590f-087a-4744-b571-d6346211f88e None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:06.308402 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:06.309216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-855e590f-087a-4744-b571-d6346211f88e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 15:37:06.309216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:06.309216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:37:06.309216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:37:06.309216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:37:06.309216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:37:06.309216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:37:06.309216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:37:06.309216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 15:37:06.309216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:06.309216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:37:06.309216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:06.309216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:06.309216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:06.309216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:06.309216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:06.309216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:06.310268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:06.310268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:06.310268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:06.310268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:06.310268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:06.310268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:06.310268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:37:06.310268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:37:06.310268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:37:06.310268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:37:06.310268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:06.310268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:06.310268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:06.310268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:06.310268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:06.310268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:06.311402 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:06.311402 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:06.311402 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:06.311402 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:06.311402 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:06.311402 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:06.311402 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:06.311402 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:06.311402 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:06.311402 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:06.311402 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:37:06.311402 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:37:06.311402 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 15:37:06.311402 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:06.311402 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 499/1006] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:37:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:37:06.317901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e590f-087a-4744-b571-d6346211f88e None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:06.362130 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f93dc-c89d-4508-8ec7-07d309900b47 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:06.396952 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43725c7-0b0e-4d38-9b12-ffa06caee952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:06.397629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43725c7-0b0e-4d38-9b12-ffa06caee952 None admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:06.398028 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43725c7-0b0e-4d38-9b12-ffa06caee952 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:06.398382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43725c7-0b0e-4d38-9b12-ffa06caee952 None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:06.399115 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43725c7-0b0e-4d38-9b12-ffa06caee952 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:06.400534 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43725c7-0b0e-4d38-9b12-ffa06caee952 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:06.420496 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e590f-087a-4744-b571-d6346211f88e None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:06.422750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:06.456244 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142b344-94fc-47fe-b98a-7ab9918df8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:06.457023 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142b344-94fc-47fe-b98a-7ab9918df8d2 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:06.457425 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142b344-94fc-47fe-b98a-7ab9918df8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:06.457794 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142b344-94fc-47fe-b98a-7ab9918df8d2 None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:06.458621 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142b344-94fc-47fe-b98a-7ab9918df8d2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:06.459022 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142b344-94fc-47fe-b98a-7ab9918df8d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:06.460543 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142b344-94fc-47fe-b98a-7ab9918df8d2 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:06.465608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 500/1007] 10.222.0.119 () {56 vars in 1117 bytes} [Thu Jul 14 15:37:06 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:37:06.466861 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60865763-3999-44b7-b51e-f49db392da90 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:06.468521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60865763-3999-44b7-b51e-f49db392da90 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:06.468820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60865763-3999-44b7-b51e-f49db392da90 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:06.470290 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 501/1008] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:06 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:06.471598 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60865763-3999-44b7-b51e-f49db392da90 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:06.552231 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 508/1009] 10.222.0.119 () {60 vars in 1146 bytes} [Thu Jul 14 15:37:06 2022] POST /identity/v3/services => generated 243 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:37:06.552231 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5867df-ada2-4b25-a56f-134f0b0bfbb6 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:06.552231 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5867df-ada2-4b25-a56f-134f0b0bfbb6 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:06.552231 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5867df-ada2-4b25-a56f-134f0b0bfbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:06.556375 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-4c5867df-ada2-4b25-a56f-134f0b0bfbb6 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:06.557711 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-4c5867df-ada2-4b25-a56f-134f0b0bfbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:06.587334 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60865763-3999-44b7-b51e-f49db392da90 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:06.629480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ce59e-8898-4bdb-a387-ee7281fb2793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:06.630157 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ce59e-8898-4bdb-a387-ee7281fb2793 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:06.630441 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ce59e-8898-4bdb-a387-ee7281fb2793 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:06.630714 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ce59e-8898-4bdb-a387-ee7281fb2793 None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:06.631429 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ce59e-8898-4bdb-a387-ee7281fb2793 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:06.631738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ce59e-8898-4bdb-a387-ee7281fb2793 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:06.633271 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ce59e-8898-4bdb-a387-ee7281fb2793 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:06.637192 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 509/1010] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:06 2022] POST /identity/v3/auth/tokens => generated 1658 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:37:06.650574 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 502/1011] 10.222.0.119 () {56 vars in 1117 bytes} [Thu Jul 14 15:37:06 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:37:06.656561 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5867df-ada2-4b25-a56f-134f0b0bfbb6 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:06.660672 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ce59e-8898-4bdb-a387-ee7281fb2793 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:06.694076 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:06.706266 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:06.767228 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5867df-ada2-4b25-a56f-134f0b0bfbb6 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:06.774333 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ce59e-8898-4bdb-a387-ee7281fb2793 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:06.806513 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e9a69-c7c6-40e7-ba78-ba78a78d8f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:06.807512 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e9a69-c7c6-40e7-ba78-ba78a78d8f26 None admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:06.808059 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e9a69-c7c6-40e7-ba78-ba78a78d8f26 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:06.808439 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e9a69-c7c6-40e7-ba78-ba78a78d8f26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:06.809170 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e9a69-c7c6-40e7-ba78-ba78a78d8f26 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:06.810545 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e9a69-c7c6-40e7-ba78-ba78a78d8f26 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:06.811979 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdd9f4-d902-4cb6-b7c7-b06a62ba1737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:06.812857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdd9f4-d902-4cb6-b7c7-b06a62ba1737 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:06.813149 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdd9f4-d902-4cb6-b7c7-b06a62ba1737 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:06.813430 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdd9f4-d902-4cb6-b7c7-b06a62ba1737 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:06.814087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecdd9f4-d902-4cb6-b7c7-b06a62ba1737 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:06.815558 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecdd9f4-d902-4cb6-b7c7-b06a62ba1737 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:06.828699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-aecdd9f4-d902-4cb6-b7c7-b06a62ba1737 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:37:06.828699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:06.828699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:37:06.828699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:37:06.828699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:37:06.828699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:37:06.828699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:37:06.828699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:37:06.828699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:37:06.828699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:06.828699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:37:06.828699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:06.828699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:06.828699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:06.828699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:06.828699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:06.828699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:06.829909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:06.829909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:06.829909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:06.829909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:06.829909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:06.829909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:06.829909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:37:06.829909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:37:06.829909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:37:06.829909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:37:06.829909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:06.829909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:06.829909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:06.829909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:06.829909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:06.829909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:06.830826 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:06.830826 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:06.830826 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:06.830826 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:06.830826 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:06.830826 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:06.830826 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:06.830826 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:06.830826 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:06.830826 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:06.830826 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:37:06.830826 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:37:06.830826 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:37:06.830826 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:06.830826 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 503/1012] 10.222.0.119 () {56 vars in 1131 bytes} [Thu Jul 14 15:37:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:37:06.836500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdd9f4-d902-4cb6-b7c7-b06a62ba1737 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:06.889533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 510/1013] 10.222.0.119 () {60 vars in 1149 bytes} [Thu Jul 14 15:37:06 2022] POST /identity/v3/endpoints => generated 336 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:06.936536 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:06.946454 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdd9f4-d902-4cb6-b7c7-b06a62ba1737 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:06.994765 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a07e2a-c516-420c-ab4e-3e99253b46bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:06.995802 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a07e2a-c516-420c-ab4e-3e99253b46bd None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:06.996308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a07e2a-c516-420c-ab4e-3e99253b46bd None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:06.996769 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a07e2a-c516-420c-ab4e-3e99253b46bd None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:06.997667 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a07e2a-c516-420c-ab4e-3e99253b46bd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:06.998158 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a07e2a-c516-420c-ab4e-3e99253b46bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:06.999810 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a07e2a-c516-420c-ab4e-3e99253b46bd None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:07.006487 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 504/1014] 10.222.0.119 () {56 vars in 1127 bytes} [Thu Jul 14 15:37:06 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:37:07.012313 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e9a69-c7c6-40e7-ba78-ba78a78d8f26 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:07.128786 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:07.133294 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e9a69-c7c6-40e7-ba78-ba78a78d8f26 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:07.172563 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a431b22-c7fe-412c-8e9f-dcd944d38eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:07.173191 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a431b22-c7fe-412c-8e9f-dcd944d38eea None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:07.173478 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a431b22-c7fe-412c-8e9f-dcd944d38eea None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:07.173754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a431b22-c7fe-412c-8e9f-dcd944d38eea None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:07.174468 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a431b22-c7fe-412c-8e9f-dcd944d38eea None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:07.174776 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a431b22-c7fe-412c-8e9f-dcd944d38eea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:07.176186 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a431b22-c7fe-412c-8e9f-dcd944d38eea None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:07.181943 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 511/1015] 10.222.0.119 () {56 vars in 1127 bytes} [Thu Jul 14 15:37:07 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:37:07.187987 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a07e2a-c516-420c-ab4e-3e99253b46bd None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:07.296146 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a07e2a-c516-420c-ab4e-3e99253b46bd None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:07.330979 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652ecce-7464-4808-a58e-8bed436fad97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:07.331647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652ecce-7464-4808-a58e-8bed436fad97 None admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:07.331939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652ecce-7464-4808-a58e-8bed436fad97 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:07.332253 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652ecce-7464-4808-a58e-8bed436fad97 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:07.333005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652ecce-7464-4808-a58e-8bed436fad97 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:07.334374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652ecce-7464-4808-a58e-8bed436fad97 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:07.459654 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 505/1016] 10.222.0.119 () {60 vars in 1149 bytes} [Thu Jul 14 15:37:07 2022] POST /identity/v3/endpoints => generated 327 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:08.660656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947daddf-0140-474b-9eed-8fc403a0778a None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:08.661171 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947daddf-0140-474b-9eed-8fc403a0778a None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:08.661280 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947daddf-0140-474b-9eed-8fc403a0778a None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:08.662627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 512/1017] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:08.667951 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea63158-9dc5-45f1-8042-cbe55d74fb79 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:08.668401 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea63158-9dc5-45f1-8042-cbe55d74fb79 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:08.668562 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea63158-9dc5-45f1-8042-cbe55d74fb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:08.685773 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-1ea63158-9dc5-45f1-8042-cbe55d74fb79 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:08.686961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-1ea63158-9dc5-45f1-8042-cbe55d74fb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:08.695654 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:08.763192 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 506/1018] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:08 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:37:08.785925 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947daddf-0140-474b-9eed-8fc403a0778a None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:08.891274 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947daddf-0140-474b-9eed-8fc403a0778a None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:08.925720 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54dd83d-3bda-41a2-a3e5-c77325c83f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:08.926520 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dd83d-3bda-41a2-a3e5-c77325c83f5a None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:08.926808 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dd83d-3bda-41a2-a3e5-c77325c83f5a None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:08.927088 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dd83d-3bda-41a2-a3e5-c77325c83f5a None admin] PATH_INFO: `/v3/services/image` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:08.927740 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54dd83d-3bda-41a2-a3e5-c77325c83f5a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:08.929210 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54dd83d-3bda-41a2-a3e5-c77325c83f5a None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:08.941464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-d54dd83d-3bda-41a2-a3e5-c77325c83f5a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 15:37:08.941464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:08.941464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:37:08.941464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:37:08.941464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:37:08.941464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:37:08.941464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:37:08.941464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:37:08.941464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 15:37:08.941464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:37:08.941464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:37:08.941464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:37:08.941464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:08.941464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:08.941464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:08.941464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:08.941464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:08.942575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:08.942575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:08.942575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:08.942575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:08.942575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:08.942575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:08.942575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:37:08.942575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:37:08.942575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:37:08.942575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:37:08.942575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:08.942575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:08.942575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:08.942575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:08.942575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:08.942575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:08.943412 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:08.943412 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:08.943412 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:08.943412 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:08.943412 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:08.943412 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:08.943412 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:08.943412 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:08.943412 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:08.943412 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:08.943412 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:37:08.943412 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:37:08.943412 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 15:37:08.943412 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:37:08.950844 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 513/1019] 10.222.0.119 () {56 vars in 1110 bytes} [Thu Jul 14 15:37:08 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:37:08.950979 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea63158-9dc5-45f1-8042-cbe55d74fb79 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:09.049917 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea63158-9dc5-45f1-8042-cbe55d74fb79 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:09.084143 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8eb310-e885-4f26-bd73-f14f3c43bd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:09.084820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8eb310-e885-4f26-bd73-f14f3c43bd7b None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:09.085106 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8eb310-e885-4f26-bd73-f14f3c43bd7b None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:09.085721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8eb310-e885-4f26-bd73-f14f3c43bd7b None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:09.086657 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8eb310-e885-4f26-bd73-f14f3c43bd7b None admin] RBAC: Adding query filter params (name=image) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:09.086970 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8eb310-e885-4f26-bd73-f14f3c43bd7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:09.088362 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8eb310-e885-4f26-bd73-f14f3c43bd7b None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:09.093773 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 507/1020] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:37:08 2022] GET /identity/v3/services?name=image => generated 123 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:09.099171 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54dd83d-3bda-41a2-a3e5-c77325c83f5a None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:09.110340 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35658bb-1f03-4206-8d07-cc31c901cec4 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:09.110629 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35658bb-1f03-4206-8d07-cc31c901cec4 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:09.110915 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35658bb-1f03-4206-8d07-cc31c901cec4 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:09.112459 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 508/1021] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:37:09.117803 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680daba7-e716-4e6c-85f1-d82778057d3e None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:09.118097 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680daba7-e716-4e6c-85f1-d82778057d3e None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:09.118377 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680daba7-e716-4e6c-85f1-d82778057d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:09.123392 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:09.130519 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:09.137437 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-680daba7-e716-4e6c-85f1-d82778057d3e None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:09.138640 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-680daba7-e716-4e6c-85f1-d82778057d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:09.203918 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54dd83d-3bda-41a2-a3e5-c77325c83f5a None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:09.209849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 509/1022] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:09 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:37:09.234700 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680daba7-e716-4e6c-85f1-d82778057d3e None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:09.243821 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7756bf-0f4a-47ec-8aa9-7cbbf18b55b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:09.244533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7756bf-0f4a-47ec-8aa9-7cbbf18b55b7 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:09.244832 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7756bf-0f4a-47ec-8aa9-7cbbf18b55b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:09.245108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7756bf-0f4a-47ec-8aa9-7cbbf18b55b7 None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:09.245854 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7756bf-0f4a-47ec-8aa9-7cbbf18b55b7 None admin] RBAC: Adding query filter params (type=image) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:09.246171 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7756bf-0f4a-47ec-8aa9-7cbbf18b55b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:09.247566 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7756bf-0f4a-47ec-8aa9-7cbbf18b55b7 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:09.252711 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 514/1023] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:37:09 2022] GET /identity/v3/services?type=image => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:09.258610 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7756bf-0f4a-47ec-8aa9-7cbbf18b55b7 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:09.350483 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680daba7-e716-4e6c-85f1-d82778057d3e None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:09.353769 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:09.362937 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7756bf-0f4a-47ec-8aa9-7cbbf18b55b7 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:09.382337 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:09.387720 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16b889-84e5-4068-bad8-cdb1f9164521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:09.388573 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16b889-84e5-4068-bad8-cdb1f9164521 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:09.388861 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16b889-84e5-4068-bad8-cdb1f9164521 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:09.389140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16b889-84e5-4068-bad8-cdb1f9164521 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:09.400362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada4fc2-0443-4f5d-a1c9-9a0c4b324306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:09.401115 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16b889-84e5-4068-bad8-cdb1f9164521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:37:09.401321 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada4fc2-0443-4f5d-a1c9-9a0c4b324306 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:09.401613 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada4fc2-0443-4f5d-a1c9-9a0c4b324306 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:09.401905 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada4fc2-0443-4f5d-a1c9-9a0c4b324306 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:09.402702 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada4fc2-0443-4f5d-a1c9-9a0c4b324306 None admin] RBAC: Adding query filter params (interface=public, service_id=426d99209b944126b58d77e2abc69dc3, region_id=RegionOne) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:09.403093 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada4fc2-0443-4f5d-a1c9-9a0c4b324306 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:09.404453 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada4fc2-0443-4f5d-a1c9-9a0c4b324306 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:09.409600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-fb16b889-84e5-4068-bad8-cdb1f9164521 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:37:09.409600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:09.409600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:09.409600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:09.409600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:09.409600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:09.409600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:09.409600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:09.409600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:09.409600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:09.409600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:09.409600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:09.409600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:37:09.409600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:37:09.409600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:37:09.409600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:37:09.410513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:37:09.410513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:37:09.410513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:37:09.410513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:37:09.410513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:09.410513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:09.410513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:09.410513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:09.410513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:09.410513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:09.410513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:09.410513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:09.410513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:09.410513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:09.410513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:09.410513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:09.411379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:09.411379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:09.411379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:09.411379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:09.411379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:37:09.411379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:37:09.411379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:37:09.411379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:37:09.411379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:37:09.411379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:37:09.411379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:37:09.411379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:09.412010 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 515/1024] 10.222.0.119 () {56 vars in 1256 bytes} [Thu Jul 14 15:37:09 2022] GET /identity/v3/endpoints?service_id=426d99209b944126b58d77e2abc69dc3&interface=public®ion_id=RegionOne => generated 195 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:37:09.418738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 510/1025] 10.222.0.119 () {56 vars in 1125 bytes} [Thu Jul 14 15:37:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:37:09.418888 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada4fc2-0443-4f5d-a1c9-9a0c4b324306 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:09.419526 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16b889-84e5-4068-bad8-cdb1f9164521 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:09.525738 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada4fc2-0443-4f5d-a1c9-9a0c4b324306 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:09.534445 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16b889-84e5-4068-bad8-cdb1f9164521 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:09.559904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66e60d-7ace-4919-b6f6-ee336ae805a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:09.560678 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66e60d-7ace-4919-b6f6-ee336ae805a3 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:09.560969 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66e60d-7ace-4919-b6f6-ee336ae805a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:09.561250 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66e60d-7ace-4919-b6f6-ee336ae805a3 None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:09.561927 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f66e60d-7ace-4919-b6f6-ee336ae805a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:09.563294 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f66e60d-7ace-4919-b6f6-ee336ae805a3 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:09.567972 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93018969-fb7c-4139-9361-243c121107f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:09.568671 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93018969-fb7c-4139-9361-243c121107f4 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:09.568958 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93018969-fb7c-4139-9361-243c121107f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:09.569233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93018969-fb7c-4139-9361-243c121107f4 None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:09.570503 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93018969-fb7c-4139-9361-243c121107f4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:09.570610 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 516/1026] 10.222.0.119 () {56 vars in 1092 bytes} [Thu Jul 14 15:37:09 2022] GET /identity/v3/services => generated 1966 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:09.570815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93018969-fb7c-4139-9361-243c121107f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:09.571766 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df8c88-b177-46ca-bc31-a08a137f7410 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:09.572054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df8c88-b177-46ca-bc31-a08a137f7410 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:09.572201 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93018969-fb7c-4139-9361-243c121107f4 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:09.572354 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df8c88-b177-46ca-bc31-a08a137f7410 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:09.577998 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 517/1027] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:09.580051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ca44d-247d-487c-ba99-339f5cbe6246 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:09.580444 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ca44d-247d-487c-ba99-339f5cbe6246 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:09.580721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ca44d-247d-487c-ba99-339f5cbe6246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:09.586736 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 511/1028] 10.222.0.119 () {56 vars in 1120 bytes} [Thu Jul 14 15:37:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:37:09.587833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93018969-fb7c-4139-9361-243c121107f4 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:09.603553 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-296ca44d-247d-487c-ba99-339f5cbe6246 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:09.604719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-296ca44d-247d-487c-ba99-339f5cbe6246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:09.620585 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:09.653676 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:09.688130 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 518/1029] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:09 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:37:09.703710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ca44d-247d-487c-ba99-339f5cbe6246 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:09.705013 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93018969-fb7c-4139-9361-243c121107f4 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:09.750894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba74f2-1fee-4ed8-b150-ed6c88c10f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:09.751712 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba74f2-1fee-4ed8-b150-ed6c88c10f9e None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:09.751985 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba74f2-1fee-4ed8-b150-ed6c88c10f9e None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:09.752565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba74f2-1fee-4ed8-b150-ed6c88c10f9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:09.763933 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba74f2-1fee-4ed8-b150-ed6c88c10f9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:09.765436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba74f2-1fee-4ed8-b150-ed6c88c10f9e None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:09.783578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-ecba74f2-1fee-4ed8-b150-ed6c88c10f9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:37:09.783578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:09.783578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:09.783578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:09.783578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:09.783578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:09.783578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:09.783578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:09.783578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:09.783578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:09.783578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:09.783578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:09.783578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:37:09.783578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:37:09.783578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:37:09.784583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:37:09.784583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:09.784583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:09.784583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:09.784583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:09.784583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:09.784583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:09.784583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:09.784583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:09.784583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:09.784583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:09.784583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:09.784583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:09.784583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:09.784583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:09.784583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:09.784583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:09.785486 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:37:09.785486 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:37:09.785486 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:37:09.785486 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:09.790214 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 512/1030] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:37:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:37:09.790944 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba74f2-1fee-4ed8-b150-ed6c88c10f9e None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:09.826557 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ca44d-247d-487c-ba99-339f5cbe6246 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:09.865316 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427b324-838b-43e9-9240-050850bfbefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:09.866027 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427b324-838b-43e9-9240-050850bfbefa None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:09.866317 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427b324-838b-43e9-9240-050850bfbefa None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:09.867215 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427b324-838b-43e9-9240-050850bfbefa None admin] PATH_INFO: `/v3/domains/default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:09.868675 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9427b324-838b-43e9-9240-050850bfbefa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:09.870243 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9427b324-838b-43e9-9240-050850bfbefa None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:09.877195 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 519/1031] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:37:09 2022] GET /identity/v3/domains/default => generated 200 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:37:09.878162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427b324-838b-43e9-9240-050850bfbefa None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:09.894714 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba74f2-1fee-4ed8-b150-ed6c88c10f9e None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:09.899523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:09.902379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:09.932489 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458ba18-8f43-43cb-92bb-cddb6f51bed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:09.933168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458ba18-8f43-43cb-92bb-cddb6f51bed3 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:09.933456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458ba18-8f43-43cb-92bb-cddb6f51bed3 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:09.933736 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458ba18-8f43-43cb-92bb-cddb6f51bed3 None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:09.934482 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458ba18-8f43-43cb-92bb-cddb6f51bed3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:09.934772 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458ba18-8f43-43cb-92bb-cddb6f51bed3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:09.936219 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458ba18-8f43-43cb-92bb-cddb6f51bed3 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:09.948453 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 513/1032] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:37:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:09.953990 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458ba18-8f43-43cb-92bb-cddb6f51bed3 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:09.983499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427b324-838b-43e9-9240-050850bfbefa None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:10.018070 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de6165-7da0-4de3-bc15-fc1f05ba4848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:10.018745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de6165-7da0-4de3-bc15-fc1f05ba4848 None admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:10.019033 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de6165-7da0-4de3-bc15-fc1f05ba4848 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:10.019308 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de6165-7da0-4de3-bc15-fc1f05ba4848 None admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:10.020091 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de6165-7da0-4de3-bc15-fc1f05ba4848 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:10.021505 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de6165-7da0-4de3-bc15-fc1f05ba4848 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:10.063148 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458ba18-8f43-43cb-92bb-cddb6f51bed3 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:10.097165 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a32c10-85a1-4d0b-99e9-ed318d6ea697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:10.097956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a32c10-85a1-4d0b-99e9-ed318d6ea697 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:10.098239 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a32c10-85a1-4d0b-99e9-ed318d6ea697 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:10.098511 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a32c10-85a1-4d0b-99e9-ed318d6ea697 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:10.105639 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a32c10-85a1-4d0b-99e9-ed318d6ea697 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:10.107073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a32c10-85a1-4d0b-99e9-ed318d6ea697 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:10.126614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 520/1033] 10.222.0.119 () {60 vars in 1146 bytes} [Thu Jul 14 15:37:09 2022] POST /identity/v3/projects => generated 312 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:10.126791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-51a32c10-85a1-4d0b-99e9-ed318d6ea697 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:37:10.126791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:10.126791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:10.126791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:10.126791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:10.126791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:10.126791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:10.126791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:10.126791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:10.126791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:10.126791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:10.126791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:10.126791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:37:10.126791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:37:10.126791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:37:10.126791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:37:10.128066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:10.128066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:10.128066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:37:10.128066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:37:10.128066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:37:10.128066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:37:10.128066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:10.128066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:10.128066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:10.128066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:10.128066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:10.128066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:10.128066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:10.128066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:10.128066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:10.128066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:10.128066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:10.128066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:10.129257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:10.129257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:10.129257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:37:10.129257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:37:10.129257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:37:10.129257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:37:10.129257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:37:10.129257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:37:10.129257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:37:10.129257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:10.129257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 514/1034] 10.222.0.119 () {56 vars in 1098 bytes} [Thu Jul 14 15:37:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:37:10.132941 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de6165-7da0-4de3-bc15-fc1f05ba4848 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:10.214395 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:10.248964 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de6165-7da0-4de3-bc15-fc1f05ba4848 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:10.287577 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd5141-6436-43b7-a4a5-84fe39b8b3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:10.288328 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd5141-6436-43b7-a4a5-84fe39b8b3ba None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:10.288792 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd5141-6436-43b7-a4a5-84fe39b8b3ba None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:10.289332 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd5141-6436-43b7-a4a5-84fe39b8b3ba None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:10.289834 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd5141-6436-43b7-a4a5-84fe39b8b3ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:10.290147 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd5141-6436-43b7-a4a5-84fe39b8b3ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:10.291581 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd5141-6436-43b7-a4a5-84fe39b8b3ba None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:10.311114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 521/1035] 10.222.0.119 () {56 vars in 1138 bytes} [Thu Jul 14 15:37:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:10.317088 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a32c10-85a1-4d0b-99e9-ed318d6ea697 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:10.346649 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:10.423596 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a32c10-85a1-4d0b-99e9-ed318d6ea697 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:10.458820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39004464-b592-457e-9d5d-8448d0f87e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:10.459475 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39004464-b592-457e-9d5d-8448d0f87e44 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:10.459759 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39004464-b592-457e-9d5d-8448d0f87e44 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:10.460119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39004464-b592-457e-9d5d-8448d0f87e44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:10.537643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39004464-b592-457e-9d5d-8448d0f87e44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:10.539879 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39004464-b592-457e-9d5d-8448d0f87e44 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:10.573374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:10.662809 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 515/1036] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:37:10 2022] GET /identity/v3/auth/tokens => generated 1963 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 15:37:10.664988 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd5141-6436-43b7-a4a5-84fe39b8b3ba None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:10.769079 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd5141-6436-43b7-a4a5-84fe39b8b3ba None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:10.796027 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:10.805125 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5228201-70e6-4613-bbc9-fc101c7b1554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:10.810900 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5228201-70e6-4613-bbc9-fc101c7b1554 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:10.810900 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5228201-70e6-4613-bbc9-fc101c7b1554 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:10.810900 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5228201-70e6-4613-bbc9-fc101c7b1554 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:10.816416 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5228201-70e6-4613-bbc9-fc101c7b1554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:10.817923 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5228201-70e6-4613-bbc9-fc101c7b1554 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:10.837223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-d5228201-70e6-4613-bbc9-fc101c7b1554 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:37:10.837223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:10.837223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:10.837223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:10.837223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:10.837223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:10.837223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:10.837223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:10.837223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:10.837223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:10.837223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:10.837223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:10.837223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:37:10.837223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:37:10.837223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:37:10.838300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:37:10.838300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:10.838300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:10.838300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:10.838300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:10.838300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:10.838300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:10.838300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:10.838300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:10.838300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:10.838300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:10.838300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:10.838300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:10.838300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:10.838300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:10.838300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:10.838300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:10.839385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:37:10.839385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:37:10.839385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:37:10.839385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:37:10.846327 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 522/1037] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:37:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:37:10.847541 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39004464-b592-457e-9d5d-8448d0f87e44 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:10.961020 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39004464-b592-457e-9d5d-8448d0f87e44 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:10.986433 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:10.995981 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56355f69-7c53-4abf-8cbe-69114bb48b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:10.998964 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56355f69-7c53-4abf-8cbe-69114bb48b8d None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:10.998964 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56355f69-7c53-4abf-8cbe-69114bb48b8d None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:10.998964 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56355f69-7c53-4abf-8cbe-69114bb48b8d None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:10.998964 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56355f69-7c53-4abf-8cbe-69114bb48b8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:10.998964 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56355f69-7c53-4abf-8cbe-69114bb48b8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:10.999781 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56355f69-7c53-4abf-8cbe-69114bb48b8d None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:11.012285 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 516/1038] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:37:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:37:11.017534 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5228201-70e6-4613-bbc9-fc101c7b1554 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:11.121398 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5228201-70e6-4613-bbc9-fc101c7b1554 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:11.154931 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e801db-b6dc-4ba5-beab-b1c39b601ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:11.155740 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e801db-b6dc-4ba5-beab-b1c39b601ec3 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:11.156027 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e801db-b6dc-4ba5-beab-b1c39b601ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:11.156333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e801db-b6dc-4ba5-beab-b1c39b601ec3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:11.163054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e801db-b6dc-4ba5-beab-b1c39b601ec3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:11.165253 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e801db-b6dc-4ba5-beab-b1c39b601ec3 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:11.179144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-01e801db-b6dc-4ba5-beab-b1c39b601ec3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:37:11.179144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:11.179144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:11.179144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:11.179144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:11.179144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:11.179144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:11.179144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:11.179144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:11.179144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:11.179144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:11.179144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:11.179144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:37:11.179144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:37:11.179144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:37:11.180691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:37:11.180691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:11.180691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:11.180691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:11.180691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:11.180691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:11.180691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:11.180691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:11.180691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:11.180691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:11.180691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:11.180691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:11.180691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:11.180691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:11.180691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:11.180691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:11.180691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:11.186354 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:37:11.186354 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:37:11.186354 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:37:11.186354 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:37:11.186354 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:37:11.186354 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:37:11.186354 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:37:11.186354 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:37:11.186354 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 523/1039] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:37:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:37:11.188294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56355f69-7c53-4abf-8cbe-69114bb48b8d None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:11.316773 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56355f69-7c53-4abf-8cbe-69114bb48b8d None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:11.353435 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01fc8c-b588-4b51-986e-a2c3194e60cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:11.354106 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01fc8c-b588-4b51-986e-a2c3194e60cc None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:11.354395 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01fc8c-b588-4b51-986e-a2c3194e60cc None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:11.354677 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01fc8c-b588-4b51-986e-a2c3194e60cc None admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:11.355459 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01fc8c-b588-4b51-986e-a2c3194e60cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:11.355772 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01fc8c-b588-4b51-986e-a2c3194e60cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:11.357220 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01fc8c-b588-4b51-986e-a2c3194e60cc None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:11.374927 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 517/1040] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:37:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:11.376549 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e801db-b6dc-4ba5-beab-b1c39b601ec3 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:11.420789 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:11.481012 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e801db-b6dc-4ba5-beab-b1c39b601ec3 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:11.524750 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912bac6-8e35-409e-a282-1461eea92183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:11.525418 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912bac6-8e35-409e-a282-1461eea92183 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:11.525701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912bac6-8e35-409e-a282-1461eea92183 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:11.525976 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912bac6-8e35-409e-a282-1461eea92183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:11.526834 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0912bac6-8e35-409e-a282-1461eea92183 None admin] RBAC: Adding query filter params (role.id=d9b93606a9bb4ff7a13f81af237b9009, scope.project.id=07652ced88cf4f069d1765176be5130b, user.id=a1e4c833a4684561ab52eda5734a7766) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:11.527146 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0912bac6-8e35-409e-a282-1461eea92183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:11.528601 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0912bac6-8e35-409e-a282-1461eea92183 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:11.534321 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 524/1041] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:37:11 2022] GET /identity/v3/role_assignments?user.id=a1e4c833a4684561ab52eda5734a7766&scope.project.id=07652ced88cf4f069d1765176be5130b&role.id=d9b93606a9bb4ff7a13f81af237b9009 => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:11.662278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4022cd-38a4-4d5e-9a52-6fd8988926e6 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:11.662581 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4022cd-38a4-4d5e-9a52-6fd8988926e6 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:11.662759 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4022cd-38a4-4d5e-9a52-6fd8988926e6 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:11.664708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 518/1042] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:11.670152 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243fd42-f10d-4fec-b637-77187757b56c None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:11.670451 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243fd42-f10d-4fec-b637-77187757b56c None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:11.670740 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243fd42-f10d-4fec-b637-77187757b56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:11.692918 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-9243fd42-f10d-4fec-b637-77187757b56c None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:11.694123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-9243fd42-f10d-4fec-b637-77187757b56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:11.768178 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 525/1043] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:11 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:37:11.789710 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4022cd-38a4-4d5e-9a52-6fd8988926e6 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:11.840280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:11.898368 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4022cd-38a4-4d5e-9a52-6fd8988926e6 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:11.935076 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8685ca-5d6d-4989-b1e4-524a08ce87de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:11.935951 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8685ca-5d6d-4989-b1e4-524a08ce87de None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:11.936227 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8685ca-5d6d-4989-b1e4-524a08ce87de None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:11.936497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8685ca-5d6d-4989-b1e4-524a08ce87de None admin] PATH_INFO: `/v3/services/image` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:11.937151 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8685ca-5d6d-4989-b1e4-524a08ce87de None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:11.938513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8685ca-5d6d-4989-b1e4-524a08ce87de None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:11.950911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-ae8685ca-5d6d-4989-b1e4-524a08ce87de None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 15:37:11.950911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:11.950911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:37:11.950911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:37:11.950911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:37:11.950911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:37:11.950911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:37:11.950911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:37:11.950911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 15:37:11.950911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:11.950911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:37:11.950911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:11.950911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:11.950911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:11.950911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:11.950911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:11.950911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:11.951995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:11.951995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:11.951995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:11.951995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:11.951995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:11.951995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:11.951995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:37:11.951995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:37:11.951995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:37:11.951995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:37:11.951995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:11.951995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:11.951995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:11.951995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:11.951995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:11.951995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:11.953415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:11.953415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:11.953415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:11.953415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:11.953415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:11.953415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:11.953415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:11.953415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:11.953415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:11.953415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:11.953415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:37:11.953415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:37:11.953415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 15:37:11.953415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:11.954510 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 519/1044] 10.222.0.119 () {56 vars in 1110 bytes} [Thu Jul 14 15:37:11 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:37:11.958264 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243fd42-f10d-4fec-b637-77187757b56c None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:11.995793 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:12.065330 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243fd42-f10d-4fec-b637-77187757b56c None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:12.099119 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c32327-eb54-4e7c-82e5-2775420e0ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:12.099803 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c32327-eb54-4e7c-82e5-2775420e0ebd None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:12.100089 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c32327-eb54-4e7c-82e5-2775420e0ebd None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:12.100391 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c32327-eb54-4e7c-82e5-2775420e0ebd None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:12.101729 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c32327-eb54-4e7c-82e5-2775420e0ebd None admin] RBAC: Adding query filter params (name=image) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:12.102040 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c32327-eb54-4e7c-82e5-2775420e0ebd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:12.103440 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c32327-eb54-4e7c-82e5-2775420e0ebd None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:12.113022 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 526/1045] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:37:11 2022] GET /identity/v3/services?name=image => generated 123 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:12.114265 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8685ca-5d6d-4989-b1e4-524a08ce87de None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:12.220813 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8685ca-5d6d-4989-b1e4-524a08ce87de None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:12.232056 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:12.255730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e03e84-bcc6-4e4d-b703-892035697c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:12.256439 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e03e84-bcc6-4e4d-b703-892035697c4b None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:12.256728 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e03e84-bcc6-4e4d-b703-892035697c4b None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:12.257017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e03e84-bcc6-4e4d-b703-892035697c4b None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:12.257853 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e03e84-bcc6-4e4d-b703-892035697c4b None admin] RBAC: Adding query filter params (type=image) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:12.258245 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e03e84-bcc6-4e4d-b703-892035697c4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:12.259621 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e03e84-bcc6-4e4d-b703-892035697c4b None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:12.270487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c32327-eb54-4e7c-82e5-2775420e0ebd None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:12.271562 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 520/1046] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:37:12 2022] GET /identity/v3/services?type=image => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:12.299409 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65d0aa-7ed7-4387-9b5f-04341d9fb767 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:12.299738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65d0aa-7ed7-4387-9b5f-04341d9fb767 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:12.299981 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65d0aa-7ed7-4387-9b5f-04341d9fb767 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:12.301402 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 521/1047] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:37:12.306646 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5aad1-331e-45f8-b38f-cdc91d3d771d None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:12.306938 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5aad1-331e-45f8-b38f-cdc91d3d771d None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:12.307223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5aad1-331e-45f8-b38f-cdc91d3d771d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:12.324264 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-b3c5aad1-331e-45f8-b38f-cdc91d3d771d None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:12.325471 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b3c5aad1-331e-45f8-b38f-cdc91d3d771d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:12.377162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:12.381085 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c32327-eb54-4e7c-82e5-2775420e0ebd None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:12.396369 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 522/1048] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:12 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:37:12.417301 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77ae57-6e4a-453d-b76c-8898b7cda62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:12.417991 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77ae57-6e4a-453d-b76c-8898b7cda62c None admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:12.418275 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77ae57-6e4a-453d-b76c-8898b7cda62c None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:12.418552 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77ae57-6e4a-453d-b76c-8898b7cda62c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:12.419286 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77ae57-6e4a-453d-b76c-8898b7cda62c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:12.420723 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77ae57-6e4a-453d-b76c-8898b7cda62c None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:12.422272 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5aad1-331e-45f8-b38f-cdc91d3d771d None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:12.520957 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 527/1049] 10.222.0.119 () {60 vars in 1149 bytes} [Thu Jul 14 15:37:12 2022] POST /identity/v3/endpoints => generated 329 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:12.530136 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5aad1-331e-45f8-b38f-cdc91d3d771d None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:12.534046 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:12.578606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19900c07-fe40-4c8f-9087-8d51255821c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:12.579426 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19900c07-fe40-4c8f-9087-8d51255821c5 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:12.579715 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19900c07-fe40-4c8f-9087-8d51255821c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:12.579992 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19900c07-fe40-4c8f-9087-8d51255821c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:12.581334 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19900c07-fe40-4c8f-9087-8d51255821c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:12.582781 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19900c07-fe40-4c8f-9087-8d51255821c5 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:12.584884 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 523/1050] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:37:12 2022] GET /identity/v3/domains/default => generated 200 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:37:12.590917 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77ae57-6e4a-453d-b76c-8898b7cda62c None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:12.703860 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77ae57-6e4a-453d-b76c-8898b7cda62c None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:12.739901 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c36597-5298-452d-a115-9699b7486084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:12.740618 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c36597-5298-452d-a115-9699b7486084 None admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:12.740907 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c36597-5298-452d-a115-9699b7486084 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:12.741190 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c36597-5298-452d-a115-9699b7486084 None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:12.742674 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c36597-5298-452d-a115-9699b7486084 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:12.744232 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c36597-5298-452d-a115-9699b7486084 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:12.822287 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 528/1051] 10.222.0.119 () {60 vars in 1137 bytes} [Thu Jul 14 15:37:12 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:13.577896 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b363a-fab6-41a7-b28b-cbd9713b061a None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:13.578412 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b363a-fab6-41a7-b28b-cbd9713b061a None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:13.578488 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b363a-fab6-41a7-b28b-cbd9713b061a None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:13.579957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 524/1052] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:37:13.584975 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8fd29-a9da-42b7-83cc-54de244ba72d None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:13.585368 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8fd29-a9da-42b7-83cc-54de244ba72d None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:13.585578 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8fd29-a9da-42b7-83cc-54de244ba72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:13.603054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-d5d8fd29-a9da-42b7-83cc-54de244ba72d None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:13.604270 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-d5d8fd29-a9da-42b7-83cc-54de244ba72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:13.607192 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:13.684010 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 529/1053] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:13 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:37:13.706783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b363a-fab6-41a7-b28b-cbd9713b061a None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:13.812193 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b363a-fab6-41a7-b28b-cbd9713b061a None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:13.846954 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b4484-8177-413f-a2b9-0970ae51f0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:13.847770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b4484-8177-413f-a2b9-0970ae51f0be None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:13.848059 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b4484-8177-413f-a2b9-0970ae51f0be None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:13.848367 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b4484-8177-413f-a2b9-0970ae51f0be None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:13.859252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b4484-8177-413f-a2b9-0970ae51f0be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:37:13.868094 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-051b4484-8177-413f-a2b9-0970ae51f0be None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:37:13.868094 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:13.868094 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:13.868094 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:13.868094 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:13.868094 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:13.868094 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:13.868094 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:13.868094 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:13.868094 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:13.868094 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:13.868094 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:13.868094 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:37:13.868094 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:37:13.868094 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:37:13.868094 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:37:13.869156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:37:13.869156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:37:13.869156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:37:13.869156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:37:13.869156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:13.869156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:13.869156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:13.869156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:13.869156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:13.869156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:13.869156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:13.869156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:13.869156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:13.869156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:13.869156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:13.869156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:13.870005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:13.870005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:13.870005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:13.870005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:13.870005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:37:13.870005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:37:13.870005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:37:13.870005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:37:13.870005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:37:13.870005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:37:13.870005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:37:13.870005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:13.872266 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 525/1054] 10.222.0.119 () {56 vars in 1125 bytes} [Thu Jul 14 15:37:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:37:13.875413 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8fd29-a9da-42b7-83cc-54de244ba72d None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:13.982453 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8fd29-a9da-42b7-83cc-54de244ba72d None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:14.019850 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd565f-b145-4f7e-9a72-5b4cf4c6d867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:14.020571 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd565f-b145-4f7e-9a72-5b4cf4c6d867 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:14.020862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd565f-b145-4f7e-9a72-5b4cf4c6d867 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:14.021146 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd565f-b145-4f7e-9a72-5b4cf4c6d867 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:14.021899 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd565f-b145-4f7e-9a72-5b4cf4c6d867 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:14.022210 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd565f-b145-4f7e-9a72-5b4cf4c6d867 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:14.023821 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd565f-b145-4f7e-9a72-5b4cf4c6d867 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:14.036270 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 530/1055] 10.222.0.119 () {56 vars in 1120 bytes} [Thu Jul 14 15:37:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:14.037906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b4484-8177-413f-a2b9-0970ae51f0be None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:14.068157 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:14.145025 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b4484-8177-413f-a2b9-0970ae51f0be None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:14.180617 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da507631-9f16-4c0f-8522-7b3a0a6dc454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:14.181414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da507631-9f16-4c0f-8522-7b3a0a6dc454 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:14.181701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da507631-9f16-4c0f-8522-7b3a0a6dc454 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:14.181982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da507631-9f16-4c0f-8522-7b3a0a6dc454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:14.193155 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da507631-9f16-4c0f-8522-7b3a0a6dc454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:14.194616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da507631-9f16-4c0f-8522-7b3a0a6dc454 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:14.213724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-da507631-9f16-4c0f-8522-7b3a0a6dc454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:37:14.213724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:14.213724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:14.213724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:14.213724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:14.213724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:14.213724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:14.213724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:14.213724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:14.213724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:14.213724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:14.213724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:14.213724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:37:14.213724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:37:14.213724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:37:14.214630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:37:14.214630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:14.214630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:14.214630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:14.214630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:14.214630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:14.214630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:14.214630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:14.214630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:14.214630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:14.214630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:14.214630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:14.214630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:14.214630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:14.214630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:14.214630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:14.214630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:14.215537 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:37:14.215537 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:37:14.215537 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:37:14.215537 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:14.215537 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 526/1056] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:37:14.221894 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd565f-b145-4f7e-9a72-5b4cf4c6d867 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:14.224820 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:14.325764 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd565f-b145-4f7e-9a72-5b4cf4c6d867 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:14.369479 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f3ff4-3b72-43bb-aeb5-fbd8ee03d16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:14.370674 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f3ff4-3b72-43bb-aeb5-fbd8ee03d16f None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:14.371261 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f3ff4-3b72-43bb-aeb5-fbd8ee03d16f None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:14.371818 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f3ff4-3b72-43bb-aeb5-fbd8ee03d16f None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:14.372875 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f3ff4-3b72-43bb-aeb5-fbd8ee03d16f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:14.373332 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f3ff4-3b72-43bb-aeb5-fbd8ee03d16f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:14.374840 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f3ff4-3b72-43bb-aeb5-fbd8ee03d16f None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:14.389376 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 531/1057] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:37:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:14.395175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da507631-9f16-4c0f-8522-7b3a0a6dc454 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:14.482347 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:14.502291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da507631-9f16-4c0f-8522-7b3a0a6dc454 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:14.540259 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cb3c6-4413-42f1-acb6-3dd0fc0321e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:14.541393 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cb3c6-4413-42f1-acb6-3dd0fc0321e9 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:14.541891 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cb3c6-4413-42f1-acb6-3dd0fc0321e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:14.542358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cb3c6-4413-42f1-acb6-3dd0fc0321e9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:14.550814 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cb3c6-4413-42f1-acb6-3dd0fc0321e9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:14.552544 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cb3c6-4413-42f1-acb6-3dd0fc0321e9 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:14.567279 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-ec9cb3c6-4413-42f1-acb6-3dd0fc0321e9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:37:14.567279 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:14.567279 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:14.567279 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:14.567279 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:14.567279 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:14.567279 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:14.567279 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:14.567279 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:14.567279 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:14.567279 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:14.567279 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:14.567279 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:37:14.567279 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:37:14.567279 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:37:14.567279 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:37:14.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:14.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:14.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:37:14.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:37:14.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:37:14.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:37:14.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:14.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:14.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:14.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:14.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:14.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:14.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:14.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:14.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:14.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:14.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:14.568286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:14.569235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:14.569235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:14.569235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:37:14.569235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:37:14.569235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:37:14.569235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:37:14.569235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:37:14.569235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:37:14.569235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:37:14.569235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:14.571578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 527/1058] 10.222.0.119 () {56 vars in 1098 bytes} [Thu Jul 14 15:37:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:37:14.577127 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f3ff4-3b72-43bb-aeb5-fbd8ee03d16f None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:14.643891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:14.684151 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f3ff4-3b72-43bb-aeb5-fbd8ee03d16f None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:14.695274 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a284cdb-5b24-4918-a120-3c0558477ec5 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:14.695878 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a284cdb-5b24-4918-a120-3c0558477ec5 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:14.695878 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a284cdb-5b24-4918-a120-3c0558477ec5 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:14.697371 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 528/1059] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:37:14.702332 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef58cf2-4eb8-4f75-9961-122423de02bd None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:14.702633 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef58cf2-4eb8-4f75-9961-122423de02bd None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:14.702915 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef58cf2-4eb8-4f75-9961-122423de02bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:14.720451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-eef58cf2-4eb8-4f75-9961-122423de02bd None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:14.721407 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c81348-f596-4908-aedf-bcff332e8534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:14.721648 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-eef58cf2-4eb8-4f75-9961-122423de02bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:14.722089 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c81348-f596-4908-aedf-bcff332e8534 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:14.722400 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c81348-f596-4908-aedf-bcff332e8534 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:14.722682 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c81348-f596-4908-aedf-bcff332e8534 None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:14.723523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c81348-f596-4908-aedf-bcff332e8534 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:14.723838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c81348-f596-4908-aedf-bcff332e8534 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:14.725308 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c81348-f596-4908-aedf-bcff332e8534 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:14.743291 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 532/1060] 10.222.0.119 () {56 vars in 1138 bytes} [Thu Jul 14 15:37:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:14.748855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c81348-f596-4908-aedf-bcff332e8534 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:14.792704 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 529/1061] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:14 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:37:14.815168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef58cf2-4eb8-4f75-9961-122423de02bd None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:14.858069 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c81348-f596-4908-aedf-bcff332e8534 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:14.880742 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:14.895718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e97df-17a3-4925-aceb-ac796df0c60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:14.896541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e97df-17a3-4925-aceb-ac796df0c60b None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:14.896828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e97df-17a3-4925-aceb-ac796df0c60b None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:14.897105 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e97df-17a3-4925-aceb-ac796df0c60b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:14.900196 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:14.908227 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e97df-17a3-4925-aceb-ac796df0c60b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:14.909875 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e97df-17a3-4925-aceb-ac796df0c60b None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:14.929460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-b24e97df-17a3-4925-aceb-ac796df0c60b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:37:14.929460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:14.929460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:14.929460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:14.929460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:14.929460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:14.929460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:14.929460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:14.929460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:14.929460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:14.929460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:14.929460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:14.929460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:37:14.929460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:37:14.929460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:37:14.930590 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:37:14.930590 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:14.930590 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:14.930590 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:14.930590 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:14.930590 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:14.930590 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:14.930590 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:14.930590 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:14.930590 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:14.930590 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:14.930590 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:14.930590 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:14.930590 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:14.930590 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:14.930590 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:14.930590 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:14.931486 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:37:14.931486 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:37:14.931486 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:37:14.931486 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:37:14.931486 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 533/1062] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:37:14.936573 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e97df-17a3-4925-aceb-ac796df0c60b None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:14.939012 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef58cf2-4eb8-4f75-9961-122423de02bd None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:14.975371 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec76dc-b89e-4d55-b9a7-2a5bb367bbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:14.976603 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec76dc-b89e-4d55-b9a7-2a5bb367bbe6 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:14.976933 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec76dc-b89e-4d55-b9a7-2a5bb367bbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:14.977162 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec76dc-b89e-4d55-b9a7-2a5bb367bbe6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:15.036699 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e97df-17a3-4925-aceb-ac796df0c60b None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:15.043676 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec76dc-b89e-4d55-b9a7-2a5bb367bbe6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:15.045177 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec76dc-b89e-4d55-b9a7-2a5bb367bbe6 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:15.072489 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d16c83-8ec1-427e-a5e5-f46b98a544dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:15.073152 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d16c83-8ec1-427e-a5e5-f46b98a544dd None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:15.073436 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d16c83-8ec1-427e-a5e5-f46b98a544dd None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:15.073713 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d16c83-8ec1-427e-a5e5-f46b98a544dd None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:15.074425 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d16c83-8ec1-427e-a5e5-f46b98a544dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:15.074727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d16c83-8ec1-427e-a5e5-f46b98a544dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:15.076134 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d16c83-8ec1-427e-a5e5-f46b98a544dd None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:15.087313 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 534/1063] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:37:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:15.088604 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324c099-41a6-4762-8a80-336d0f04709c None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:15.088901 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324c099-41a6-4762-8a80-336d0f04709c None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:15.089187 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324c099-41a6-4762-8a80-336d0f04709c None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:15.090572 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 535/1064] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:15.095558 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324c099-41a6-4762-8a80-336d0f04709c None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:15.112910 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:15.128021 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:15.149231 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 530/1065] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:37:14 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:37:15.150646 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbe261-2b1a-465d-acfb-a724abd92338 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:15.151134 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbe261-2b1a-465d-acfb-a724abd92338 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:15.151437 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbe261-2b1a-465d-acfb-a724abd92338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:15.173218 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-24cbe261-2b1a-465d-acfb-a724abd92338 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:15.174909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-24cbe261-2b1a-465d-acfb-a724abd92338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:15.202584 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324c099-41a6-4762-8a80-336d0f04709c None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:15.237279 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce399ee-01c7-487e-a224-9217d3c85986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:15.238068 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce399ee-01c7-487e-a224-9217d3c85986 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:15.238350 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce399ee-01c7-487e-a224-9217d3c85986 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:15.238669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce399ee-01c7-487e-a224-9217d3c85986 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:15.243791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 531/1066] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:15 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:37:15.244656 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbe261-2b1a-465d-acfb-a724abd92338 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:15.245563 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce399ee-01c7-487e-a224-9217d3c85986 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:15.247003 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce399ee-01c7-487e-a224-9217d3c85986 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:15.261718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-0ce399ee-01c7-487e-a224-9217d3c85986 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:37:15.261718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:15.261718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:15.261718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:15.261718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:15.261718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:15.261718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:15.261718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:15.261718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:15.261718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:15.261718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:15.261718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:15.261718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:37:15.261718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:37:15.261718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:37:15.262660 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:37:15.262660 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:15.262660 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:15.262660 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:15.262660 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:15.262660 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:15.262660 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:15.262660 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:15.262660 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:15.262660 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:15.262660 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:15.262660 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:15.262660 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:15.262660 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:15.262660 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:15.262660 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:15.262660 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:15.263556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:37:15.263556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:37:15.263556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:37:15.263556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:37:15.263556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:37:15.263556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:37:15.263556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:37:15.263556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:37:15.263556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 536/1067] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:37:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:37:15.269009 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce399ee-01c7-487e-a224-9217d3c85986 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:15.344698 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:15.348260 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbe261-2b1a-465d-acfb-a724abd92338 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:15.362989 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:15.371360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce399ee-01c7-487e-a224-9217d3c85986 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:15.384170 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630a495-4e38-47da-b346-69fb3fd612e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:15.384977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630a495-4e38-47da-b346-69fb3fd612e5 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:15.387119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630a495-4e38-47da-b346-69fb3fd612e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:15.387119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630a495-4e38-47da-b346-69fb3fd612e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:15.395731 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630a495-4e38-47da-b346-69fb3fd612e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:15.397216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630a495-4e38-47da-b346-69fb3fd612e5 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:15.404948 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba2663-95fc-4fb1-ae40-a53cd06d7817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:15.405608 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba2663-95fc-4fb1-ae40-a53cd06d7817 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:15.406165 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba2663-95fc-4fb1-ae40-a53cd06d7817 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:15.406275 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba2663-95fc-4fb1-ae40-a53cd06d7817 None admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:15.407051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba2663-95fc-4fb1-ae40-a53cd06d7817 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:15.407523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba2663-95fc-4fb1-ae40-a53cd06d7817 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:15.409243 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba2663-95fc-4fb1-ae40-a53cd06d7817 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:15.415323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-9630a495-4e38-47da-b346-69fb3fd612e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:37:15.415323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:15.415323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:15.415323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:15.415323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:15.415323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:15.415323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:15.415323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:15.415323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:15.415323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:15.415323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:15.415323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:15.415323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:37:15.415323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:37:15.415323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:37:15.416235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:37:15.416235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:15.416235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:15.416235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:15.416235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:15.416235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:15.416235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:15.416235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:15.416235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:15.416235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:15.416235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:15.416235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:15.416235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:15.416235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:15.416235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:15.416235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:15.416235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:15.417330 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:37:15.417330 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:37:15.417330 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:37:15.417330 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:15.417330 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 532/1068] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:37:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:37:15.417330 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630a495-4e38-47da-b346-69fb3fd612e5 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:15.422896 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 537/1069] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:37:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:37:15.423719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba2663-95fc-4fb1-ae40-a53cd06d7817 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:15.522259 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630a495-4e38-47da-b346-69fb3fd612e5 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:15.526164 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba2663-95fc-4fb1-ae40-a53cd06d7817 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:15.558206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce584339-2a57-4faf-8ab9-f6507a9b37d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:15.559004 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce584339-2a57-4faf-8ab9-f6507a9b37d2 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:15.559289 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce584339-2a57-4faf-8ab9-f6507a9b37d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:15.559487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522215f9-30d9-4a99-9c95-d6172f2a2a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:15.559611 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce584339-2a57-4faf-8ab9-f6507a9b37d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:15.560179 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522215f9-30d9-4a99-9c95-d6172f2a2a09 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:15.560472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522215f9-30d9-4a99-9c95-d6172f2a2a09 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:15.560750 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522215f9-30d9-4a99-9c95-d6172f2a2a09 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:15.561495 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522215f9-30d9-4a99-9c95-d6172f2a2a09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:15.561803 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522215f9-30d9-4a99-9c95-d6172f2a2a09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:15.563172 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522215f9-30d9-4a99-9c95-d6172f2a2a09 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:15.569661 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce584339-2a57-4faf-8ab9-f6507a9b37d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:37:15.575287 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 538/1070] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:37:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:15.576055 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522215f9-30d9-4a99-9c95-d6172f2a2a09 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:15.578084 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-ce584339-2a57-4faf-8ab9-f6507a9b37d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:37:15.578084 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:15.578084 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:15.578084 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:15.578084 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:15.578084 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:15.578084 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:15.578084 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:15.578084 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:15.578084 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:15.578084 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:15.578084 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:15.578084 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:37:15.578084 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:37:15.578084 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:37:15.578084 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:37:15.579004 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:37:15.579004 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:37:15.579004 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:37:15.579004 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:37:15.579004 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:15.579004 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:15.579004 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:15.579004 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:15.579004 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:15.579004 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:15.579004 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:15.579004 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:15.579004 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:15.579004 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:15.579004 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:15.579004 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:15.579858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:15.579858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:15.579858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:15.579858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:15.579858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:37:15.579858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:37:15.579858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:37:15.579858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:37:15.579858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:37:15.579858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:37:15.579858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:37:15.579858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:15.579858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 533/1071] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:37:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:37:15.586196 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce584339-2a57-4faf-8ab9-f6507a9b37d2 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:15.595819 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:15.605519 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:15.707663 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522215f9-30d9-4a99-9c95-d6172f2a2a09 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:15.712810 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce584339-2a57-4faf-8ab9-f6507a9b37d2 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:15.757084 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecedbfd-a133-4fcd-8f44-22fb98f23f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:15.757697 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8a307-7921-4e6b-b2d7-d83b60bd821f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:15.758287 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecedbfd-a133-4fcd-8f44-22fb98f23f45 None admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:15.758378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8a307-7921-4e6b-b2d7-d83b60bd821f None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:15.758453 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecedbfd-a133-4fcd-8f44-22fb98f23f45 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:15.758650 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecedbfd-a133-4fcd-8f44-22fb98f23f45 None admin] PATH_INFO: `/v3/projects/07652ced88cf4f069d1765176be5130b/users/a1e4c833a4684561ab52eda5734a7766/roles/d9b93606a9bb4ff7a13f81af237b9009` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:15.758756 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8a307-7921-4e6b-b2d7-d83b60bd821f None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:15.759054 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8a307-7921-4e6b-b2d7-d83b60bd821f None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:15.760020 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8a307-7921-4e6b-b2d7-d83b60bd821f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:15.760371 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8a307-7921-4e6b-b2d7-d83b60bd821f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:15.761544 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecedbfd-a133-4fcd-8f44-22fb98f23f45 None admin] RBAC: Authorizing `identity:create_grant(project_id=07652ced88cf4f069d1765176be5130b, user_id=a1e4c833a4684561ab52eda5734a7766, role_id=d9b93606a9bb4ff7a13f81af237b9009)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:15.761753 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8a307-7921-4e6b-b2d7-d83b60bd821f None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:15.763486 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecedbfd-a133-4fcd-8f44-22fb98f23f45 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:15.770878 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 534/1072] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:37:15 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:37:15.779366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8a307-7921-4e6b-b2d7-d83b60bd821f None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:15.856284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:15.882896 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8a307-7921-4e6b-b2d7-d83b60bd821f None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:15.899733 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 539/1073] 10.222.0.119 () {58 vars in 1444 bytes} [Thu Jul 14 15:37:15 2022] PUT /identity/v3/projects/07652ced88cf4f069d1765176be5130b/users/a1e4c833a4684561ab52eda5734a7766/roles/d9b93606a9bb4ff7a13f81af237b9009 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:15.918347 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe45f4-095f-4dab-89f2-076d130ae5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:15.919383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe45f4-095f-4dab-89f2-076d130ae5aa None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:15.919679 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe45f4-095f-4dab-89f2-076d130ae5aa None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:15.919956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe45f4-095f-4dab-89f2-076d130ae5aa None admin] PATH_INFO: `/v3/users/5efe4dc748c8444da600b7a927dbaa8f` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:15.937151 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe45f4-095f-4dab-89f2-076d130ae5aa None admin] RBAC: Authorizing `identity:get_user(user_id=5efe4dc748c8444da600b7a927dbaa8f)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:15.938616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe45f4-095f-4dab-89f2-076d130ae5aa None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:15.940485 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 535/1074] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:37:15 2022] GET /identity/v3/users/5efe4dc748c8444da600b7a927dbaa8f => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:37:15.946869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecedbfd-a133-4fcd-8f44-22fb98f23f45 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:16.025385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:16.066840 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecedbfd-a133-4fcd-8f44-22fb98f23f45 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:16.115999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cdfbc-e5d4-4026-9c2e-30af79d0b844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:16.116727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cdfbc-e5d4-4026-9c2e-30af79d0b844 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:16.117013 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cdfbc-e5d4-4026-9c2e-30af79d0b844 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:16.117292 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cdfbc-e5d4-4026-9c2e-30af79d0b844 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:16.183466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cdfbc-e5d4-4026-9c2e-30af79d0b844 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:16.184962 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cdfbc-e5d4-4026-9c2e-30af79d0b844 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:16.254424 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:16.284827 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 540/1075] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:37:15 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:37:16.291379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe45f4-095f-4dab-89f2-076d130ae5aa None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:16.392544 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe45f4-095f-4dab-89f2-076d130ae5aa None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:16.426432 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:16.431964 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd859a5b-410b-4f22-ad12-9435d079b902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:16.432784 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd859a5b-410b-4f22-ad12-9435d079b902 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:16.433099 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd859a5b-410b-4f22-ad12-9435d079b902 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:16.433388 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd859a5b-410b-4f22-ad12-9435d079b902 None admin] PATH_INFO: `/v3/projects/438eea1e4dfa4c9ba63b71d0b961d3a8` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:16.435812 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd859a5b-410b-4f22-ad12-9435d079b902 None admin] RBAC: Authorizing `identity:get_project(project_id=438eea1e4dfa4c9ba63b71d0b961d3a8)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:16.437293 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd859a5b-410b-4f22-ad12-9435d079b902 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:16.439124 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 536/1076] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:37:16 2022] GET /identity/v3/projects/438eea1e4dfa4c9ba63b71d0b961d3a8 => generated 312 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:16.446074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cdfbc-e5d4-4026-9c2e-30af79d0b844 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:16.550098 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cdfbc-e5d4-4026-9c2e-30af79d0b844 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:16.583275 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f71367-f58a-4e7d-b967-23e450533e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:16.583940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f71367-f58a-4e7d-b967-23e450533e1a None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:16.584263 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f71367-f58a-4e7d-b967-23e450533e1a None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:16.584577 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f71367-f58a-4e7d-b967-23e450533e1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:16.585415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f71367-f58a-4e7d-b967-23e450533e1a None admin] RBAC: Adding query filter params (role.id=07aaf007cde043318319928d151bdc75, scope.project.id=438eea1e4dfa4c9ba63b71d0b961d3a8, user.id=5efe4dc748c8444da600b7a927dbaa8f) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:16.586281 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f71367-f58a-4e7d-b967-23e450533e1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:16.587711 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f71367-f58a-4e7d-b967-23e450533e1a None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:16.604145 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 541/1077] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:37:16 2022] GET /identity/v3/role_assignments?user.id=5efe4dc748c8444da600b7a927dbaa8f&scope.project.id=438eea1e4dfa4c9ba63b71d0b961d3a8&role.id=07aaf007cde043318319928d151bdc75 => generated 260 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:37:18.035967 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc279332-f3b6-4663-9c23-728920b3d29e None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:18.036554 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc279332-f3b6-4663-9c23-728920b3d29e None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:18.036554 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc279332-f3b6-4663-9c23-728920b3d29e None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:18.037934 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 537/1078] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:18.044175 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a638290-04a9-4d90-b64a-1fae3e0618fa None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:18.044575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a638290-04a9-4d90-b64a-1fae3e0618fa None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:18.044873 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a638290-04a9-4d90-b64a-1fae3e0618fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:18.062312 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-7a638290-04a9-4d90-b64a-1fae3e0618fa None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:18.063496 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-7a638290-04a9-4d90-b64a-1fae3e0618fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:18.091978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:18.131198 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 542/1079] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:18 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:37:18.154228 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc279332-f3b6-4663-9c23-728920b3d29e None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:18.259422 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc279332-f3b6-4663-9c23-728920b3d29e None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:18.293844 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bee72-3778-4695-820a-cb23b51c7147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:18.294622 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bee72-3778-4695-820a-cb23b51c7147 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:18.294990 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bee72-3778-4695-820a-cb23b51c7147 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:18.295270 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bee72-3778-4695-820a-cb23b51c7147 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:18.305620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bee72-3778-4695-820a-cb23b51c7147 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:37:18.313858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-ee5bee72-3778-4695-820a-cb23b51c7147 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:37:18.313858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:18.313858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:18.313858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:18.313858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:18.313858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:18.313858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:18.313858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:18.313858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:18.313858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:18.313858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:18.313858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:18.313858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:37:18.313858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:37:18.313858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:37:18.313858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:37:18.314955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:37:18.314955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:37:18.314955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:37:18.314955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:37:18.314955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:18.314955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:18.314955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:18.314955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:18.314955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:18.314955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:18.314955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:18.314955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:18.314955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:18.314955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:18.314955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:18.314955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:18.316223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:18.316223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:18.316223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:18.316223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:18.316223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:37:18.316223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:37:18.316223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:37:18.316223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:37:18.316223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:37:18.316223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:37:18.316223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:37:18.316223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:18.316223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 538/1080] 10.222.0.119 () {56 vars in 1125 bytes} [Thu Jul 14 15:37:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:37:18.322149 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a638290-04a9-4d90-b64a-1fae3e0618fa None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:18.421327 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a638290-04a9-4d90-b64a-1fae3e0618fa None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:18.455000 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416bb8ee-5a0f-4a97-a5e9-82e9ba9ae39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:18.455666 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bb8ee-5a0f-4a97-a5e9-82e9ba9ae39d None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:18.455952 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bb8ee-5a0f-4a97-a5e9-82e9ba9ae39d None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:18.456290 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bb8ee-5a0f-4a97-a5e9-82e9ba9ae39d None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:18.457021 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416bb8ee-5a0f-4a97-a5e9-82e9ba9ae39d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:18.457331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416bb8ee-5a0f-4a97-a5e9-82e9ba9ae39d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:18.458731 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416bb8ee-5a0f-4a97-a5e9-82e9ba9ae39d None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:18.467108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 543/1081] 10.222.0.119 () {56 vars in 1120 bytes} [Thu Jul 14 15:37:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:18.473168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bee72-3778-4695-820a-cb23b51c7147 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:18.532913 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:18.575847 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bee72-3778-4695-820a-cb23b51c7147 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:18.608918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b282226-a73e-4f6a-934e-24e797dbf721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:18.609713 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b282226-a73e-4f6a-934e-24e797dbf721 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:18.609999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b282226-a73e-4f6a-934e-24e797dbf721 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:18.610279 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b282226-a73e-4f6a-934e-24e797dbf721 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:18.621386 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b282226-a73e-4f6a-934e-24e797dbf721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:18.622847 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b282226-a73e-4f6a-934e-24e797dbf721 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:18.637426 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68861b1e-e523-4bfe-a55a-599b7b0eb82e None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:18.637716 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68861b1e-e523-4bfe-a55a-599b7b0eb82e None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:18.638163 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68861b1e-e523-4bfe-a55a-599b7b0eb82e None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:18.639523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 544/1082] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:37:18.639623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-3b282226-a73e-4f6a-934e-24e797dbf721 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:37:18.639623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:18.639623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:18.639623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:18.639623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:18.639623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:18.639623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:18.639623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:18.639623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:18.639623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:18.639623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:18.639623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:18.639623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:37:18.639623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:37:18.639623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:37:18.640538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:37:18.640538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:18.640538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:18.640538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:18.640538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:18.640538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:18.640538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:18.640538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:18.640538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:18.640538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:18.640538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:18.640538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:18.640538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:18.640538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:18.640538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:18.640538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:18.640538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:18.641430 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:37:18.641430 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:37:18.641430 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:37:18.641430 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:18.641430 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 539/1083] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:37:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:37:18.644977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfaba58-2913-4a3f-acc2-a95d7b8e6e98 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:18.645268 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfaba58-2913-4a3f-acc2-a95d7b8e6e98 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:18.645551 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfaba58-2913-4a3f-acc2-a95d7b8e6e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:18.646285 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b282226-a73e-4f6a-934e-24e797dbf721 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:18.661728 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-edfaba58-2913-4a3f-acc2-a95d7b8e6e98 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:18.662912 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-edfaba58-2913-4a3f-acc2-a95d7b8e6e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:18.686694 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:18.731218 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 545/1084] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:18 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:37:18.746612 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b282226-a73e-4f6a-934e-24e797dbf721 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:18.754639 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfaba58-2913-4a3f-acc2-a95d7b8e6e98 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:18.760218 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:18.780903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf809aa-86bd-496d-8d57-094fec98b064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:18.781567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf809aa-86bd-496d-8d57-094fec98b064 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:18.781849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf809aa-86bd-496d-8d57-094fec98b064 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:18.782123 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf809aa-86bd-496d-8d57-094fec98b064 None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:18.782843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf809aa-86bd-496d-8d57-094fec98b064 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:18.783146 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf809aa-86bd-496d-8d57-094fec98b064 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:18.784534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf809aa-86bd-496d-8d57-094fec98b064 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:18.796653 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 540/1085] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:37:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:37:18.802233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf809aa-86bd-496d-8d57-094fec98b064 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:19.005705 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfaba58-2913-4a3f-acc2-a95d7b8e6e98 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:19.039469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664cff0e-c337-4066-a655-352735d3999f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:19.040313 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cff0e-c337-4066-a655-352735d3999f None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:19.040602 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cff0e-c337-4066-a655-352735d3999f None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:19.040884 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cff0e-c337-4066-a655-352735d3999f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:19.041914 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf809aa-86bd-496d-8d57-094fec98b064 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:19.050850 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664cff0e-c337-4066-a655-352735d3999f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:37:19.059322 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-664cff0e-c337-4066-a655-352735d3999f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:37:19.059322 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:19.059322 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:19.059322 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:19.059322 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:19.059322 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:19.059322 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:19.059322 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:19.059322 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:19.059322 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:19.059322 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:19.059322 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:19.059322 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:37:19.059322 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:37:19.059322 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:37:19.059322 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:37:19.060389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:37:19.060389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:37:19.060389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:37:19.060389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:37:19.060389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:19.060389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:19.060389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:19.060389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:19.060389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:19.060389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:19.060389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:19.060389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:19.060389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:19.060389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:19.060389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:19.060389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:19.061523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:19.061523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:19.061523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:19.061523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:19.061523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:37:19.061523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:37:19.061523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:37:19.061523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:37:19.061523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:37:19.061523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:37:19.061523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:37:19.061523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:37:19.061523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 546/1086] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:37:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:37:19.066555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664cff0e-c337-4066-a655-352735d3999f None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:19.079881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4adbd-75e0-41c5-a2da-74ed81f274e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:19.080708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4adbd-75e0-41c5-a2da-74ed81f274e2 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:19.080993 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4adbd-75e0-41c5-a2da-74ed81f274e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:19.081273 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4adbd-75e0-41c5-a2da-74ed81f274e2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:19.086523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:19.088958 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4adbd-75e0-41c5-a2da-74ed81f274e2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:19.090395 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4adbd-75e0-41c5-a2da-74ed81f274e2 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:19.105833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-2db4adbd-75e0-41c5-a2da-74ed81f274e2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:37:19.105833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:19.105833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:19.105833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:19.105833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:19.105833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:19.105833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:19.105833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:19.105833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:19.105833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:19.105833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:19.105833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:19.105833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:37:19.105833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:37:19.105833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:37:19.105833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:37:19.106820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:19.106820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:19.106820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:37:19.106820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:37:19.106820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:37:19.106820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:37:19.106820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:19.106820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:19.106820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:19.106820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:19.106820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:19.106820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:19.106820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:19.106820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:19.106820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:19.106820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:19.106820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:19.106820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:19.107770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:19.107770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:19.107770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:37:19.107770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:37:19.107770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:37:19.107770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:37:19.107770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:37:19.107770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:37:19.107770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:37:19.107770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:19.107770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 541/1087] 10.222.0.119 () {56 vars in 1098 bytes} [Thu Jul 14 15:37:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:37:19.112645 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4adbd-75e0-41c5-a2da-74ed81f274e2 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:19.142946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:19.170940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664cff0e-c337-4066-a655-352735d3999f None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:19.204622 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c76d1f-49e0-405a-a25a-f58e60e06fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:19.205292 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c76d1f-49e0-405a-a25a-f58e60e06fbc None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:19.205574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c76d1f-49e0-405a-a25a-f58e60e06fbc None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:19.205860 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c76d1f-49e0-405a-a25a-f58e60e06fbc None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:19.206640 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c76d1f-49e0-405a-a25a-f58e60e06fbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:19.206950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c76d1f-49e0-405a-a25a-f58e60e06fbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:19.208344 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c76d1f-49e0-405a-a25a-f58e60e06fbc None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:19.212014 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4adbd-75e0-41c5-a2da-74ed81f274e2 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:19.217277 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 547/1088] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:37:19 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:37:19.223250 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c76d1f-49e0-405a-a25a-f58e60e06fbc None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:19.246517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3242f9f-691c-4f33-a43b-bb3cdd484326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:19.247192 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3242f9f-691c-4f33-a43b-bb3cdd484326 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:19.247481 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3242f9f-691c-4f33-a43b-bb3cdd484326 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:19.247762 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3242f9f-691c-4f33-a43b-bb3cdd484326 None admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:19.248640 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3242f9f-691c-4f33-a43b-bb3cdd484326 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:19.248960 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3242f9f-691c-4f33-a43b-bb3cdd484326 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:19.250384 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3242f9f-691c-4f33-a43b-bb3cdd484326 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:19.268632 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 542/1089] 10.222.0.119 () {56 vars in 1138 bytes} [Thu Jul 14 15:37:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:37:19.274959 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3242f9f-691c-4f33-a43b-bb3cdd484326 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:19.305388 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:19.323790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c76d1f-49e0-405a-a25a-f58e60e06fbc None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:19.359185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b730a5-5a5d-43c2-8a8d-c0a3fdbada73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:19.360063 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b730a5-5a5d-43c2-8a8d-c0a3fdbada73 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:19.360372 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b730a5-5a5d-43c2-8a8d-c0a3fdbada73 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:19.360642 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b730a5-5a5d-43c2-8a8d-c0a3fdbada73 None admin] PATH_INFO: `/v3/users/5efe4dc748c8444da600b7a927dbaa8f` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:19.361828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b730a5-5a5d-43c2-8a8d-c0a3fdbada73 None admin] RBAC: Authorizing `identity:get_user(user_id=5efe4dc748c8444da600b7a927dbaa8f)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:19.363284 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b730a5-5a5d-43c2-8a8d-c0a3fdbada73 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:19.365139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 548/1090] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:37:19 2022] GET /identity/v3/users/5efe4dc748c8444da600b7a927dbaa8f => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:37:19.365369 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:19.371494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b730a5-5a5d-43c2-8a8d-c0a3fdbada73 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:19.377094 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3242f9f-691c-4f33-a43b-bb3cdd484326 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:19.409408 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc6067-d49e-4be0-a63c-e9255f56586d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:19.410079 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc6067-d49e-4be0-a63c-e9255f56586d None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:19.410363 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc6067-d49e-4be0-a63c-e9255f56586d None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:19.410639 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc6067-d49e-4be0-a63c-e9255f56586d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:19.472571 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b730a5-5a5d-43c2-8a8d-c0a3fdbada73 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:19.480857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc6067-d49e-4be0-a63c-e9255f56586d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:19.482680 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc6067-d49e-4be0-a63c-e9255f56586d None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:19.515501 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84f319-5476-45b2-b57c-57f281635125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:19.516778 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84f319-5476-45b2-b57c-57f281635125 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:19.516778 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84f319-5476-45b2-b57c-57f281635125 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:19.516949 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84f319-5476-45b2-b57c-57f281635125 None admin] PATH_INFO: `/v3/projects/438eea1e4dfa4c9ba63b71d0b961d3a8` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:19.518107 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84f319-5476-45b2-b57c-57f281635125 None admin] RBAC: Authorizing `identity:get_project(project_id=438eea1e4dfa4c9ba63b71d0b961d3a8)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:19.519633 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84f319-5476-45b2-b57c-57f281635125 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:19.521313 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 549/1091] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:37:19 2022] GET /identity/v3/projects/438eea1e4dfa4c9ba63b71d0b961d3a8 => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:37:19.528021 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84f319-5476-45b2-b57c-57f281635125 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:19.546560 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:19.575599 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:19.586620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 543/1092] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:37:19 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:37:19.592647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc6067-d49e-4be0-a63c-e9255f56586d None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:19.629792 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84f319-5476-45b2-b57c-57f281635125 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:19.664387 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864062a-8948-4282-b569-b9631ca19974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:19.665284 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864062a-8948-4282-b569-b9631ca19974 None admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:19.665673 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864062a-8948-4282-b569-b9631ca19974 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:19.665958 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864062a-8948-4282-b569-b9631ca19974 None admin] PATH_INFO: `/v3/projects/438eea1e4dfa4c9ba63b71d0b961d3a8/users/5efe4dc748c8444da600b7a927dbaa8f/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:19.667967 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8864062a-8948-4282-b569-b9631ca19974 None admin] RBAC: Authorizing `identity:create_grant(project_id=438eea1e4dfa4c9ba63b71d0b961d3a8, user_id=5efe4dc748c8444da600b7a927dbaa8f, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:19.669430 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8864062a-8948-4282-b569-b9631ca19974 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:19.690678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc6067-d49e-4be0-a63c-e9255f56586d None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:19.724189 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b830af8-4746-4f5f-993d-6a502e3a0374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:19.724985 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b830af8-4746-4f5f-993d-6a502e3a0374 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:19.725272 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b830af8-4746-4f5f-993d-6a502e3a0374 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:19.725565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b830af8-4746-4f5f-993d-6a502e3a0374 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:19.736074 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b830af8-4746-4f5f-993d-6a502e3a0374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:19.737574 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b830af8-4746-4f5f-993d-6a502e3a0374 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:19.750562 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 550/1093] 10.222.0.119 () {58 vars in 1444 bytes} [Thu Jul 14 15:37:19 2022] PUT /identity/v3/projects/438eea1e4dfa4c9ba63b71d0b961d3a8/users/5efe4dc748c8444da600b7a927dbaa8f/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:19.756188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-2b830af8-4746-4f5f-993d-6a502e3a0374 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:37:19.756188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:19.756188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:19.756188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:19.756188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:19.756188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:19.756188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:19.756188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:19.756188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:19.756188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:19.756188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:19.756188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:19.756188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:37:19.756188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:37:19.756188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:37:19.757354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:37:19.757354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:19.757354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:19.757354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:19.757354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:19.757354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:19.757354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:19.757354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:19.757354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:19.757354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:19.757354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:19.757354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:19.757354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:19.757354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:19.757354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:19.757354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:19.757354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:19.763960 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:37:19.763960 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:37:19.763960 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:37:19.763960 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:19.763960 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 544/1094] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:37:19.765118 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864062a-8948-4282-b569-b9631ca19974 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:19.860533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:19.885449 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864062a-8948-4282-b569-b9631ca19974 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:19.921884 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2deff-3726-4c28-b15a-71b886c78654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:19.922559 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2deff-3726-4c28-b15a-71b886c78654 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:19.922843 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2deff-3726-4c28-b15a-71b886c78654 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:19.923123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2deff-3726-4c28-b15a-71b886c78654 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:19.923855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f2deff-3726-4c28-b15a-71b886c78654 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:19.924197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f2deff-3726-4c28-b15a-71b886c78654 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:19.925573 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f2deff-3726-4c28-b15a-71b886c78654 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:19.938734 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 551/1095] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:37:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:19.944532 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b830af8-4746-4f5f-993d-6a502e3a0374 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:19.989047 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:20.049665 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b830af8-4746-4f5f-993d-6a502e3a0374 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:20.084908 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b540b85-bcd5-41b5-9c8a-e693ea01478a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:20.086171 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b540b85-bcd5-41b5-9c8a-e693ea01478a None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:20.086463 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b540b85-bcd5-41b5-9c8a-e693ea01478a None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:20.086747 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b540b85-bcd5-41b5-9c8a-e693ea01478a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:20.093739 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b540b85-bcd5-41b5-9c8a-e693ea01478a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:20.095179 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b540b85-bcd5-41b5-9c8a-e693ea01478a None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:20.110049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-6b540b85-bcd5-41b5-9c8a-e693ea01478a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:37:20.110049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:20.110049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:20.110049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:20.110049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:20.110049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:20.110049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:20.110049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:20.110049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:20.110049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:20.110049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:20.110049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:20.110049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:37:20.110049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:37:20.110049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:37:20.111194 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:37:20.111194 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:20.111194 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:20.111194 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:20.111194 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:20.111194 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:20.111194 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:20.111194 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:20.111194 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:20.111194 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:20.111194 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:20.111194 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:20.111194 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:20.111194 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:20.111194 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:20.111194 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:20.111194 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:20.112563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:37:20.112563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:37:20.112563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:37:20.112563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:37:20.112563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:37:20.112563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:37:20.112563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:37:20.112563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:20.112563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 545/1096] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:37:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:37:20.120523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2deff-3726-4c28-b15a-71b886c78654 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:20.222902 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2deff-3726-4c28-b15a-71b886c78654 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:20.259171 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1278f16-4738-421f-85b7-764c8ec64bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:20.260226 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1278f16-4738-421f-85b7-764c8ec64bcd None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:20.260522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1278f16-4738-421f-85b7-764c8ec64bcd None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:20.260808 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1278f16-4738-421f-85b7-764c8ec64bcd None admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:20.261601 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1278f16-4738-421f-85b7-764c8ec64bcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:20.261919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1278f16-4738-421f-85b7-764c8ec64bcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:20.263363 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1278f16-4738-421f-85b7-764c8ec64bcd None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:20.265953 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:20.275985 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 552/1097] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:37:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:20.282001 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b540b85-bcd5-41b5-9c8a-e693ea01478a None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:20.383739 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b540b85-bcd5-41b5-9c8a-e693ea01478a None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:20.385231 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:20.417883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f246f-6008-4823-8b1f-b3d7ac768463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:20.418535 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f246f-6008-4823-8b1f-b3d7ac768463 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:20.418819 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f246f-6008-4823-8b1f-b3d7ac768463 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:20.419096 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f246f-6008-4823-8b1f-b3d7ac768463 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:20.419917 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f246f-6008-4823-8b1f-b3d7ac768463 None admin] RBAC: Adding query filter params (role.id=d9b93606a9bb4ff7a13f81af237b9009, scope.project.id=07652ced88cf4f069d1765176be5130b, user.id=a1e4c833a4684561ab52eda5734a7766) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:20.420259 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f246f-6008-4823-8b1f-b3d7ac768463 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:20.421673 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f246f-6008-4823-8b1f-b3d7ac768463 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:20.440139 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 546/1098] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:37:20 2022] GET /identity/v3/role_assignments?user.id=a1e4c833a4684561ab52eda5734a7766&scope.project.id=07652ced88cf4f069d1765176be5130b&role.id=d9b93606a9bb4ff7a13f81af237b9009 => generated 610 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:21.808825 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f5ce0-b8cb-4e3e-abf3-a713ca3b97e9 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:21.809381 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f5ce0-b8cb-4e3e-abf3-a713ca3b97e9 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:21.809381 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f5ce0-b8cb-4e3e-abf3-a713ca3b97e9 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:21.810694 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 553/1099] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:21.815730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bfb17-43c0-4170-98d9-43df5a712f4d None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:21.816206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bfb17-43c0-4170-98d9-43df5a712f4d None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:21.816308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bfb17-43c0-4170-98d9-43df5a712f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:21.833191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-322bfb17-43c0-4170-98d9-43df5a712f4d None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:21.834355 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-322bfb17-43c0-4170-98d9-43df5a712f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:21.899141 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 547/1100] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:21 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:37:21.922439 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f5ce0-b8cb-4e3e-abf3-a713ca3b97e9 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:22.021768 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f5ce0-b8cb-4e3e-abf3-a713ca3b97e9 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:22.055246 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0ab87-7574-4151-b6e6-ff1a308a0e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:22.056027 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0ab87-7574-4151-b6e6-ff1a308a0e23 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:22.056339 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0ab87-7574-4151-b6e6-ff1a308a0e23 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:22.056616 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0ab87-7574-4151-b6e6-ff1a308a0e23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:22.067050 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0ab87-7574-4151-b6e6-ff1a308a0e23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:37:22.074895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-09c0ab87-7574-4151-b6e6-ff1a308a0e23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:37:22.074895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:22.074895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:22.074895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:22.074895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:22.074895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:22.074895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:22.074895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:22.074895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:22.074895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:22.074895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:22.074895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:22.074895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:37:22.074895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:37:22.074895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:37:22.074895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:37:22.076069 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:37:22.076069 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:37:22.076069 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:37:22.076069 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:37:22.076069 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:22.076069 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:22.076069 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:22.076069 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:22.076069 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:22.076069 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:22.076069 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:22.076069 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:22.076069 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:22.076069 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:22.076069 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:22.076069 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:22.077224 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:22.077224 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:22.077224 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:22.077224 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:22.077224 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:37:22.077224 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:37:22.077224 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:37:22.077224 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:37:22.077224 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:37:22.077224 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:37:22.077224 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:37:22.077224 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:37:22.077224 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 554/1101] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:37:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:37:22.082083 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bfb17-43c0-4170-98d9-43df5a712f4d None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:22.172620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:22.178106 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bfb17-43c0-4170-98d9-43df5a712f4d None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:22.211638 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25736b46-85ea-4ce9-805d-d4dc569fce7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:22.212369 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25736b46-85ea-4ce9-805d-d4dc569fce7e None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:22.212849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25736b46-85ea-4ce9-805d-d4dc569fce7e None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:22.213295 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25736b46-85ea-4ce9-805d-d4dc569fce7e None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:22.214361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25736b46-85ea-4ce9-805d-d4dc569fce7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:22.214670 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25736b46-85ea-4ce9-805d-d4dc569fce7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:22.216044 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25736b46-85ea-4ce9-805d-d4dc569fce7e None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:22.224196 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 548/1102] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:37:22 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:22.230551 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0ab87-7574-4151-b6e6-ff1a308a0e23 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:22.287002 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:22.330457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0ab87-7574-4151-b6e6-ff1a308a0e23 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:22.364375 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8593d2b-3f39-4a0f-81a8-cecc0ceb74d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:22.365234 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8593d2b-3f39-4a0f-81a8-cecc0ceb74d3 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:22.365513 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8593d2b-3f39-4a0f-81a8-cecc0ceb74d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:22.365783 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8593d2b-3f39-4a0f-81a8-cecc0ceb74d3 None admin] PATH_INFO: `/v3/users/5efe4dc748c8444da600b7a927dbaa8f` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:22.366999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8593d2b-3f39-4a0f-81a8-cecc0ceb74d3 None admin] RBAC: Authorizing `identity:get_user(user_id=5efe4dc748c8444da600b7a927dbaa8f)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:22.368467 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8593d2b-3f39-4a0f-81a8-cecc0ceb74d3 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:22.370103 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 555/1103] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:37:22 2022] GET /identity/v3/users/5efe4dc748c8444da600b7a927dbaa8f => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:22.375836 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25736b46-85ea-4ce9-805d-d4dc569fce7e None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:22.473087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25736b46-85ea-4ce9-805d-d4dc569fce7e None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:22.505417 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca540db-9211-465a-b835-fb38c0121d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:22.506091 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca540db-9211-465a-b835-fb38c0121d23 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:22.506373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca540db-9211-465a-b835-fb38c0121d23 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:22.506652 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca540db-9211-465a-b835-fb38c0121d23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:22.533746 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:22.572967 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca540db-9211-465a-b835-fb38c0121d23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:22.574394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca540db-9211-465a-b835-fb38c0121d23 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:22.667903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 549/1104] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:37:22 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:37:22.673719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8593d2b-3f39-4a0f-81a8-cecc0ceb74d3 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:22.770162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8593d2b-3f39-4a0f-81a8-cecc0ceb74d3 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:22.795324 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:22.805682 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9bfdd-56e7-4bba-a1a5-0c66752b298e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:22.806537 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9bfdd-56e7-4bba-a1a5-0c66752b298e None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:22.806827 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9bfdd-56e7-4bba-a1a5-0c66752b298e None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:22.807102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9bfdd-56e7-4bba-a1a5-0c66752b298e None admin] PATH_INFO: `/v3/projects/438eea1e4dfa4c9ba63b71d0b961d3a8` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:22.808303 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9bfdd-56e7-4bba-a1a5-0c66752b298e None admin] RBAC: Authorizing `identity:get_project(project_id=438eea1e4dfa4c9ba63b71d0b961d3a8)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:22.809765 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9bfdd-56e7-4bba-a1a5-0c66752b298e None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:22.811462 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 556/1105] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:37:22 2022] GET /identity/v3/projects/438eea1e4dfa4c9ba63b71d0b961d3a8 => generated 312 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:22.817698 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca540db-9211-465a-b835-fb38c0121d23 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:22.874809 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:22.914811 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca540db-9211-465a-b835-fb38c0121d23 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:22.947582 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a643c-7886-4679-ae75-2575c99bf654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:22.948203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a643c-7886-4679-ae75-2575c99bf654 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:22.948492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a643c-7886-4679-ae75-2575c99bf654 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:22.948771 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a643c-7886-4679-ae75-2575c99bf654 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:22.949599 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a643c-7886-4679-ae75-2575c99bf654 None admin] RBAC: Adding query filter params (role.id=07aaf007cde043318319928d151bdc75, scope.project.id=438eea1e4dfa4c9ba63b71d0b961d3a8, user.id=5efe4dc748c8444da600b7a927dbaa8f) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:22.949915 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a643c-7886-4679-ae75-2575c99bf654 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:22.951333 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a643c-7886-4679-ae75-2575c99bf654 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:22.957199 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 550/1106] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:37:22 2022] GET /identity/v3/role_assignments?user.id=5efe4dc748c8444da600b7a927dbaa8f&scope.project.id=438eea1e4dfa4c9ba63b71d0b961d3a8&role.id=07aaf007cde043318319928d151bdc75 => generated 610 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:24.990477 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0e762-2c0d-40e8-b662-68ff384db96c None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:24.991029 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0e762-2c0d-40e8-b662-68ff384db96c None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:24.991029 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0e762-2c0d-40e8-b662-68ff384db96c None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:24.993059 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 557/1107] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:24 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:24.998331 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc533c-ccd5-4630-a5e2-627977b78347 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:24.998757 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc533c-ccd5-4630-a5e2-627977b78347 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:24.998888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc533c-ccd5-4630-a5e2-627977b78347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:25.016029 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-2fdc533c-ccd5-4630-a5e2-627977b78347 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:25.017298 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-2fdc533c-ccd5-4630-a5e2-627977b78347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:25.082056 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 551/1108] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:24 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:37:25.107479 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0e762-2c0d-40e8-b662-68ff384db96c None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:25.206131 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0e762-2c0d-40e8-b662-68ff384db96c None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:25.239235 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23bc57-bfa6-46fb-9e67-28863c62f50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:25.240022 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23bc57-bfa6-46fb-9e67-28863c62f50e None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:25.240341 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23bc57-bfa6-46fb-9e67-28863c62f50e None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:25.240666 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23bc57-bfa6-46fb-9e67-28863c62f50e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:25.241791 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23bc57-bfa6-46fb-9e67-28863c62f50e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:25.243820 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23bc57-bfa6-46fb-9e67-28863c62f50e None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:25.245456 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 558/1109] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:37:25 2022] GET /identity/v3/domains/default => generated 200 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:25.251318 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc533c-ccd5-4630-a5e2-627977b78347 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:25.302018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:25.353435 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc533c-ccd5-4630-a5e2-627977b78347 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:25.387343 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83e408-cdda-40ee-9010-e1e286f84479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:25.388009 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83e408-cdda-40ee-9010-e1e286f84479 None admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:25.388318 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83e408-cdda-40ee-9010-e1e286f84479 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:25.388597 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83e408-cdda-40ee-9010-e1e286f84479 None admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:25.389310 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83e408-cdda-40ee-9010-e1e286f84479 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:25.390730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83e408-cdda-40ee-9010-e1e286f84479 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:25.499335 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 552/1110] 10.222.0.119 () {60 vars in 1137 bytes} [Thu Jul 14 15:37:25 2022] POST /identity/v3/users => generated 287 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:27.582751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa7f76-6cc3-40e1-adef-d726fe59cc43 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:27.583287 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa7f76-6cc3-40e1-adef-d726fe59cc43 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:27.583380 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa7f76-6cc3-40e1-adef-d726fe59cc43 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:27.584711 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 559/1111] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:27.589816 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb4e37-81bf-4519-878c-9a6b3d371f3f None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:27.590268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb4e37-81bf-4519-878c-9a6b3d371f3f None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:27.590362 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb4e37-81bf-4519-878c-9a6b3d371f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:27.608326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-e4eb4e37-81bf-4519-878c-9a6b3d371f3f None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:27.609513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-e4eb4e37-81bf-4519-878c-9a6b3d371f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:27.675885 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 553/1112] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:27 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:37:27.699681 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa7f76-6cc3-40e1-adef-d726fe59cc43 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:27.760400 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:27.801225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa7f76-6cc3-40e1-adef-d726fe59cc43 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:27.834609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873ebeb-094d-4b56-ae77-1a983412a57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:27.835462 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873ebeb-094d-4b56-ae77-1a983412a57f None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:27.835833 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873ebeb-094d-4b56-ae77-1a983412a57f None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:27.836209 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873ebeb-094d-4b56-ae77-1a983412a57f None admin] PATH_INFO: `/v3/roles/71b77f014251450eac200e62300144ab` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:27.837685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873ebeb-094d-4b56-ae77-1a983412a57f None admin] RBAC: Authorizing `identity:get_role(role_id=71b77f014251450eac200e62300144ab)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:27.839051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873ebeb-094d-4b56-ae77-1a983412a57f None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:27.840486 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 560/1113] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:37:27 2022] GET /identity/v3/roles/71b77f014251450eac200e62300144ab => generated 224 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:27.846704 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb4e37-81bf-4519-878c-9a6b3d371f3f None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:27.885739 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:27.943466 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb4e37-81bf-4519-878c-9a6b3d371f3f None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:27.978324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26d72e-c8cf-452b-98da-0edab0a425fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:27.979191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26d72e-c8cf-452b-98da-0edab0a425fb None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:27.979479 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26d72e-c8cf-452b-98da-0edab0a425fb None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:27.979760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26d72e-c8cf-452b-98da-0edab0a425fb None admin] PATH_INFO: `/v3/users/f5a827bc183e4d6bb75f111b4a1cd160` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:27.992665 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26d72e-c8cf-452b-98da-0edab0a425fb None admin] RBAC: Authorizing `identity:get_user(user_id=f5a827bc183e4d6bb75f111b4a1cd160)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:27.994101 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26d72e-c8cf-452b-98da-0edab0a425fb None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:27.995767 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 554/1114] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:37:27 2022] GET /identity/v3/users/f5a827bc183e4d6bb75f111b4a1cd160 => generated 287 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:28.001550 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873ebeb-094d-4b56-ae77-1a983412a57f None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:28.097826 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873ebeb-094d-4b56-ae77-1a983412a57f None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:28.123651 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:28.131188 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac78cd-aa39-48e4-a31d-d7b2d9b5f953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:28.131888 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac78cd-aa39-48e4-a31d-d7b2d9b5f953 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:28.132207 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac78cd-aa39-48e4-a31d-d7b2d9b5f953 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:28.137866 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac78cd-aa39-48e4-a31d-d7b2d9b5f953 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:28.198756 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac78cd-aa39-48e4-a31d-d7b2d9b5f953 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:28.200233 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac78cd-aa39-48e4-a31d-d7b2d9b5f953 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:28.295836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 561/1115] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:37:28 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:37:28.301738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26d72e-c8cf-452b-98da-0edab0a425fb None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:28.399109 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:28.404541 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26d72e-c8cf-452b-98da-0edab0a425fb None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:28.438425 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a43d66-914e-4237-87c3-8f508d2022fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:28.439286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a43d66-914e-4237-87c3-8f508d2022fd None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:28.439574 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a43d66-914e-4237-87c3-8f508d2022fd None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:28.439852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a43d66-914e-4237-87c3-8f508d2022fd None admin] PATH_INFO: `/v3/projects/438eea1e4dfa4c9ba63b71d0b961d3a8` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:28.441049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a43d66-914e-4237-87c3-8f508d2022fd None admin] RBAC: Authorizing `identity:get_project(project_id=438eea1e4dfa4c9ba63b71d0b961d3a8)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:28.442472 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a43d66-914e-4237-87c3-8f508d2022fd None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:28.444193 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 555/1116] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:37:28 2022] GET /identity/v3/projects/438eea1e4dfa4c9ba63b71d0b961d3a8 => generated 312 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:28.450562 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac78cd-aa39-48e4-a31d-d7b2d9b5f953 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:28.477673 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:28.548044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac78cd-aa39-48e4-a31d-d7b2d9b5f953 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:28.581261 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6895b-1c84-4023-89d1-40a0dd4c4f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:28.581908 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6895b-1c84-4023-89d1-40a0dd4c4f37 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:28.582194 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6895b-1c84-4023-89d1-40a0dd4c4f37 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:28.582472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6895b-1c84-4023-89d1-40a0dd4c4f37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:28.583297 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6895b-1c84-4023-89d1-40a0dd4c4f37 None admin] RBAC: Adding query filter params (role.id=71b77f014251450eac200e62300144ab, scope.project.id=438eea1e4dfa4c9ba63b71d0b961d3a8, user.id=f5a827bc183e4d6bb75f111b4a1cd160) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:28.583809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6895b-1c84-4023-89d1-40a0dd4c4f37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:28.585062 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6895b-1c84-4023-89d1-40a0dd4c4f37 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:28.590397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 562/1117] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:37:28 2022] GET /identity/v3/role_assignments?user.id=f5a827bc183e4d6bb75f111b4a1cd160&scope.project.id=438eea1e4dfa4c9ba63b71d0b961d3a8&role.id=71b77f014251450eac200e62300144ab => generated 260 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:30.645550 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535faaac-48a2-466a-8666-36ad1c33f808 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:30.646090 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535faaac-48a2-466a-8666-36ad1c33f808 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:30.646090 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535faaac-48a2-466a-8666-36ad1c33f808 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:30.647469 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 556/1118] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:30.653214 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792e170-8602-492f-bb96-cafb31b70c26 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:30.653615 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792e170-8602-492f-bb96-cafb31b70c26 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:30.653794 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792e170-8602-492f-bb96-cafb31b70c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:30.671759 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-7792e170-8602-492f-bb96-cafb31b70c26 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:30.672975 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-7792e170-8602-492f-bb96-cafb31b70c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:30.738890 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 563/1119] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:30 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:37:30.761145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535faaac-48a2-466a-8666-36ad1c33f808 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:30.861169 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535faaac-48a2-466a-8666-36ad1c33f808 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:30.894022 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95911fb4-8e1c-4c51-9809-09d50dc943ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:30.894867 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95911fb4-8e1c-4c51-9809-09d50dc943ea None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:30.895148 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95911fb4-8e1c-4c51-9809-09d50dc943ea None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:30.895424 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95911fb4-8e1c-4c51-9809-09d50dc943ea None admin] PATH_INFO: `/v3/roles/71b77f014251450eac200e62300144ab` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:30.896918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95911fb4-8e1c-4c51-9809-09d50dc943ea None admin] RBAC: Authorizing `identity:get_role(role_id=71b77f014251450eac200e62300144ab)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:30.898315 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95911fb4-8e1c-4c51-9809-09d50dc943ea None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:30.899716 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 557/1120] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:37:30 2022] GET /identity/v3/roles/71b77f014251450eac200e62300144ab => generated 224 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:30.905690 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792e170-8602-492f-bb96-cafb31b70c26 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:30.930357 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:31.004065 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792e170-8602-492f-bb96-cafb31b70c26 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:31.037051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516991f-e369-400d-913b-135531263b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:31.037914 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516991f-e369-400d-913b-135531263b95 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:31.038200 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516991f-e369-400d-913b-135531263b95 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:31.038477 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516991f-e369-400d-913b-135531263b95 None admin] PATH_INFO: `/v3/users/f5a827bc183e4d6bb75f111b4a1cd160` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:31.040536 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516991f-e369-400d-913b-135531263b95 None admin] RBAC: Authorizing `identity:get_user(user_id=f5a827bc183e4d6bb75f111b4a1cd160)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:31.041970 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516991f-e369-400d-913b-135531263b95 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:31.043594 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 564/1121] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:37:30 2022] GET /identity/v3/users/f5a827bc183e4d6bb75f111b4a1cd160 => generated 287 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:31.049383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95911fb4-8e1c-4c51-9809-09d50dc943ea None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:31.079487 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:31.146009 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95911fb4-8e1c-4c51-9809-09d50dc943ea None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:31.180361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421742f-baaa-42b3-942b-2a442d641a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:31.181244 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421742f-baaa-42b3-942b-2a442d641a6d None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:31.181522 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421742f-baaa-42b3-942b-2a442d641a6d None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:31.181792 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421742f-baaa-42b3-942b-2a442d641a6d None admin] PATH_INFO: `/v3/projects/438eea1e4dfa4c9ba63b71d0b961d3a8` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:31.182974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421742f-baaa-42b3-942b-2a442d641a6d None admin] RBAC: Authorizing `identity:get_project(project_id=438eea1e4dfa4c9ba63b71d0b961d3a8)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:31.184417 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421742f-baaa-42b3-942b-2a442d641a6d None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:31.186110 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 558/1122] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:37:31 2022] GET /identity/v3/projects/438eea1e4dfa4c9ba63b71d0b961d3a8 => generated 312 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:31.192173 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516991f-e369-400d-913b-135531263b95 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:31.280218 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:31.289918 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516991f-e369-400d-913b-135531263b95 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:31.322380 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf262f-2f5e-4bad-99ba-42fdce96cbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:31.323274 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf262f-2f5e-4bad-99ba-42fdce96cbf2 None admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:31.323748 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf262f-2f5e-4bad-99ba-42fdce96cbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:31.324222 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf262f-2f5e-4bad-99ba-42fdce96cbf2 None admin] PATH_INFO: `/v3/projects/438eea1e4dfa4c9ba63b71d0b961d3a8/users/f5a827bc183e4d6bb75f111b4a1cd160/roles/71b77f014251450eac200e62300144ab` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:31.326680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf262f-2f5e-4bad-99ba-42fdce96cbf2 None admin] RBAC: Authorizing `identity:create_grant(project_id=438eea1e4dfa4c9ba63b71d0b961d3a8, user_id=f5a827bc183e4d6bb75f111b4a1cd160, role_id=71b77f014251450eac200e62300144ab)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:31.328128 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf262f-2f5e-4bad-99ba-42fdce96cbf2 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:31.402777 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 565/1123] 10.222.0.119 () {58 vars in 1444 bytes} [Thu Jul 14 15:37:31 2022] PUT /identity/v3/projects/438eea1e4dfa4c9ba63b71d0b961d3a8/users/f5a827bc183e4d6bb75f111b4a1cd160/roles/71b77f014251450eac200e62300144ab => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:33.576490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7b254-588e-4c3b-a789-886c871f9d3b None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:33.576989 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7b254-588e-4c3b-a789-886c871f9d3b None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:33.577077 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7b254-588e-4c3b-a789-886c871f9d3b None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:33.578401 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 559/1124] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:33.583454 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f767d-56f4-4d59-956e-a51e387700b3 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:33.583825 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f767d-56f4-4d59-956e-a51e387700b3 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:33.584022 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f767d-56f4-4d59-956e-a51e387700b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:33.600430 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-268f767d-56f4-4d59-956e-a51e387700b3 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:33.602200 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-268f767d-56f4-4d59-956e-a51e387700b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:33.667233 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 566/1125] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:33 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:37:33.691107 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7b254-588e-4c3b-a789-886c871f9d3b None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:33.787699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:33.792154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7b254-588e-4c3b-a789-886c871f9d3b None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:33.826066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202e235-4983-44ad-bf58-4b8ff987112e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:33.826916 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202e235-4983-44ad-bf58-4b8ff987112e None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:33.827202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202e235-4983-44ad-bf58-4b8ff987112e None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:33.827481 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202e235-4983-44ad-bf58-4b8ff987112e None admin] PATH_INFO: `/v3/roles/71b77f014251450eac200e62300144ab` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:33.828965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202e235-4983-44ad-bf58-4b8ff987112e None admin] RBAC: Authorizing `identity:get_role(role_id=71b77f014251450eac200e62300144ab)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:33.830373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202e235-4983-44ad-bf58-4b8ff987112e None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:33.831734 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 560/1126] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:37:33 2022] GET /identity/v3/roles/71b77f014251450eac200e62300144ab => generated 224 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:33.837600 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f767d-56f4-4d59-956e-a51e387700b3 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:33.916478 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:33.935112 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f767d-56f4-4d59-956e-a51e387700b3 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:33.967964 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79852d85-8d1b-4b5d-81ee-b1d188063d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:33.969156 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79852d85-8d1b-4b5d-81ee-b1d188063d86 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:33.969439 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79852d85-8d1b-4b5d-81ee-b1d188063d86 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:33.969714 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79852d85-8d1b-4b5d-81ee-b1d188063d86 None admin] PATH_INFO: `/v3/users/f5a827bc183e4d6bb75f111b4a1cd160` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:33.970879 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79852d85-8d1b-4b5d-81ee-b1d188063d86 None admin] RBAC: Authorizing `identity:get_user(user_id=f5a827bc183e4d6bb75f111b4a1cd160)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:33.972382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79852d85-8d1b-4b5d-81ee-b1d188063d86 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:33.974311 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 567/1127] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:37:33 2022] GET /identity/v3/users/f5a827bc183e4d6bb75f111b4a1cd160 => generated 287 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:33.979868 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202e235-4983-44ad-bf58-4b8ff987112e None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:34.076586 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202e235-4983-44ad-bf58-4b8ff987112e None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:34.108816 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2133c9-dbcf-4f63-b0fd-6df3aad05bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:34.109455 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2133c9-dbcf-4f63-b0fd-6df3aad05bcd None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:34.109742 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2133c9-dbcf-4f63-b0fd-6df3aad05bcd None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:34.110020 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2133c9-dbcf-4f63-b0fd-6df3aad05bcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:34.143512 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:34.174857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2133c9-dbcf-4f63-b0fd-6df3aad05bcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:34.176349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2133c9-dbcf-4f63-b0fd-6df3aad05bcd None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:34.280884 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 561/1128] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:37:33 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:37:34.286883 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79852d85-8d1b-4b5d-81ee-b1d188063d86 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:34.385264 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79852d85-8d1b-4b5d-81ee-b1d188063d86 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:34.418523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b72c59-76bc-42d3-bac8-f81e579205f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:34.420023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b72c59-76bc-42d3-bac8-f81e579205f1 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:34.420333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b72c59-76bc-42d3-bac8-f81e579205f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:34.421674 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b72c59-76bc-42d3-bac8-f81e579205f1 None admin] PATH_INFO: `/v3/projects/438eea1e4dfa4c9ba63b71d0b961d3a8` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:34.422890 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b72c59-76bc-42d3-bac8-f81e579205f1 None admin] RBAC: Authorizing `identity:get_project(project_id=438eea1e4dfa4c9ba63b71d0b961d3a8)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:34.424359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b72c59-76bc-42d3-bac8-f81e579205f1 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:34.426089 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 568/1129] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:37:34 2022] GET /identity/v3/projects/438eea1e4dfa4c9ba63b71d0b961d3a8 => generated 312 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:34.433032 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2133c9-dbcf-4f63-b0fd-6df3aad05bcd None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:34.497207 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:34.529694 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2133c9-dbcf-4f63-b0fd-6df3aad05bcd None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:34.565196 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359c9b0-258f-48e9-9d05-fd6238ca11fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:34.565842 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359c9b0-258f-48e9-9d05-fd6238ca11fd None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:34.566125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359c9b0-258f-48e9-9d05-fd6238ca11fd None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:34.566421 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359c9b0-258f-48e9-9d05-fd6238ca11fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:34.567237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359c9b0-258f-48e9-9d05-fd6238ca11fd None admin] RBAC: Adding query filter params (role.id=71b77f014251450eac200e62300144ab, scope.project.id=438eea1e4dfa4c9ba63b71d0b961d3a8, user.id=f5a827bc183e4d6bb75f111b4a1cd160) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:34.567544 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359c9b0-258f-48e9-9d05-fd6238ca11fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:34.568983 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359c9b0-258f-48e9-9d05-fd6238ca11fd None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:34.574861 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 562/1130] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:37:34 2022] GET /identity/v3/role_assignments?user.id=f5a827bc183e4d6bb75f111b4a1cd160&scope.project.id=438eea1e4dfa4c9ba63b71d0b961d3a8&role.id=71b77f014251450eac200e62300144ab => generated 610 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:36.653472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262711c-f7fc-42f2-8a7a-dc97ce0ca5a2 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.653989 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262711c-f7fc-42f2-8a7a-dc97ce0ca5a2 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.654094 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262711c-f7fc-42f2-8a7a-dc97ce0ca5a2 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.655412 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 569/1131] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:36.660545 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64fefc-39d1-498c-b6ad-0e8d3a156be4 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.660953 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64fefc-39d1-498c-b6ad-0e8d3a156be4 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.661190 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64fefc-39d1-498c-b6ad-0e8d3a156be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.678229 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-dc64fefc-39d1-498c-b6ad-0e8d3a156be4 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:36.679412 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-dc64fefc-39d1-498c-b6ad-0e8d3a156be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:36.744919 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 563/1132] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:36 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:37:36.768224 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262711c-f7fc-42f2-8a7a-dc97ce0ca5a2 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:36.785980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:36.868961 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262711c-f7fc-42f2-8a7a-dc97ce0ca5a2 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:36.901671 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c859815-9060-4bc2-ac92-34430c823ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:36.902460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c859815-9060-4bc2-ac92-34430c823ee8 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.902749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c859815-9060-4bc2-ac92-34430c823ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.903030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c859815-9060-4bc2-ac92-34430c823ee8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.904231 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c859815-9060-4bc2-ac92-34430c823ee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:36.905667 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c859815-9060-4bc2-ac92-34430c823ee8 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:36.907276 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 570/1133] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:37:36 2022] GET /identity/v3/domains/default => generated 200 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:36.913094 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64fefc-39d1-498c-b6ad-0e8d3a156be4 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:36.977784 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:37.014414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64fefc-39d1-498c-b6ad-0e8d3a156be4 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.049367 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873d7e7-236a-4c6b-a696-9daea0411150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.049955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873d7e7-236a-4c6b-a696-9daea0411150 None admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.050240 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873d7e7-236a-4c6b-a696-9daea0411150 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.050518 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873d7e7-236a-4c6b-a696-9daea0411150 None admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.051222 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873d7e7-236a-4c6b-a696-9daea0411150 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.052673 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873d7e7-236a-4c6b-a696-9daea0411150 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.189526 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 564/1134] 10.222.0.119 () {60 vars in 1146 bytes} [Thu Jul 14 15:37:36 2022] POST /identity/v3/projects => generated 312 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:39.242427 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a319c-d48d-46b4-9872-8fac81d3da84 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:39.243063 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a319c-d48d-46b4-9872-8fac81d3da84 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:39.243063 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a319c-d48d-46b4-9872-8fac81d3da84 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:39.244392 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 571/1135] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:39.249682 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34164e-6e84-445d-bbd2-739ccc237d51 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:39.250056 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34164e-6e84-445d-bbd2-739ccc237d51 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:39.250246 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34164e-6e84-445d-bbd2-739ccc237d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:39.267313 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-9d34164e-6e84-445d-bbd2-739ccc237d51 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:39.268530 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-9d34164e-6e84-445d-bbd2-739ccc237d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:39.333243 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 565/1136] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:39 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:37:39.359477 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a319c-d48d-46b4-9872-8fac81d3da84 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:39.442463 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:39.458754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a319c-d48d-46b4-9872-8fac81d3da84 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:39.493236 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6c0fd-7e50-43db-8742-9198bb64ee1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:39.494063 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6c0fd-7e50-43db-8742-9198bb64ee1e None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:39.494342 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6c0fd-7e50-43db-8742-9198bb64ee1e None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:39.494618 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6c0fd-7e50-43db-8742-9198bb64ee1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:39.495787 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6c0fd-7e50-43db-8742-9198bb64ee1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:39.497243 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6c0fd-7e50-43db-8742-9198bb64ee1e None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:39.498849 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 572/1137] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:37:39 2022] GET /identity/v3/domains/default => generated 200 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:39.504691 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34164e-6e84-445d-bbd2-739ccc237d51 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:39.549617 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:39.603978 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34164e-6e84-445d-bbd2-739ccc237d51 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:39.638517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed8be2-5e80-499c-ab25-167257ae925c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:39.639180 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed8be2-5e80-499c-ab25-167257ae925c None admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:39.639469 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed8be2-5e80-499c-ab25-167257ae925c None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:39.639752 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed8be2-5e80-499c-ab25-167257ae925c None admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:39.640505 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed8be2-5e80-499c-ab25-167257ae925c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:39.641931 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed8be2-5e80-499c-ab25-167257ae925c None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:39.773818 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 566/1138] 10.222.0.119 () {60 vars in 1137 bytes} [Thu Jul 14 15:37:39 2022] POST /identity/v3/users => generated 287 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:41.875439 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125cdf3-7e56-4d0c-851b-e09f7e471eb5 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:41.875974 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125cdf3-7e56-4d0c-851b-e09f7e471eb5 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:41.875974 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125cdf3-7e56-4d0c-851b-e09f7e471eb5 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:41.877414 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 573/1139] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:41.882798 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902069e3-3661-4548-bfe8-017fc04b80df None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:41.883469 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902069e3-3661-4548-bfe8-017fc04b80df None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:41.883606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902069e3-3661-4548-bfe8-017fc04b80df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:41.900001 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-902069e3-3661-4548-bfe8-017fc04b80df None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:41.901217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-902069e3-3661-4548-bfe8-017fc04b80df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:41.965481 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 567/1140] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:41 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:37:41.991536 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125cdf3-7e56-4d0c-851b-e09f7e471eb5 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:42.095699 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125cdf3-7e56-4d0c-851b-e09f7e471eb5 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:42.132119 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80a0c1-bd31-4928-b22d-32926b47fa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:42.132861 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80a0c1-bd31-4928-b22d-32926b47fa95 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:42.133227 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80a0c1-bd31-4928-b22d-32926b47fa95 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:42.133502 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80a0c1-bd31-4928-b22d-32926b47fa95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:42.143252 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80a0c1-bd31-4928-b22d-32926b47fa95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:37:42.151043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-1d80a0c1-bd31-4928-b22d-32926b47fa95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:37:42.151043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:42.151043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:42.151043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:42.151043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:42.151043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:42.151043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:42.151043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:42.151043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:42.151043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:42.151043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:42.151043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:42.151043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:37:42.151043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:37:42.151043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:37:42.151043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:37:42.152201 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:37:42.152201 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:37:42.152201 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:37:42.152201 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:37:42.152201 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:42.152201 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:42.152201 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:42.152201 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:42.152201 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:42.152201 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:42.152201 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:42.152201 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:42.152201 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:42.152201 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:42.152201 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:42.152201 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:42.153397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:42.153397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:42.153397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:42.153397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:42.153397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:37:42.153397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:37:42.153397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:37:42.153397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:37:42.153397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:37:42.153397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:37:42.153397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:37:42.153397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:37:42.153397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 574/1141] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:37:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:37:42.158384 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902069e3-3661-4548-bfe8-017fc04b80df None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:42.189449 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:42.262461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902069e3-3661-4548-bfe8-017fc04b80df None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:42.298083 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd7fba-95b0-4e14-a5cc-6cc1f9f95014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:42.298759 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd7fba-95b0-4e14-a5cc-6cc1f9f95014 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:42.299050 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd7fba-95b0-4e14-a5cc-6cc1f9f95014 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:42.299334 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd7fba-95b0-4e14-a5cc-6cc1f9f95014 None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:42.300085 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd7fba-95b0-4e14-a5cc-6cc1f9f95014 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:42.300519 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd7fba-95b0-4e14-a5cc-6cc1f9f95014 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:42.301995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd7fba-95b0-4e14-a5cc-6cc1f9f95014 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:42.310988 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 568/1142] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:37:42 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:42.316882 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80a0c1-bd31-4928-b22d-32926b47fa95 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:42.332278 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:42.416037 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80a0c1-bd31-4928-b22d-32926b47fa95 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:42.448240 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76417e05-2f52-4980-9f2f-c41a476c7333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:42.449117 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76417e05-2f52-4980-9f2f-c41a476c7333 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:42.449404 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76417e05-2f52-4980-9f2f-c41a476c7333 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:42.449683 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76417e05-2f52-4980-9f2f-c41a476c7333 None admin] PATH_INFO: `/v3/users/d8a8f9cff50b41ef843ecf5d9e3afd89` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:42.463102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76417e05-2f52-4980-9f2f-c41a476c7333 None admin] RBAC: Authorizing `identity:get_user(user_id=d8a8f9cff50b41ef843ecf5d9e3afd89)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:42.464580 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76417e05-2f52-4980-9f2f-c41a476c7333 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:42.466234 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 575/1143] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:37:42 2022] GET /identity/v3/users/d8a8f9cff50b41ef843ecf5d9e3afd89 => generated 287 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:42.472332 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd7fba-95b0-4e14-a5cc-6cc1f9f95014 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:42.567922 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:42.577178 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd7fba-95b0-4e14-a5cc-6cc1f9f95014 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:42.610570 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79fea3-4ca3-4cee-8011-4690373cdab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:42.611220 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79fea3-4ca3-4cee-8011-4690373cdab3 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:42.611508 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79fea3-4ca3-4cee-8011-4690373cdab3 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:42.611790 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79fea3-4ca3-4cee-8011-4690373cdab3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:42.676977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79fea3-4ca3-4cee-8011-4690373cdab3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:42.678343 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79fea3-4ca3-4cee-8011-4690373cdab3 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:42.788715 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:42.799339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 569/1144] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:37:42 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:37:42.805695 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76417e05-2f52-4980-9f2f-c41a476c7333 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:42.873669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:42.904242 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76417e05-2f52-4980-9f2f-c41a476c7333 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:42.938138 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82238a4-d3c3-4da1-bd98-89ef4e0f75a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:42.938927 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82238a4-d3c3-4da1-bd98-89ef4e0f75a3 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:42.939216 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82238a4-d3c3-4da1-bd98-89ef4e0f75a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:42.939496 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82238a4-d3c3-4da1-bd98-89ef4e0f75a3 None admin] PATH_INFO: `/v3/projects/0ba1cc1b92d343518a5b5f0b2f568c48` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:42.940691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82238a4-d3c3-4da1-bd98-89ef4e0f75a3 None admin] RBAC: Authorizing `identity:get_project(project_id=0ba1cc1b92d343518a5b5f0b2f568c48)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:42.942125 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82238a4-d3c3-4da1-bd98-89ef4e0f75a3 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:42.943810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 576/1145] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:37:42 2022] GET /identity/v3/projects/0ba1cc1b92d343518a5b5f0b2f568c48 => generated 312 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:42.950558 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79fea3-4ca3-4cee-8011-4690373cdab3 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:43.052963 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79fea3-4ca3-4cee-8011-4690373cdab3 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:43.093903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55588166-54da-499a-8a84-21897eb18679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:43.094847 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55588166-54da-499a-8a84-21897eb18679 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:43.095132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55588166-54da-499a-8a84-21897eb18679 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:43.095408 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55588166-54da-499a-8a84-21897eb18679 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:43.096701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55588166-54da-499a-8a84-21897eb18679 None admin] RBAC: Adding query filter params (role.id=07aaf007cde043318319928d151bdc75, scope.project.id=0ba1cc1b92d343518a5b5f0b2f568c48, user.id=d8a8f9cff50b41ef843ecf5d9e3afd89) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:43.097035 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55588166-54da-499a-8a84-21897eb18679 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:43.098451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55588166-54da-499a-8a84-21897eb18679 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:43.103984 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 570/1146] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:37:42 2022] GET /identity/v3/role_assignments?user.id=d8a8f9cff50b41ef843ecf5d9e3afd89&scope.project.id=0ba1cc1b92d343518a5b5f0b2f568c48&role.id=07aaf007cde043318319928d151bdc75 => generated 260 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:45.127421 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5da82-e400-4ac4-8cd4-7f57adb64d5b None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:45.127987 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5da82-e400-4ac4-8cd4-7f57adb64d5b None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:45.127987 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5da82-e400-4ac4-8cd4-7f57adb64d5b None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:45.129387 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 577/1147] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:45.134739 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92ff21-1b3f-456d-927f-1faa56864370 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:45.135163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92ff21-1b3f-456d-927f-1faa56864370 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:45.135297 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92ff21-1b3f-456d-927f-1faa56864370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:45.151897 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-3e92ff21-1b3f-456d-927f-1faa56864370 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:45.153113 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-3e92ff21-1b3f-456d-927f-1faa56864370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:45.202336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:45.218985 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 571/1148] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:45 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:37:45.242365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5da82-e400-4ac4-8cd4-7f57adb64d5b None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:45.342225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5da82-e400-4ac4-8cd4-7f57adb64d5b None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:45.376727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb21944-6915-45b5-a467-b934e82e5880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:45.377559 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb21944-6915-45b5-a467-b934e82e5880 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:45.377796 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb21944-6915-45b5-a467-b934e82e5880 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:45.378070 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb21944-6915-45b5-a467-b934e82e5880 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:45.384963 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:45.388797 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb21944-6915-45b5-a467-b934e82e5880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:37:45.396414 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-5eb21944-6915-45b5-a467-b934e82e5880 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:37:45.396414 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:45.396414 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:45.396414 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:45.396414 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:45.396414 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:45.396414 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:45.396414 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:45.396414 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:45.396414 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:45.396414 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:45.396414 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:45.396414 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:37:45.396414 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:37:45.396414 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:37:45.396414 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:37:45.397542 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:37:45.397542 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:37:45.397542 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:37:45.397542 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:37:45.397542 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:45.397542 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:45.397542 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:45.397542 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:45.397542 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:45.397542 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:45.397542 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:45.397542 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:45.397542 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:45.397542 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:45.397542 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:45.397542 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:45.398446 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:45.398446 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:45.398446 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:45.398446 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:45.398446 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:37:45.398446 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:37:45.398446 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:37:45.398446 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:37:45.398446 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:37:45.398446 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:37:45.398446 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:37:45.398446 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:37:45.398446 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 578/1149] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:37:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:37:45.404629 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92ff21-1b3f-456d-927f-1faa56864370 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:45.504416 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92ff21-1b3f-456d-927f-1faa56864370 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:45.537956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b5441-4a2c-4019-ab58-899d9517fb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:45.538625 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b5441-4a2c-4019-ab58-899d9517fb54 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:45.538913 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b5441-4a2c-4019-ab58-899d9517fb54 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:45.539197 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b5441-4a2c-4019-ab58-899d9517fb54 None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:45.540530 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b5441-4a2c-4019-ab58-899d9517fb54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:45.540839 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b5441-4a2c-4019-ab58-899d9517fb54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:45.542198 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b5441-4a2c-4019-ab58-899d9517fb54 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:45.550143 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 572/1150] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:37:45 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:45.556110 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb21944-6915-45b5-a467-b934e82e5880 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:45.653890 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb21944-6915-45b5-a467-b934e82e5880 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:45.690639 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae12ecf-70b6-42fd-baf1-d386cf43db76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:45.691487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae12ecf-70b6-42fd-baf1-d386cf43db76 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:45.691841 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae12ecf-70b6-42fd-baf1-d386cf43db76 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:45.692140 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae12ecf-70b6-42fd-baf1-d386cf43db76 None admin] PATH_INFO: `/v3/users/d8a8f9cff50b41ef843ecf5d9e3afd89` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:45.693311 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae12ecf-70b6-42fd-baf1-d386cf43db76 None admin] RBAC: Authorizing `identity:get_user(user_id=d8a8f9cff50b41ef843ecf5d9e3afd89)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:45.694759 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae12ecf-70b6-42fd-baf1-d386cf43db76 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:45.697088 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 579/1151] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:37:45 2022] GET /identity/v3/users/d8a8f9cff50b41ef843ecf5d9e3afd89 => generated 287 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:37:45.703368 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b5441-4a2c-4019-ab58-899d9517fb54 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:45.753450 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:45.805466 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b5441-4a2c-4019-ab58-899d9517fb54 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:45.840394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede77527-190f-4cc9-8e94-77d14ade87b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:45.841256 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede77527-190f-4cc9-8e94-77d14ade87b4 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:45.841547 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede77527-190f-4cc9-8e94-77d14ade87b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:45.841832 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede77527-190f-4cc9-8e94-77d14ade87b4 None admin] PATH_INFO: `/v3/projects/0ba1cc1b92d343518a5b5f0b2f568c48` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:45.843008 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede77527-190f-4cc9-8e94-77d14ade87b4 None admin] RBAC: Authorizing `identity:get_project(project_id=0ba1cc1b92d343518a5b5f0b2f568c48)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:45.844720 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede77527-190f-4cc9-8e94-77d14ade87b4 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:45.846423 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 573/1152] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:37:45 2022] GET /identity/v3/projects/0ba1cc1b92d343518a5b5f0b2f568c48 => generated 312 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:45.853291 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae12ecf-70b6-42fd-baf1-d386cf43db76 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:45.917838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:45.951979 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae12ecf-70b6-42fd-baf1-d386cf43db76 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:45.985421 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021de5c5-23e8-4f52-92b3-a8b32d27b56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:45.986377 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021de5c5-23e8-4f52-92b3-a8b32d27b56b None admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:45.986667 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021de5c5-23e8-4f52-92b3-a8b32d27b56b None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:45.986949 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021de5c5-23e8-4f52-92b3-a8b32d27b56b None admin] PATH_INFO: `/v3/projects/0ba1cc1b92d343518a5b5f0b2f568c48/users/d8a8f9cff50b41ef843ecf5d9e3afd89/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:45.988911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021de5c5-23e8-4f52-92b3-a8b32d27b56b None admin] RBAC: Authorizing `identity:create_grant(project_id=0ba1cc1b92d343518a5b5f0b2f568c48, user_id=d8a8f9cff50b41ef843ecf5d9e3afd89, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:45.990343 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021de5c5-23e8-4f52-92b3-a8b32d27b56b None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:46.072571 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 580/1153] 10.222.0.119 () {58 vars in 1444 bytes} [Thu Jul 14 15:37:45 2022] PUT /identity/v3/projects/0ba1cc1b92d343518a5b5f0b2f568c48/users/d8a8f9cff50b41ef843ecf5d9e3afd89/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:48.100492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50567139-1324-4e0f-b211-f482d2f78b64 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:48.101022 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50567139-1324-4e0f-b211-f482d2f78b64 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:48.101136 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50567139-1324-4e0f-b211-f482d2f78b64 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:48.103010 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 574/1154] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:48 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:48.108235 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d6739-610d-4a81-b790-d783a56851c9 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:48.108635 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d6739-610d-4a81-b790-d783a56851c9 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:48.108806 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d6739-610d-4a81-b790-d783a56851c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:48.125611 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-d61d6739-610d-4a81-b790-d783a56851c9 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:48.126801 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-d61d6739-610d-4a81-b790-d783a56851c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:48.197952 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 581/1155] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:48 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:37:48.220891 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50567139-1324-4e0f-b211-f482d2f78b64 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:48.320027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50567139-1324-4e0f-b211-f482d2f78b64 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:48.336537 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:48.361910 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c31f5-5541-49fa-903f-cc840172898a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:48.361910 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c31f5-5541-49fa-903f-cc840172898a None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:48.361910 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c31f5-5541-49fa-903f-cc840172898a None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:48.361910 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c31f5-5541-49fa-903f-cc840172898a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:48.366547 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c31f5-5541-49fa-903f-cc840172898a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:37:48.375008 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-bb4c31f5-5541-49fa-903f-cc840172898a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:37:48.375008 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:48.375008 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:48.375008 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:48.375008 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:48.375008 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:48.375008 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:48.375008 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:48.375008 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:48.375008 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:48.375008 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:48.375008 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:48.375008 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:37:48.375008 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:37:48.375008 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:37:48.375008 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:37:48.376223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:37:48.376223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:37:48.376223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:37:48.376223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:37:48.376223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:48.376223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:48.376223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:48.376223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:48.376223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:48.376223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:48.376223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:48.376223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:48.376223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:48.376223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:48.376223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:48.376223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:48.377119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:48.377119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:48.377119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:48.377119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:48.377119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:37:48.377119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:37:48.377119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:37:48.377119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:37:48.377119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:37:48.377119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:37:48.377119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:37:48.377119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:37:48.377119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 575/1156] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:37:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:37:48.382827 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d6739-610d-4a81-b790-d783a56851c9 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:48.455276 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:48.498294 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d6739-610d-4a81-b790-d783a56851c9 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:48.532314 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdcb99-5271-4e42-b1bd-3c08192388f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:48.532986 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdcb99-5271-4e42-b1bd-3c08192388f8 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:48.533274 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdcb99-5271-4e42-b1bd-3c08192388f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:48.533555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdcb99-5271-4e42-b1bd-3c08192388f8 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:48.534344 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcdcb99-5271-4e42-b1bd-3c08192388f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:48.534624 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcdcb99-5271-4e42-b1bd-3c08192388f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:48.535998 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcdcb99-5271-4e42-b1bd-3c08192388f8 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:48.544452 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 582/1157] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:37:48 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:48.550466 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c31f5-5541-49fa-903f-cc840172898a None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:48.652243 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c31f5-5541-49fa-903f-cc840172898a None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:48.685374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50473ad-f4d5-43bd-b5de-cc9403a57de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:48.686237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50473ad-f4d5-43bd-b5de-cc9403a57de6 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:48.686521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50473ad-f4d5-43bd-b5de-cc9403a57de6 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:48.686801 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50473ad-f4d5-43bd-b5de-cc9403a57de6 None admin] PATH_INFO: `/v3/users/d8a8f9cff50b41ef843ecf5d9e3afd89` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:48.687974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50473ad-f4d5-43bd-b5de-cc9403a57de6 None admin] RBAC: Authorizing `identity:get_user(user_id=d8a8f9cff50b41ef843ecf5d9e3afd89)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:48.689435 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50473ad-f4d5-43bd-b5de-cc9403a57de6 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:48.691056 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 576/1158] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:37:48 2022] GET /identity/v3/users/d8a8f9cff50b41ef843ecf5d9e3afd89 => generated 287 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:48.697103 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdcb99-5271-4e42-b1bd-3c08192388f8 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:48.797884 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdcb99-5271-4e42-b1bd-3c08192388f8 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:48.814646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:48.830809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d19ccc-f5d2-4040-8adf-2d66dc07033b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:48.831461 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d19ccc-f5d2-4040-8adf-2d66dc07033b None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:48.831751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d19ccc-f5d2-4040-8adf-2d66dc07033b None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:48.832034 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d19ccc-f5d2-4040-8adf-2d66dc07033b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:48.899719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d19ccc-f5d2-4040-8adf-2d66dc07033b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:48.901361 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d19ccc-f5d2-4040-8adf-2d66dc07033b None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:48.998125 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 583/1159] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:37:48 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:37:49.003968 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50473ad-f4d5-43bd-b5de-cc9403a57de6 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:49.048985 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:49.100977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50473ad-f4d5-43bd-b5de-cc9403a57de6 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:49.134052 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d519647-bd8e-464f-8081-79a3fdf01642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:49.134901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d519647-bd8e-464f-8081-79a3fdf01642 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:49.135188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d519647-bd8e-464f-8081-79a3fdf01642 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:49.135467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d519647-bd8e-464f-8081-79a3fdf01642 None admin] PATH_INFO: `/v3/projects/0ba1cc1b92d343518a5b5f0b2f568c48` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:49.136795 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d519647-bd8e-464f-8081-79a3fdf01642 None admin] RBAC: Authorizing `identity:get_project(project_id=0ba1cc1b92d343518a5b5f0b2f568c48)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:49.138209 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d519647-bd8e-464f-8081-79a3fdf01642 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:49.139887 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 577/1160] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:37:49 2022] GET /identity/v3/projects/0ba1cc1b92d343518a5b5f0b2f568c48 => generated 312 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:49.145981 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d19ccc-f5d2-4040-8adf-2d66dc07033b None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:49.165196 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:49.243944 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d19ccc-f5d2-4040-8adf-2d66dc07033b None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:49.277346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac378640-cb6a-4962-a51b-e3f3b9b9d593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:49.277937 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac378640-cb6a-4962-a51b-e3f3b9b9d593 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:49.278226 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac378640-cb6a-4962-a51b-e3f3b9b9d593 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:49.278509 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac378640-cb6a-4962-a51b-e3f3b9b9d593 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:49.279333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac378640-cb6a-4962-a51b-e3f3b9b9d593 None admin] RBAC: Adding query filter params (role.id=07aaf007cde043318319928d151bdc75, scope.project.id=0ba1cc1b92d343518a5b5f0b2f568c48, user.id=d8a8f9cff50b41ef843ecf5d9e3afd89) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:49.279649 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac378640-cb6a-4962-a51b-e3f3b9b9d593 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:49.281102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac378640-cb6a-4962-a51b-e3f3b9b9d593 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:49.286841 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 584/1161] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:37:49 2022] GET /identity/v3/role_assignments?user.id=d8a8f9cff50b41ef843ecf5d9e3afd89&scope.project.id=0ba1cc1b92d343518a5b5f0b2f568c48&role.id=07aaf007cde043318319928d151bdc75 => generated 610 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:51.368738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10177ed8-b3ec-4b6e-af04-52171ff40954 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:51.369300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10177ed8-b3ec-4b6e-af04-52171ff40954 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:51.369300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10177ed8-b3ec-4b6e-af04-52171ff40954 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:51.370662 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 578/1162] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:51.375769 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a658be-eb9c-4561-9437-fed189d184f5 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:51.376216 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a658be-eb9c-4561-9437-fed189d184f5 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:51.376365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a658be-eb9c-4561-9437-fed189d184f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:51.392666 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-79a658be-eb9c-4561-9437-fed189d184f5 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:51.393832 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-79a658be-eb9c-4561-9437-fed189d184f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:51.463222 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 585/1163] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:51 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:37:51.487611 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10177ed8-b3ec-4b6e-af04-52171ff40954 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:51.588244 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10177ed8-b3ec-4b6e-af04-52171ff40954 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:51.601163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:51.621550 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d32f6-d71e-41fb-944b-535f927fd122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:51.622129 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d32f6-d71e-41fb-944b-535f927fd122 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:51.622416 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d32f6-d71e-41fb-944b-535f927fd122 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:51.622697 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d32f6-d71e-41fb-944b-535f927fd122 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:51.687878 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d32f6-d71e-41fb-944b-535f927fd122 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:51.689350 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d32f6-d71e-41fb-944b-535f927fd122 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:51.784683 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 579/1164] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:37:51 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:37:51.790770 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a658be-eb9c-4561-9437-fed189d184f5 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:51.804671 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:51.888413 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a658be-eb9c-4561-9437-fed189d184f5 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:51.922939 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a35611-6308-4133-aa1b-2b764c992f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:51.923739 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a35611-6308-4133-aa1b-2b764c992f5f None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:51.924029 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a35611-6308-4133-aa1b-2b764c992f5f None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:51.924341 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a35611-6308-4133-aa1b-2b764c992f5f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:51.931481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a35611-6308-4133-aa1b-2b764c992f5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:51.932977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a35611-6308-4133-aa1b-2b764c992f5f None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:51.947809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-81a35611-6308-4133-aa1b-2b764c992f5f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 14 15:37:51.947809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:51.947809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 15:37:51.947809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 15:37:51.947809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:37:51.947809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:37:51.947809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:37:51.947809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:37:51.947809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 14 15:37:51.947809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:37:51.947809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:37:51.947809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:37:51.947809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:37:51.947809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:37:51.947809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:37:51.947809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:37:51.947809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:37:51.949074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:37:51.949074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:37:51.949074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:37:51.949074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:37:51.949074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:37:51.949074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:37:51.949074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:37:51.949074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:37:51.949074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:37:51.949074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:37:51.949074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:37:51.949074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:37:51.949074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:37:51.949074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:37:51.949074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:37:51.949074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:37:51.949938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:37:51.949938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:37:51.949938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:37:51.949938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:37:51.949938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:37:51.949938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:37:51.949938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:37:51.949938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:37:51.949938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:37:51.949938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:37:51.949938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 15:37:51.949938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:37:51.949938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 14 15:37:51.949938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:37:51.949938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 586/1165] 10.222.0.119 () {56 vars in 1122 bytes} [Thu Jul 14 15:37:51 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:37:51.955125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d32f6-d71e-41fb-944b-535f927fd122 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:51.969038 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:52.051392 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d32f6-d71e-41fb-944b-535f927fd122 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:52.084882 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c117f-ff52-48e9-98fb-42b815cc10e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:52.085534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c117f-ff52-48e9-98fb-42b815cc10e3 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:52.085821 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c117f-ff52-48e9-98fb-42b815cc10e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:52.086102 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c117f-ff52-48e9-98fb-42b815cc10e3 None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:52.086941 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c117f-ff52-48e9-98fb-42b815cc10e3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:52.087249 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c117f-ff52-48e9-98fb-42b815cc10e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:52.088637 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c117f-ff52-48e9-98fb-42b815cc10e3 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:52.095818 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 580/1166] 10.222.0.119 () {56 vars in 1120 bytes} [Thu Jul 14 15:37:51 2022] GET /identity/v3/domains?name=swift_test => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:54.122162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb88ec-f8b1-491d-909c-43581d758652 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:54.122745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb88ec-f8b1-491d-909c-43581d758652 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:54.122745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb88ec-f8b1-491d-909c-43581d758652 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:54.124157 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 587/1167] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:54.129477 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa59e0-1047-430a-b647-7dc27f94f618 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:54.129893 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa59e0-1047-430a-b647-7dc27f94f618 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:54.130043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa59e0-1047-430a-b647-7dc27f94f618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:54.146995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-9aaa59e0-1047-430a-b647-7dc27f94f618 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:54.148206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-9aaa59e0-1047-430a-b647-7dc27f94f618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:54.214139 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 581/1168] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:54 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:37:54.237387 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb88ec-f8b1-491d-909c-43581d758652 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:54.308463 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:54.338414 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb88ec-f8b1-491d-909c-43581d758652 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:54.371488 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbf880-b1b1-433e-9232-8569f29342f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:54.372212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbf880-b1b1-433e-9232-8569f29342f4 None admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:54.372451 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbf880-b1b1-433e-9232-8569f29342f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:54.372727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbf880-b1b1-433e-9232-8569f29342f4 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:54.373468 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbf880-b1b1-433e-9232-8569f29342f4 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:54.374829 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbf880-b1b1-433e-9232-8569f29342f4 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:54.452225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 588/1169] 10.222.0.119 () {60 vars in 1143 bytes} [Thu Jul 14 15:37:54 2022] POST /identity/v3/domains => generated 268 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:56.533090 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d2cf9-5a89-4865-8d06-f990131b35bb None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:56.533657 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d2cf9-5a89-4865-8d06-f990131b35bb None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:56.533657 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d2cf9-5a89-4865-8d06-f990131b35bb None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:56.535130 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 582/1170] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:56.542428 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c915cd7-72e2-4734-8313-04894f76c108 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:56.542942 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c915cd7-72e2-4734-8313-04894f76c108 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:56.543037 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c915cd7-72e2-4734-8313-04894f76c108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:56.562197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-7c915cd7-72e2-4734-8313-04894f76c108 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:56.563914 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-7c915cd7-72e2-4734-8313-04894f76c108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:56.636714 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 589/1171] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:56 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:37:56.660401 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d2cf9-5a89-4865-8d06-f990131b35bb None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:56.669325 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:56.774941 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d2cf9-5a89-4865-8d06-f990131b35bb None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:56.810272 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0af54-6a57-498e-a7ef-faaae5b3817c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:56.811143 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0af54-6a57-498e-a7ef-faaae5b3817c None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:56.811434 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0af54-6a57-498e-a7ef-faaae5b3817c None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:56.811715 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0af54-6a57-498e-a7ef-faaae5b3817c None admin] PATH_INFO: `/v3/domains/eeb9f22890284da9af9bab69136c5949` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:56.823278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b0af54-6a57-498e-a7ef-faaae5b3817c None admin] RBAC: Authorizing `identity:get_domain(domain_id=eeb9f22890284da9af9bab69136c5949)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:56.824874 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b0af54-6a57-498e-a7ef-faaae5b3817c None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:56.826599 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 583/1172] 10.222.0.119 () {56 vars in 1188 bytes} [Thu Jul 14 15:37:56 2022] GET /identity/v3/domains/eeb9f22890284da9af9bab69136c5949 => generated 268 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:56.832714 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c915cd7-72e2-4734-8313-04894f76c108 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:56.921413 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:56.969732 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c915cd7-72e2-4734-8313-04894f76c108 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:57.006158 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af89d0c-ea6f-415a-9299-c0b7885a0334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:57.006827 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af89d0c-ea6f-415a-9299-c0b7885a0334 None admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:57.007114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af89d0c-ea6f-415a-9299-c0b7885a0334 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:57.007397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af89d0c-ea6f-415a-9299-c0b7885a0334 None admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:57.008149 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af89d0c-ea6f-415a-9299-c0b7885a0334 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:57.009724 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af89d0c-ea6f-415a-9299-c0b7885a0334 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:57.107618 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 590/1173] 10.222.0.119 () {60 vars in 1146 bytes} [Thu Jul 14 15:37:56 2022] POST /identity/v3/projects => generated 362 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:59.181273 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e05b56-2742-4ee6-a0dd-00ac9ce2a889 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:59.181842 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e05b56-2742-4ee6-a0dd-00ac9ce2a889 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:59.181842 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e05b56-2742-4ee6-a0dd-00ac9ce2a889 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:59.183212 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 584/1174] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:37:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:37:59.189015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e5eaf-e2f5-4ee7-b120-128d614a273f None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:59.189424 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e5eaf-e2f5-4ee7-b120-128d614a273f None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:59.189584 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e5eaf-e2f5-4ee7-b120-128d614a273f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:59.206103 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-e02e5eaf-e2f5-4ee7-b120-128d614a273f None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:59.207283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-e02e5eaf-e2f5-4ee7-b120-128d614a273f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:59.271432 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 591/1175] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:37:59 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:37:59.296493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e05b56-2742-4ee6-a0dd-00ac9ce2a889 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:59.361465 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:59.396087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e05b56-2742-4ee6-a0dd-00ac9ce2a889 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:59.431578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be45e9-d72d-41dc-be4f-67a69d053e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:59.432404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be45e9-d72d-41dc-be4f-67a69d053e24 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:59.432695 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be45e9-d72d-41dc-be4f-67a69d053e24 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:59.432974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be45e9-d72d-41dc-be4f-67a69d053e24 None admin] PATH_INFO: `/v3/domains/eeb9f22890284da9af9bab69136c5949` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:59.434151 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be45e9-d72d-41dc-be4f-67a69d053e24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=eeb9f22890284da9af9bab69136c5949)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:59.435574 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be45e9-d72d-41dc-be4f-67a69d053e24 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:59.437218 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 585/1176] 10.222.0.119 () {56 vars in 1188 bytes} [Thu Jul 14 15:37:59 2022] GET /identity/v3/domains/eeb9f22890284da9af9bab69136c5949 => generated 268 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:59.443103 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e5eaf-e2f5-4ee7-b120-128d614a273f None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:59.487822 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:59.540830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e5eaf-e2f5-4ee7-b120-128d614a273f None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:59.574176 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355b5fb-e793-4a03-94bf-d5440848baa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:59.574848 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355b5fb-e793-4a03-94bf-d5440848baa1 None admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:59.575139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355b5fb-e793-4a03-94bf-d5440848baa1 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:59.575423 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355b5fb-e793-4a03-94bf-d5440848baa1 None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:59.576153 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355b5fb-e793-4a03-94bf-d5440848baa1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:59.577589 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355b5fb-e793-4a03-94bf-d5440848baa1 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:59.694559 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 592/1177] 10.222.0.119 () {60 vars in 1137 bytes} [Thu Jul 14 15:37:59 2022] POST /identity/v3/users => generated 312 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:01.778579 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2a205-5819-486e-a9de-738af3f207cc None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:01.779100 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2a205-5819-486e-a9de-738af3f207cc None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:01.779100 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2a205-5819-486e-a9de-738af3f207cc None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:01.780465 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 586/1178] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:38:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:38:01.785721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642352a-e21c-4ee5-8458-3dd3807158b4 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:01.786222 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642352a-e21c-4ee5-8458-3dd3807158b4 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:01.786322 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642352a-e21c-4ee5-8458-3dd3807158b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:01.803451 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-0642352a-e21c-4ee5-8458-3dd3807158b4 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:01.804670 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-0642352a-e21c-4ee5-8458-3dd3807158b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:01.869348 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 593/1179] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:38:01 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:38:01.893049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2a205-5819-486e-a9de-738af3f207cc None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:01.993229 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2a205-5819-486e-a9de-738af3f207cc None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:02.026663 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254c7d6-befe-4791-9a04-ed6b0a75af7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:02.027433 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254c7d6-befe-4791-9a04-ed6b0a75af7b None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:02.027716 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254c7d6-befe-4791-9a04-ed6b0a75af7b None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:02.027993 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254c7d6-befe-4791-9a04-ed6b0a75af7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:02.029905 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:02.038693 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254c7d6-befe-4791-9a04-ed6b0a75af7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:38:02.047154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-8254c7d6-befe-4791-9a04-ed6b0a75af7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:38:02.047154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:38:02.047154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:38:02.047154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:38:02.047154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:38:02.047154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:38:02.047154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:38:02.047154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:38:02.047154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:38:02.047154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:38:02.047154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:38:02.047154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:38:02.047154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:38:02.047154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:38:02.047154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:38:02.047154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:38:02.048378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:38:02.048378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:38:02.048378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:38:02.048378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:38:02.048378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:38:02.048378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:38:02.048378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:38:02.048378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:38:02.048378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:38:02.048378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:38:02.048378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:38:02.048378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:38:02.048378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:38:02.048378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:38:02.048378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:38:02.048378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:38:02.049288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:38:02.049288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:38:02.049288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:38:02.049288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:38:02.049288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:38:02.049288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:38:02.049288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:38:02.049288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:38:02.049288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:38:02.049288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:38:02.049288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:38:02.049288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:38:02.049288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 587/1180] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:38:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:38:02.054473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642352a-e21c-4ee5-8458-3dd3807158b4 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:02.083891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:02.153235 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642352a-e21c-4ee5-8458-3dd3807158b4 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:02.185885 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5451a-b9a0-45e7-b189-756f3120a5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:02.186546 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5451a-b9a0-45e7-b189-756f3120a5f3 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:02.186837 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5451a-b9a0-45e7-b189-756f3120a5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:02.187116 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5451a-b9a0-45e7-b189-756f3120a5f3 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:02.187858 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5451a-b9a0-45e7-b189-756f3120a5f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:38:02.188197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5451a-b9a0-45e7-b189-756f3120a5f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:02.189577 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5451a-b9a0-45e7-b189-756f3120a5f3 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:02.198047 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 594/1181] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:38:02 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:38:02.203825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254c7d6-befe-4791-9a04-ed6b0a75af7b None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:02.300471 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254c7d6-befe-4791-9a04-ed6b0a75af7b None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:02.333382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d12ed-e4b9-4422-b07a-8774ae1cbf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:02.334239 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d12ed-e4b9-4422-b07a-8774ae1cbf06 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:02.334528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d12ed-e4b9-4422-b07a-8774ae1cbf06 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:02.334809 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d12ed-e4b9-4422-b07a-8774ae1cbf06 None admin] PATH_INFO: `/v3/users/396a6058025145febf65c1a89f2fecf0` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:02.348285 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d12ed-e4b9-4422-b07a-8774ae1cbf06 None admin] RBAC: Authorizing `identity:get_user(user_id=396a6058025145febf65c1a89f2fecf0)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:02.349707 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d12ed-e4b9-4422-b07a-8774ae1cbf06 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:02.351331 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 588/1182] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:38:02 2022] GET /identity/v3/users/396a6058025145febf65c1a89f2fecf0 => generated 312 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:38:02.357055 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5451a-b9a0-45e7-b189-756f3120a5f3 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:02.445028 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:02.454063 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5451a-b9a0-45e7-b189-756f3120a5f3 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:02.486431 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531422b-71f5-447c-953d-bfcc95968e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:02.487077 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531422b-71f5-447c-953d-bfcc95968e22 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:02.487367 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531422b-71f5-447c-953d-bfcc95968e22 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:02.487644 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531422b-71f5-447c-953d-bfcc95968e22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:02.560754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531422b-71f5-447c-953d-bfcc95968e22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:02.562128 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531422b-71f5-447c-953d-bfcc95968e22 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:02.647749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:02.657799 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 595/1183] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:38:02 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:38:02.663825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d12ed-e4b9-4422-b07a-8774ae1cbf06 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:02.716408 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:02.762495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d12ed-e4b9-4422-b07a-8774ae1cbf06 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:02.800293 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb08f41-491a-4fef-9b3e-68b5f490a990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:02.801148 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb08f41-491a-4fef-9b3e-68b5f490a990 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:02.801432 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb08f41-491a-4fef-9b3e-68b5f490a990 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:02.801708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb08f41-491a-4fef-9b3e-68b5f490a990 None admin] PATH_INFO: `/v3/projects/76296a46a9484fdd8b41c3a31f5684df` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:02.802874 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb08f41-491a-4fef-9b3e-68b5f490a990 None admin] RBAC: Authorizing `identity:get_project(project_id=76296a46a9484fdd8b41c3a31f5684df)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:02.804316 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb08f41-491a-4fef-9b3e-68b5f490a990 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:02.806062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 589/1184] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:38:02 2022] GET /identity/v3/projects/76296a46a9484fdd8b41c3a31f5684df => generated 362 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:38:02.812215 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531422b-71f5-447c-953d-bfcc95968e22 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:02.914302 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531422b-71f5-447c-953d-bfcc95968e22 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:02.946947 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61311c7a-35ab-4483-9c34-d9560d17d313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:02.947592 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61311c7a-35ab-4483-9c34-d9560d17d313 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:02.947875 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61311c7a-35ab-4483-9c34-d9560d17d313 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:02.948175 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61311c7a-35ab-4483-9c34-d9560d17d313 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:02.948999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61311c7a-35ab-4483-9c34-d9560d17d313 None admin] RBAC: Adding query filter params (role.id=07aaf007cde043318319928d151bdc75, scope.project.id=76296a46a9484fdd8b41c3a31f5684df, user.id=396a6058025145febf65c1a89f2fecf0) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:38:02.949315 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61311c7a-35ab-4483-9c34-d9560d17d313 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:02.950741 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61311c7a-35ab-4483-9c34-d9560d17d313 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:02.956010 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 596/1185] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:38:02 2022] GET /identity/v3/role_assignments?user.id=396a6058025145febf65c1a89f2fecf0&scope.project.id=76296a46a9484fdd8b41c3a31f5684df&role.id=07aaf007cde043318319928d151bdc75 => generated 260 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:38:05.100960 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e634343-9008-4add-b18c-0e8559e93551 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:05.101516 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e634343-9008-4add-b18c-0e8559e93551 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:05.101516 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e634343-9008-4add-b18c-0e8559e93551 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:05.102950 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 590/1186] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:38:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:38:05.108378 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498dd88-4ee5-4a42-9633-084b62f5ad01 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:05.108775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498dd88-4ee5-4a42-9633-084b62f5ad01 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:05.108939 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498dd88-4ee5-4a42-9633-084b62f5ad01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:05.125562 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-b498dd88-4ee5-4a42-9633-084b62f5ad01 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:05.126727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-b498dd88-4ee5-4a42-9633-084b62f5ad01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:05.176389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:05.192244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 597/1187] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:38:05 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:38:05.215989 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e634343-9008-4add-b18c-0e8559e93551 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:05.314180 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e634343-9008-4add-b18c-0e8559e93551 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:05.334122 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:05.348198 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c30b3-2e56-41fc-9edb-34d08937c433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:05.348987 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c30b3-2e56-41fc-9edb-34d08937c433 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:05.349278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c30b3-2e56-41fc-9edb-34d08937c433 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:05.349555 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c30b3-2e56-41fc-9edb-34d08937c433 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:05.359719 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c30b3-2e56-41fc-9edb-34d08937c433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:38:05.367946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-c08c30b3-2e56-41fc-9edb-34d08937c433 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:38:05.367946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:38:05.367946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:38:05.367946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:38:05.367946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:38:05.367946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:38:05.367946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:38:05.367946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:38:05.367946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:38:05.367946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:38:05.367946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:38:05.367946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:38:05.367946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:38:05.367946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:38:05.367946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:38:05.367946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:38:05.370827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:38:05.370827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:38:05.370827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:38:05.370827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:38:05.370827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:38:05.370827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:38:05.370827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:38:05.370827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:38:05.370827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:38:05.370827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:38:05.370827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:38:05.370827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:38:05.370827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:38:05.370827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:38:05.370827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:38:05.370827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:38:05.371898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:38:05.371898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:38:05.371898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:38:05.371898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:38:05.371898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:38:05.371898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:38:05.371898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:38:05.371898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:38:05.371898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:38:05.371898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:38:05.371898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:38:05.371898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:38:05.371898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 591/1188] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:38:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:38:05.374705 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498dd88-4ee5-4a42-9633-084b62f5ad01 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:05.477514 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498dd88-4ee5-4a42-9633-084b62f5ad01 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:05.511687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e8581-2293-4889-979a-7118ac67d851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:05.512269 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e8581-2293-4889-979a-7118ac67d851 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:05.512558 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e8581-2293-4889-979a-7118ac67d851 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:05.512835 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e8581-2293-4889-979a-7118ac67d851 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:05.513583 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e8581-2293-4889-979a-7118ac67d851 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:38:05.513892 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e8581-2293-4889-979a-7118ac67d851 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:05.515265 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e8581-2293-4889-979a-7118ac67d851 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:05.523609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 598/1189] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:38:05 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:38:05.529736 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c30b3-2e56-41fc-9edb-34d08937c433 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:05.627465 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c30b3-2e56-41fc-9edb-34d08937c433 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:05.660506 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7c68d-84ed-4e2e-ba83-f761b596f44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:05.661370 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7c68d-84ed-4e2e-ba83-f761b596f44f None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:05.661661 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7c68d-84ed-4e2e-ba83-f761b596f44f None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:05.661945 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7c68d-84ed-4e2e-ba83-f761b596f44f None admin] PATH_INFO: `/v3/users/396a6058025145febf65c1a89f2fecf0` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:05.663128 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7c68d-84ed-4e2e-ba83-f761b596f44f None admin] RBAC: Authorizing `identity:get_user(user_id=396a6058025145febf65c1a89f2fecf0)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:05.664612 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7c68d-84ed-4e2e-ba83-f761b596f44f None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:05.666388 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 592/1190] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:38:05 2022] GET /identity/v3/users/396a6058025145febf65c1a89f2fecf0 => generated 312 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:38:05.672380 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e8581-2293-4889-979a-7118ac67d851 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:05.728564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:05.781318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e8581-2293-4889-979a-7118ac67d851 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:05.813874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d2b0c-e80a-4d0e-a96a-08a8bfa5b3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:05.814756 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d2b0c-e80a-4d0e-a96a-08a8bfa5b3dd None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:05.815037 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d2b0c-e80a-4d0e-a96a-08a8bfa5b3dd None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:05.815310 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d2b0c-e80a-4d0e-a96a-08a8bfa5b3dd None admin] PATH_INFO: `/v3/projects/76296a46a9484fdd8b41c3a31f5684df` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:05.816503 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d2b0c-e80a-4d0e-a96a-08a8bfa5b3dd None admin] RBAC: Authorizing `identity:get_project(project_id=76296a46a9484fdd8b41c3a31f5684df)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:05.818021 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d2b0c-e80a-4d0e-a96a-08a8bfa5b3dd None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:05.819706 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 599/1191] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:38:05 2022] GET /identity/v3/projects/76296a46a9484fdd8b41c3a31f5684df => generated 362 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:38:05.827133 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7c68d-84ed-4e2e-ba83-f761b596f44f None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:05.876486 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:05.926187 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7c68d-84ed-4e2e-ba83-f761b596f44f None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:05.959207 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57947d92-5322-4759-92a6-1053ef3d8745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:05.960299 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57947d92-5322-4759-92a6-1053ef3d8745 None admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:05.960587 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57947d92-5322-4759-92a6-1053ef3d8745 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:05.960866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57947d92-5322-4759-92a6-1053ef3d8745 None admin] PATH_INFO: `/v3/projects/76296a46a9484fdd8b41c3a31f5684df/users/396a6058025145febf65c1a89f2fecf0/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:05.963027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57947d92-5322-4759-92a6-1053ef3d8745 None admin] RBAC: Authorizing `identity:create_grant(project_id=76296a46a9484fdd8b41c3a31f5684df, user_id=396a6058025145febf65c1a89f2fecf0, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:05.964479 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57947d92-5322-4759-92a6-1053ef3d8745 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:06.081239 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 593/1192] 10.222.0.119 () {58 vars in 1444 bytes} [Thu Jul 14 15:38:05 2022] PUT /identity/v3/projects/76296a46a9484fdd8b41c3a31f5684df/users/396a6058025145febf65c1a89f2fecf0/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:08.112258 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a3176-47aa-4bff-86ac-696ae5e2e135 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:08.112895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a3176-47aa-4bff-86ac-696ae5e2e135 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:08.112895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a3176-47aa-4bff-86ac-696ae5e2e135 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:08.114190 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 600/1193] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:38:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:38:08.119953 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68997f07-484d-4b77-bbcc-9878c1386271 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:08.120397 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68997f07-484d-4b77-bbcc-9878c1386271 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:08.120598 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68997f07-484d-4b77-bbcc-9878c1386271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:08.136866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-68997f07-484d-4b77-bbcc-9878c1386271 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:08.138028 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-68997f07-484d-4b77-bbcc-9878c1386271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:08.203347 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 594/1194] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:38:08 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:38:08.226921 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a3176-47aa-4bff-86ac-696ae5e2e135 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:08.326609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a3176-47aa-4bff-86ac-696ae5e2e135 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:08.341900 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:08.359559 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5dbec-cf82-48b0-b291-7d225583cacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:08.360372 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5dbec-cf82-48b0-b291-7d225583cacd None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:08.360657 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5dbec-cf82-48b0-b291-7d225583cacd None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:08.360934 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5dbec-cf82-48b0-b291-7d225583cacd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:08.371965 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5dbec-cf82-48b0-b291-7d225583cacd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:38:08.379977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-f7c5dbec-cf82-48b0-b291-7d225583cacd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:38:08.379977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:38:08.379977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:38:08.379977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:38:08.379977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:38:08.379977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:38:08.379977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:38:08.379977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:38:08.379977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:38:08.379977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:38:08.379977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:38:08.379977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:38:08.379977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:38:08.379977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:38:08.379977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:38:08.379977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:38:08.381130 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:38:08.381130 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:38:08.381130 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:38:08.381130 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:38:08.381130 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:38:08.381130 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:38:08.381130 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:38:08.381130 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:38:08.381130 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:38:08.381130 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:38:08.381130 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:38:08.381130 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:38:08.381130 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:38:08.381130 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:38:08.381130 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:38:08.381130 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:38:08.382043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:38:08.382043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:38:08.382043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:38:08.382043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:38:08.382043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:38:08.382043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:38:08.382043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:38:08.382043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:38:08.382043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:38:08.382043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:38:08.382043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:38:08.382043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:38:08.382043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 601/1195] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:38:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:38:08.387399 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68997f07-484d-4b77-bbcc-9878c1386271 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:08.425877 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:08.485902 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68997f07-484d-4b77-bbcc-9878c1386271 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:08.521166 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd00f2-12b1-4e26-8a39-3bf7935cfc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:08.521842 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd00f2-12b1-4e26-8a39-3bf7935cfc17 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:08.522132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd00f2-12b1-4e26-8a39-3bf7935cfc17 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:08.522411 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd00f2-12b1-4e26-8a39-3bf7935cfc17 None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:08.523163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd00f2-12b1-4e26-8a39-3bf7935cfc17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:38:08.523472 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd00f2-12b1-4e26-8a39-3bf7935cfc17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:08.524968 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd00f2-12b1-4e26-8a39-3bf7935cfc17 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:08.533150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 595/1196] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:38:08 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:38:08.538905 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5dbec-cf82-48b0-b291-7d225583cacd None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:08.637417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5dbec-cf82-48b0-b291-7d225583cacd None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:08.669808 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c46645-6166-4946-bd81-3b83aa78b06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:08.670671 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c46645-6166-4946-bd81-3b83aa78b06d None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:08.670957 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c46645-6166-4946-bd81-3b83aa78b06d None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:08.671232 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c46645-6166-4946-bd81-3b83aa78b06d None admin] PATH_INFO: `/v3/users/396a6058025145febf65c1a89f2fecf0` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:08.672436 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c46645-6166-4946-bd81-3b83aa78b06d None admin] RBAC: Authorizing `identity:get_user(user_id=396a6058025145febf65c1a89f2fecf0)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:08.673860 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c46645-6166-4946-bd81-3b83aa78b06d None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:08.675471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 602/1197] 10.222.0.119 () {56 vars in 1182 bytes} [Thu Jul 14 15:38:08 2022] GET /identity/v3/users/396a6058025145febf65c1a89f2fecf0 => generated 312 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:38:08.681728 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd00f2-12b1-4e26-8a39-3bf7935cfc17 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:08.779365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:08.782308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd00f2-12b1-4e26-8a39-3bf7935cfc17 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:08.815651 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420366c5-ffa3-4e03-9636-e80bfed3a1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:08.816336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420366c5-ffa3-4e03-9636-e80bfed3a1c9 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:08.816626 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420366c5-ffa3-4e03-9636-e80bfed3a1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:08.816904 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420366c5-ffa3-4e03-9636-e80bfed3a1c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:08.884657 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420366c5-ffa3-4e03-9636-e80bfed3a1c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:08.886307 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420366c5-ffa3-4e03-9636-e80bfed3a1c9 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:08.978269 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:08.981951 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 596/1198] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:38:08 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:38:08.987921 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c46645-6166-4946-bd81-3b83aa78b06d None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:09.033113 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:09.084771 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c46645-6166-4946-bd81-3b83aa78b06d None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:09.118963 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d584f47-c556-48af-9af3-63c16747ab9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:09.119818 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d584f47-c556-48af-9af3-63c16747ab9b None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:09.120124 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d584f47-c556-48af-9af3-63c16747ab9b None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:09.120403 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d584f47-c556-48af-9af3-63c16747ab9b None admin] PATH_INFO: `/v3/projects/76296a46a9484fdd8b41c3a31f5684df` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:09.121558 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d584f47-c556-48af-9af3-63c16747ab9b None admin] RBAC: Authorizing `identity:get_project(project_id=76296a46a9484fdd8b41c3a31f5684df)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:09.122988 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d584f47-c556-48af-9af3-63c16747ab9b None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:09.124707 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 603/1199] 10.222.0.119 () {56 vars in 1191 bytes} [Thu Jul 14 15:38:08 2022] GET /identity/v3/projects/76296a46a9484fdd8b41c3a31f5684df => generated 362 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:38:09.130908 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420366c5-ffa3-4e03-9636-e80bfed3a1c9 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:09.227895 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420366c5-ffa3-4e03-9636-e80bfed3a1c9 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:09.262059 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaedbbf-b50e-472a-ad47-5f02fae65a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:09.262648 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaedbbf-b50e-472a-ad47-5f02fae65a63 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:09.262933 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaedbbf-b50e-472a-ad47-5f02fae65a63 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:09.263211 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaedbbf-b50e-472a-ad47-5f02fae65a63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:09.264032 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaedbbf-b50e-472a-ad47-5f02fae65a63 None admin] RBAC: Adding query filter params (role.id=07aaf007cde043318319928d151bdc75, scope.project.id=76296a46a9484fdd8b41c3a31f5684df, user.id=396a6058025145febf65c1a89f2fecf0) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:38:09.264375 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaedbbf-b50e-472a-ad47-5f02fae65a63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:09.265784 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaedbbf-b50e-472a-ad47-5f02fae65a63 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:09.271461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 597/1200] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:38:09 2022] GET /identity/v3/role_assignments?user.id=396a6058025145febf65c1a89f2fecf0&scope.project.id=76296a46a9484fdd8b41c3a31f5684df&role.id=07aaf007cde043318319928d151bdc75 => generated 610 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:38:19.114759 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=44 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:19.268880 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=68 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:26.892020 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7be10d-5f0f-4e71-8f0b-959d8e028e0d None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:26.892636 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7be10d-5f0f-4e71-8f0b-959d8e028e0d None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:26.892636 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7be10d-5f0f-4e71-8f0b-959d8e028e0d None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:26.893999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 604/1201] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:39:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:39:26.899116 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77776f-d402-4fde-b57d-9fd65eb8232e None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:26.904144 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77776f-d402-4fde-b57d-9fd65eb8232e None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:26.904144 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77776f-d402-4fde-b57d-9fd65eb8232e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:26.917391 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-ba77776f-d402-4fde-b57d-9fd65eb8232e None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:26.918580 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-ba77776f-d402-4fde-b57d-9fd65eb8232e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:26.986483 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 598/1202] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:39:26 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:39:27.011430 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7be10d-5f0f-4e71-8f0b-959d8e028e0d None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:27.112038 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7be10d-5f0f-4e71-8f0b-959d8e028e0d None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:27.145762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c152ac-9edc-44d2-8cf0-f1e57122bfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:27.146493 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c152ac-9edc-44d2-8cf0-f1e57122bfc8 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:27.146779 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c152ac-9edc-44d2-8cf0-f1e57122bfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:27.147059 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c152ac-9edc-44d2-8cf0-f1e57122bfc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:27.157497 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c152ac-9edc-44d2-8cf0-f1e57122bfc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:27.158954 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c152ac-9edc-44d2-8cf0-f1e57122bfc8 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:27.178334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-31c152ac-9edc-44d2-8cf0-f1e57122bfc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:39:27.178334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:27.178334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:27.178334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:27.178334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:27.178334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:27.178334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:27.178334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:27.178334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:27.178334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:27.178334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:27.178334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:27.178334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:39:27.178334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:39:27.178334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:39:27.179481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:39:27.179481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:27.179481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:27.179481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:27.179481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:27.179481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:27.179481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:27.179481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:27.179481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:27.179481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:27.179481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:27.179481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:27.179481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:27.179481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:27.179481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:27.179481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:27.179481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:27.180796 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:39:27.180796 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:39:27.180796 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:39:27.180796 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:39:27.180796 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 605/1203] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:27.186167 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77776f-d402-4fde-b57d-9fd65eb8232e None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:27.282474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77776f-d402-4fde-b57d-9fd65eb8232e None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:27.310419 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:27.315995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5d24e-b699-4204-906b-1edc79f6c1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:27.316767 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5d24e-b699-4204-906b-1edc79f6c1ce None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:27.320675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5d24e-b699-4204-906b-1edc79f6c1ce None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:27.320675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5d24e-b699-4204-906b-1edc79f6c1ce None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:27.320675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5d24e-b699-4204-906b-1edc79f6c1ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:27.320675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5d24e-b699-4204-906b-1edc79f6c1ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:27.320675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5d24e-b699-4204-906b-1edc79f6c1ce None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:27.331045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 599/1204] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:39:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:27.336862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c152ac-9edc-44d2-8cf0-f1e57122bfc8 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:27.389816 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:27.436928 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c152ac-9edc-44d2-8cf0-f1e57122bfc8 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:27.469300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a695bec-fa36-40f6-8c71-db7310f015e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:27.469966 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a695bec-fa36-40f6-8c71-db7310f015e4 None admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:27.470254 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a695bec-fa36-40f6-8c71-db7310f015e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:27.470533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a695bec-fa36-40f6-8c71-db7310f015e4 None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:27.471237 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a695bec-fa36-40f6-8c71-db7310f015e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:27.472967 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a695bec-fa36-40f6-8c71-db7310f015e4 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:27.597106 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 606/1205] 10.222.0.119 () {60 vars in 1137 bytes} [Thu Jul 14 15:39:27 2022] POST /identity/v3/users => generated 252 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:39:29.697247 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad1a76-8bbb-4407-ba9a-25b94c6a4707 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:29.697799 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad1a76-8bbb-4407-ba9a-25b94c6a4707 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:29.697799 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad1a76-8bbb-4407-ba9a-25b94c6a4707 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:29.699813 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 600/1206] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:39:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:39:29.705056 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2af72-11a4-479b-91ca-a7acf04ea9ba None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:29.705459 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2af72-11a4-479b-91ca-a7acf04ea9ba None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:29.705627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2af72-11a4-479b-91ca-a7acf04ea9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:29.722211 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-25e2af72-11a4-479b-91ca-a7acf04ea9ba None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:29.723654 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-25e2af72-11a4-479b-91ca-a7acf04ea9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:29.801646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 607/1207] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:39:29 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:39:29.826534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad1a76-8bbb-4407-ba9a-25b94c6a4707 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:29.928492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad1a76-8bbb-4407-ba9a-25b94c6a4707 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:29.961485 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b798e5-d6c8-4a14-b1e2-9e1ab2434a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:29.964779 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b798e5-d6c8-4a14-b1e2-9e1ab2434a08 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:29.964779 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b798e5-d6c8-4a14-b1e2-9e1ab2434a08 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:29.964779 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b798e5-d6c8-4a14-b1e2-9e1ab2434a08 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:29.974680 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b798e5-d6c8-4a14-b1e2-9e1ab2434a08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:39:29.984034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-47b798e5-d6c8-4a14-b1e2-9e1ab2434a08 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:39:29.984034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:29.984034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:29.984034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:29.984034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:29.984034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:29.984034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:29.984034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:29.984034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:29.984034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:29.984034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:29.984034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:29.984034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:39:29.984034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:39:29.984034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:39:29.984034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:39:29.988684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:39:29.988684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:39:29.988684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:39:29.988684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:39:29.988684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:29.988684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:29.988684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:29.988684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:29.988684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:29.988684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:29.988684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:29.988684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:29.988684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:29.988684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:29.988684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:29.988684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:29.989553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:29.989553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:29.989553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:29.989553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:29.989553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:39:29.989553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:39:29.989553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:39:29.989553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:39:29.989553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:39:29.989553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:39:29.989553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:39:29.989553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:39:29.989553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 601/1208] 10.222.0.119 () {56 vars in 1107 bytes} [Thu Jul 14 15:39:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:29.991830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2af72-11a4-479b-91ca-a7acf04ea9ba None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:30.031322 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:30.089961 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2af72-11a4-479b-91ca-a7acf04ea9ba None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:30.123825 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c66a9-e1ad-4b7c-8d0b-1c88a617b433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:30.124578 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c66a9-e1ad-4b7c-8d0b-1c88a617b433 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:30.125405 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c66a9-e1ad-4b7c-8d0b-1c88a617b433 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:30.125405 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c66a9-e1ad-4b7c-8d0b-1c88a617b433 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:30.125808 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c66a9-e1ad-4b7c-8d0b-1c88a617b433 None admin] RBAC: Adding query filter params (name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:30.126113 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c66a9-e1ad-4b7c-8d0b-1c88a617b433 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:30.127639 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c66a9-e1ad-4b7c-8d0b-1c88a617b433 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:30.135748 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 608/1209] 10.222.0.119 () {56 vars in 1108 bytes} [Thu Jul 14 15:39:29 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:30.141916 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b798e5-d6c8-4a14-b1e2-9e1ab2434a08 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:30.195196 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:30.243502 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b798e5-d6c8-4a14-b1e2-9e1ab2434a08 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:30.277073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084d475-c505-4627-a570-ef6129121600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:30.277900 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084d475-c505-4627-a570-ef6129121600 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:30.278140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084d475-c505-4627-a570-ef6129121600 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:30.278412 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084d475-c505-4627-a570-ef6129121600 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:30.288336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084d475-c505-4627-a570-ef6129121600 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:30.289773 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084d475-c505-4627-a570-ef6129121600 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:30.307649 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-4084d475-c505-4627-a570-ef6129121600 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:39:30.307649 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:30.307649 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:30.307649 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:30.307649 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:30.307649 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:30.307649 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:30.307649 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:30.307649 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:30.307649 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:30.307649 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:30.307649 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:30.307649 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:39:30.307649 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:39:30.307649 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:39:30.308738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:39:30.308738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:30.308738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:30.308738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:30.308738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:30.308738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:30.308738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:30.308738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:30.308738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:30.308738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:30.308738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:30.308738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:30.308738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:30.308738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:30.308738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:30.308738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:30.308738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:30.309789 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:39:30.309789 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:39:30.309789 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:39:30.309789 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:39:30.309789 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 602/1210] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:30.314963 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c66a9-e1ad-4b7c-8d0b-1c88a617b433 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:30.411532 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:30.414440 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c66a9-e1ad-4b7c-8d0b-1c88a617b433 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:30.447662 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a57b2-34b0-4c47-a9cf-28059d837ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:30.448516 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a57b2-34b0-4c47-a9cf-28059d837ae6 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:30.448936 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a57b2-34b0-4c47-a9cf-28059d837ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:30.449292 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a57b2-34b0-4c47-a9cf-28059d837ae6 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:30.450021 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a57b2-34b0-4c47-a9cf-28059d837ae6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:30.450336 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a57b2-34b0-4c47-a9cf-28059d837ae6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:30.451710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a57b2-34b0-4c47-a9cf-28059d837ae6 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:30.463254 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 609/1211] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:39:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:30.469824 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084d475-c505-4627-a570-ef6129121600 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:30.569516 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084d475-c505-4627-a570-ef6129121600 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:30.571001 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:30.602369 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e5e90-978d-4df9-bcfc-cf6351696011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:30.603158 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e5e90-978d-4df9-bcfc-cf6351696011 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:30.603441 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e5e90-978d-4df9-bcfc-cf6351696011 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:30.603714 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e5e90-978d-4df9-bcfc-cf6351696011 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:30.611044 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e5e90-978d-4df9-bcfc-cf6351696011 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:30.612595 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e5e90-978d-4df9-bcfc-cf6351696011 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:30.626961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-7c3e5e90-978d-4df9-bcfc-cf6351696011 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:39:30.626961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:30.626961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:30.626961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:30.626961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:30.626961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:30.626961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:30.626961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:30.626961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:30.626961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:30.626961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:30.626961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:30.626961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:39:30.626961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:39:30.626961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:39:30.626961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:39:30.628070 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:30.628070 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:30.628070 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:39:30.628070 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:39:30.628070 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:39:30.628070 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:39:30.628070 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:30.628070 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:30.628070 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:30.628070 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:30.628070 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:30.628070 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:30.628070 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:30.628070 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:30.628070 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:30.628070 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:30.628070 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:30.628070 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:30.629206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:30.629206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:30.629206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:39:30.629206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:39:30.629206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:39:30.629206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:39:30.629206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:39:30.629206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:39:30.629206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:39:30.629206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:39:30.629206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 603/1212] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:39:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:30.634246 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a57b2-34b0-4c47-a9cf-28059d837ae6 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:30.734781 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a57b2-34b0-4c47-a9cf-28059d837ae6 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:30.768760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08854a-969d-43ca-8545-e5e7862f1402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:30.769434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08854a-969d-43ca-8545-e5e7862f1402 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:30.769754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08854a-969d-43ca-8545-e5e7862f1402 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:30.770198 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08854a-969d-43ca-8545-e5e7862f1402 None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:30.771049 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08854a-969d-43ca-8545-e5e7862f1402 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:30.771365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08854a-969d-43ca-8545-e5e7862f1402 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:30.772838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08854a-969d-43ca-8545-e5e7862f1402 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:30.790727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 610/1213] 10.222.0.119 () {56 vars in 1148 bytes} [Thu Jul 14 15:39:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:30.796509 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e5e90-978d-4df9-bcfc-cf6351696011 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:30.897446 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e5e90-978d-4df9-bcfc-cf6351696011 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:30.931197 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6cfda-5c2f-4dec-9b8e-92d0efce5d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:30.931834 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6cfda-5c2f-4dec-9b8e-92d0efce5d43 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:30.932154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6cfda-5c2f-4dec-9b8e-92d0efce5d43 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:30.932434 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6cfda-5c2f-4dec-9b8e-92d0efce5d43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:30.962533 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:31.000087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6cfda-5c2f-4dec-9b8e-92d0efce5d43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:31.001602 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6cfda-5c2f-4dec-9b8e-92d0efce5d43 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:31.100349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 604/1214] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:39:30 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:39:31.106225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08854a-969d-43ca-8545-e5e7862f1402 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:31.125157 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:31.203373 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08854a-969d-43ca-8545-e5e7862f1402 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:31.238297 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7085b5-60b5-47ad-89e6-e1006c0802cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:31.239091 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7085b5-60b5-47ad-89e6-e1006c0802cd None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:31.239378 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7085b5-60b5-47ad-89e6-e1006c0802cd None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:31.239657 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7085b5-60b5-47ad-89e6-e1006c0802cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:31.250186 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7085b5-60b5-47ad-89e6-e1006c0802cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:31.251578 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7085b5-60b5-47ad-89e6-e1006c0802cd None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:31.269745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-cf7085b5-60b5-47ad-89e6-e1006c0802cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:39:31.269745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:31.269745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:31.269745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:31.269745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:31.269745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:31.269745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:31.269745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:31.269745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:31.269745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:31.269745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:31.269745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:31.269745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:39:31.269745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:39:31.269745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:39:31.270680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:39:31.270680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:31.270680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:31.270680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:31.270680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:31.270680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:31.270680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:31.270680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:31.270680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:31.270680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:31.270680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:31.270680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:31.270680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:31.270680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:31.270680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:31.270680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:31.270680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:31.271638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:39:31.271638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:39:31.271638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:39:31.271638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:39:31.271864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 611/1215] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:31.277009 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6cfda-5c2f-4dec-9b8e-92d0efce5d43 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:31.342671 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:31.384006 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6cfda-5c2f-4dec-9b8e-92d0efce5d43 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:31.418733 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dc78c-c01c-47c3-9a0e-01e398e94121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:31.422949 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dc78c-c01c-47c3-9a0e-01e398e94121 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:31.422949 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dc78c-c01c-47c3-9a0e-01e398e94121 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:31.422949 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dc78c-c01c-47c3-9a0e-01e398e94121 None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:31.422949 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671dc78c-c01c-47c3-9a0e-01e398e94121 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:31.422949 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671dc78c-c01c-47c3-9a0e-01e398e94121 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:31.422949 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671dc78c-c01c-47c3-9a0e-01e398e94121 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:31.434306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 605/1216] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:39:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:31.440023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7085b5-60b5-47ad-89e6-e1006c0802cd None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:31.511281 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:31.540934 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7085b5-60b5-47ad-89e6-e1006c0802cd None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:31.574425 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3bce2-e8c1-435d-8aa2-a8930d9a3a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:31.575210 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3bce2-e8c1-435d-8aa2-a8930d9a3a6c None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:31.575497 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3bce2-e8c1-435d-8aa2-a8930d9a3a6c None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:31.575775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3bce2-e8c1-435d-8aa2-a8930d9a3a6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:31.582187 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d3bce2-e8c1-435d-8aa2-a8930d9a3a6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:31.583634 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d3bce2-e8c1-435d-8aa2-a8930d9a3a6c None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:31.597169 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-37d3bce2-e8c1-435d-8aa2-a8930d9a3a6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:39:31.597169 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:31.597169 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:31.597169 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:31.597169 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:31.597169 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:31.597169 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:31.597169 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:31.597169 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:31.597169 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:31.597169 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:31.597169 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:31.597169 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:39:31.597169 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:39:31.597169 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:39:31.601686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:39:31.601686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:31.601686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:31.601686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:31.601686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:31.601686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:31.601686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:31.601686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:31.601686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:31.601686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:31.601686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:31.601686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:31.601686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:31.601686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:31.601686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:31.601686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:31.601686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:31.602698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:39:31.602698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:39:31.602698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:39:31.602698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:39:31.602698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:39:31.602698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:39:31.602698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:39:31.602698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:39:31.602698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 612/1217] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:39:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:31.605247 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dc78c-c01c-47c3-9a0e-01e398e94121 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:31.706675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dc78c-c01c-47c3-9a0e-01e398e94121 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:31.728649 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:31.741579 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a243a2-798d-4a15-9cf8-620ba7e4392d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:31.742241 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a243a2-798d-4a15-9cf8-620ba7e4392d None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:31.742528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a243a2-798d-4a15-9cf8-620ba7e4392d None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:31.742805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a243a2-798d-4a15-9cf8-620ba7e4392d None admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:31.743590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a243a2-798d-4a15-9cf8-620ba7e4392d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:31.743983 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a243a2-798d-4a15-9cf8-620ba7e4392d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:31.746222 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a243a2-798d-4a15-9cf8-620ba7e4392d None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:31.757897 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 606/1218] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:39:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:31.764671 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3bce2-e8c1-435d-8aa2-a8930d9a3a6c None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:31.870093 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3bce2-e8c1-435d-8aa2-a8930d9a3a6c None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:31.897878 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:31.904287 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343e663-a9d7-4c07-af14-d883de2a6947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:31.906137 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343e663-a9d7-4c07-af14-d883de2a6947 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:31.906137 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343e663-a9d7-4c07-af14-d883de2a6947 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:31.906137 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343e663-a9d7-4c07-af14-d883de2a6947 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:31.906375 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343e663-a9d7-4c07-af14-d883de2a6947 None admin] RBAC: Adding query filter params (role.id=92c47f3813b04366b3019ba2a56337eb, scope.project.id=07652ced88cf4f069d1765176be5130b, user.id=716cbbfeede34885b0411e5b9b25df47) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:31.906700 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343e663-a9d7-4c07-af14-d883de2a6947 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:31.908248 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343e663-a9d7-4c07-af14-d883de2a6947 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:31.913637 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 613/1219] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:39:31 2022] GET /identity/v3/role_assignments?user.id=716cbbfeede34885b0411e5b9b25df47&scope.project.id=07652ced88cf4f069d1765176be5130b&role.id=92c47f3813b04366b3019ba2a56337eb => generated 260 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:33.941564 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6ee03-eab2-43a4-b672-654c839b295f None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:33.942124 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6ee03-eab2-43a4-b672-654c839b295f None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:33.942124 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6ee03-eab2-43a4-b672-654c839b295f None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:33.943521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 607/1220] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:39:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:39:33.949073 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b523b9-81ac-4f36-8cf5-26b78e4ac620 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:33.949456 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b523b9-81ac-4f36-8cf5-26b78e4ac620 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:33.949627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b523b9-81ac-4f36-8cf5-26b78e4ac620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:33.966219 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-37b523b9-81ac-4f36-8cf5-26b78e4ac620 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:33.967390 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-37b523b9-81ac-4f36-8cf5-26b78e4ac620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:34.033846 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 614/1221] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:39:33 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:39:34.057244 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6ee03-eab2-43a4-b672-654c839b295f None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:34.158433 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6ee03-eab2-43a4-b672-654c839b295f None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:34.192168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2f339-bea7-405e-bc8c-f0e188e57fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:34.192923 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2f339-bea7-405e-bc8c-f0e188e57fa6 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:34.193211 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2f339-bea7-405e-bc8c-f0e188e57fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:34.193566 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2f339-bea7-405e-bc8c-f0e188e57fa6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:34.203558 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2f339-bea7-405e-bc8c-f0e188e57fa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:39:34.211398 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-60b2f339-bea7-405e-bc8c-f0e188e57fa6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:39:34.211398 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:34.211398 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:34.211398 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:34.211398 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:34.211398 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:34.211398 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:34.211398 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:34.211398 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:34.211398 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:34.211398 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:34.211398 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:34.211398 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:39:34.211398 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:39:34.211398 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:39:34.211398 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:39:34.212493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:39:34.212493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:39:34.212493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:39:34.212493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:39:34.212493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:34.212493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:34.212493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:34.212493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:34.212493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:34.212493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:34.212493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:34.212493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:34.212493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:34.212493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:34.212493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:34.212493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:34.213348 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:34.213348 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:34.213348 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:34.213348 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:34.213348 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:39:34.213348 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:39:34.213348 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:39:34.213348 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:39:34.213348 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:39:34.213348 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:39:34.213348 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:39:34.213348 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:39:34.213348 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 608/1222] 10.222.0.119 () {56 vars in 1107 bytes} [Thu Jul 14 15:39:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:34.219701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b523b9-81ac-4f36-8cf5-26b78e4ac620 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:34.316788 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b523b9-81ac-4f36-8cf5-26b78e4ac620 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:34.340446 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:34.351461 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4811e-aa85-4d10-8743-b14ef2585b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:34.352159 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4811e-aa85-4d10-8743-b14ef2585b75 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:34.352448 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4811e-aa85-4d10-8743-b14ef2585b75 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:34.352839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4811e-aa85-4d10-8743-b14ef2585b75 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:34.353571 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4811e-aa85-4d10-8743-b14ef2585b75 None admin] RBAC: Adding query filter params (name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:34.353879 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4811e-aa85-4d10-8743-b14ef2585b75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:34.355855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4811e-aa85-4d10-8743-b14ef2585b75 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:34.363690 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 615/1223] 10.222.0.119 () {56 vars in 1108 bytes} [Thu Jul 14 15:39:34 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:34.369631 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2f339-bea7-405e-bc8c-f0e188e57fa6 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:34.414735 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:34.470524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2f339-bea7-405e-bc8c-f0e188e57fa6 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:34.503928 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71d9b0-d327-4dfc-b9c3-562730fdef88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:34.504858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71d9b0-d327-4dfc-b9c3-562730fdef88 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:34.505208 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71d9b0-d327-4dfc-b9c3-562730fdef88 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:34.505549 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71d9b0-d327-4dfc-b9c3-562730fdef88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:34.519479 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71d9b0-d327-4dfc-b9c3-562730fdef88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:34.520958 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71d9b0-d327-4dfc-b9c3-562730fdef88 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:34.539188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-1c71d9b0-d327-4dfc-b9c3-562730fdef88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:39:34.539188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:34.539188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:34.539188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:34.539188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:34.539188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:34.539188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:34.539188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:34.539188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:34.539188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:34.539188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:34.539188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:34.539188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:39:34.539188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:39:34.539188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:39:34.540338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:39:34.540338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:34.540338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:34.540338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:34.540338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:34.540338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:34.540338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:34.540338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:34.540338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:34.540338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:34.540338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:34.540338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:34.540338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:34.540338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:34.540338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:34.540338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:34.540338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:34.541296 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:39:34.541296 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:39:34.541296 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:39:34.541296 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:39:34.541296 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 609/1224] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:34.546583 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4811e-aa85-4d10-8743-b14ef2585b75 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:34.644883 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4811e-aa85-4d10-8743-b14ef2585b75 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:34.679703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afd0cf-1eb4-4d11-8c95-4843b9488fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:34.680407 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afd0cf-1eb4-4d11-8c95-4843b9488fa4 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:34.680695 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afd0cf-1eb4-4d11-8c95-4843b9488fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:34.680977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afd0cf-1eb4-4d11-8c95-4843b9488fa4 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:34.681705 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0afd0cf-1eb4-4d11-8c95-4843b9488fa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:34.682008 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0afd0cf-1eb4-4d11-8c95-4843b9488fa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:34.683505 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0afd0cf-1eb4-4d11-8c95-4843b9488fa4 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:34.694985 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 616/1225] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:39:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:34.701691 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71d9b0-d327-4dfc-b9c3-562730fdef88 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:34.794755 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:34.801164 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71d9b0-d327-4dfc-b9c3-562730fdef88 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:34.836222 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21de00-576e-4eb9-9caa-42588418e3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:34.837018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21de00-576e-4eb9-9caa-42588418e3a3 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:34.837301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21de00-576e-4eb9-9caa-42588418e3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:34.837574 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21de00-576e-4eb9-9caa-42588418e3a3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:34.844968 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21de00-576e-4eb9-9caa-42588418e3a3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:34.846471 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21de00-576e-4eb9-9caa-42588418e3a3 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:34.861567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-fb21de00-576e-4eb9-9caa-42588418e3a3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:39:34.861567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:34.861567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:34.861567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:34.861567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:34.861567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:34.861567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:34.861567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:34.861567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:34.861567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:34.861567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:34.861567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:34.861567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:39:34.861567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:39:34.861567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:39:34.861567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:39:34.862721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:34.862721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:34.862721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:39:34.862721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:39:34.862721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:39:34.862721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:39:34.862721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:34.862721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:34.862721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:34.862721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:34.862721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:34.862721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:34.862721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:34.862721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:34.862721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:34.862721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:34.862721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:34.862721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:34.863911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:34.863911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:34.863911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:39:34.863911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:39:34.863911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:39:34.863911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:39:34.863911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:39:34.863911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:39:34.863911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:39:34.863911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:39:34.863911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 610/1226] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:39:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:34.868997 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afd0cf-1eb4-4d11-8c95-4843b9488fa4 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:34.916496 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:34.968681 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afd0cf-1eb4-4d11-8c95-4843b9488fa4 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:35.002485 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0264d7a-9b21-4cd7-bcfd-e3295f7e3af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:35.003151 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0264d7a-9b21-4cd7-bcfd-e3295f7e3af4 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:35.003438 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0264d7a-9b21-4cd7-bcfd-e3295f7e3af4 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:35.003721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0264d7a-9b21-4cd7-bcfd-e3295f7e3af4 None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:35.004582 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0264d7a-9b21-4cd7-bcfd-e3295f7e3af4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:35.004897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0264d7a-9b21-4cd7-bcfd-e3295f7e3af4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:35.006327 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0264d7a-9b21-4cd7-bcfd-e3295f7e3af4 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:35.023370 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 617/1227] 10.222.0.119 () {56 vars in 1148 bytes} [Thu Jul 14 15:39:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:35.029296 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21de00-576e-4eb9-9caa-42588418e3a3 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:35.129192 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21de00-576e-4eb9-9caa-42588418e3a3 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:35.162650 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b703456-c96c-4a36-ad17-801009730222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:35.163439 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b703456-c96c-4a36-ad17-801009730222 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:35.163720 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b703456-c96c-4a36-ad17-801009730222 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:35.163993 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b703456-c96c-4a36-ad17-801009730222 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:35.174675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b703456-c96c-4a36-ad17-801009730222 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:35.176130 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b703456-c96c-4a36-ad17-801009730222 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:35.194770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-9b703456-c96c-4a36-ad17-801009730222 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:39:35.194770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:35.194770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:35.194770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:35.194770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:35.194770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:35.194770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:35.194770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:35.194770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:35.194770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:35.194770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:35.194770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:35.194770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:39:35.194770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:39:35.194770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:39:35.195852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:39:35.195852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:35.195852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:35.195852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:35.195852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:35.195852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:35.195852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:35.195852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:35.195852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:35.195852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:35.195852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:35.195852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:35.195852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:35.195852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:35.195852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:35.195852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:35.195852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:35.200875 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:39:35.200875 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:39:35.200875 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:39:35.200875 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:39:35.200875 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 611/1228] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:35.201971 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0264d7a-9b21-4cd7-bcfd-e3295f7e3af4 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:35.300768 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0264d7a-9b21-4cd7-bcfd-e3295f7e3af4 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:35.303045 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:35.335460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afab0cf-dcaa-406d-9592-a7fc750e7acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:35.336337 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afab0cf-dcaa-406d-9592-a7fc750e7acf None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:35.336611 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afab0cf-dcaa-406d-9592-a7fc750e7acf None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:35.336932 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afab0cf-dcaa-406d-9592-a7fc750e7acf None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:35.337664 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afab0cf-dcaa-406d-9592-a7fc750e7acf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:35.337982 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afab0cf-dcaa-406d-9592-a7fc750e7acf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:35.339389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afab0cf-dcaa-406d-9592-a7fc750e7acf None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:35.351186 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 618/1229] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:39:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:35.357482 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b703456-c96c-4a36-ad17-801009730222 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:35.366245 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:35.457351 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b703456-c96c-4a36-ad17-801009730222 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:35.491993 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739d44e-4300-47d4-8f0d-38d379cbb00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:35.492882 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739d44e-4300-47d4-8f0d-38d379cbb00d None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:35.493162 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739d44e-4300-47d4-8f0d-38d379cbb00d None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:35.493439 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739d44e-4300-47d4-8f0d-38d379cbb00d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:35.500771 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739d44e-4300-47d4-8f0d-38d379cbb00d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:35.502219 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739d44e-4300-47d4-8f0d-38d379cbb00d None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:35.517132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-9739d44e-4300-47d4-8f0d-38d379cbb00d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:39:35.517132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:35.517132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:35.517132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:35.517132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:35.517132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:35.517132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:35.517132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:35.517132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:35.517132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:35.517132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:35.517132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:35.517132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:39:35.517132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:39:35.517132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:39:35.518257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:39:35.518257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:35.518257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:35.518257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:35.518257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:35.518257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:35.518257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:35.518257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:35.518257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:35.518257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:35.518257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:35.518257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:35.518257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:35.518257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:35.518257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:35.518257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:35.518257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:35.519355 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:39:35.519355 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:39:35.519355 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:39:35.519355 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:39:35.519355 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:39:35.519355 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:39:35.519355 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:39:35.519355 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:39:35.519355 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 612/1230] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:39:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:35.524244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afab0cf-dcaa-406d-9592-a7fc750e7acf None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:35.623729 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afab0cf-dcaa-406d-9592-a7fc750e7acf None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:35.656118 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1af33-b885-4319-b3ce-f08ac515cfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:35.656802 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1af33-b885-4319-b3ce-f08ac515cfc0 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:35.657091 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1af33-b885-4319-b3ce-f08ac515cfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:35.657379 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1af33-b885-4319-b3ce-f08ac515cfc0 None admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:35.658168 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b1af33-b885-4319-b3ce-f08ac515cfc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:35.658480 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b1af33-b885-4319-b3ce-f08ac515cfc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:35.659906 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b1af33-b885-4319-b3ce-f08ac515cfc0 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:35.672347 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 619/1231] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:39:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:35.678372 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739d44e-4300-47d4-8f0d-38d379cbb00d None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:35.757973 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:35.793815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739d44e-4300-47d4-8f0d-38d379cbb00d None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:35.827600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb3528-b084-4b37-bd54-2aec50ce2c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:35.828519 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb3528-b084-4b37-bd54-2aec50ce2c19 None admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:35.828855 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb3528-b084-4b37-bd54-2aec50ce2c19 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:35.829143 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb3528-b084-4b37-bd54-2aec50ce2c19 None admin] PATH_INFO: `/v3/projects/07652ced88cf4f069d1765176be5130b/users/716cbbfeede34885b0411e5b9b25df47/roles/92c47f3813b04366b3019ba2a56337eb` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:35.844288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb3528-b084-4b37-bd54-2aec50ce2c19 None admin] RBAC: Authorizing `identity:create_grant(project_id=07652ced88cf4f069d1765176be5130b, user_id=716cbbfeede34885b0411e5b9b25df47, role_id=92c47f3813b04366b3019ba2a56337eb)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:35.845789 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb3528-b084-4b37-bd54-2aec50ce2c19 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:35.972401 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 613/1232] 10.222.0.119 () {58 vars in 1444 bytes} [Thu Jul 14 15:39:35 2022] PUT /identity/v3/projects/07652ced88cf4f069d1765176be5130b/users/716cbbfeede34885b0411e5b9b25df47/roles/92c47f3813b04366b3019ba2a56337eb => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:38.012738 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73549550-6480-42cd-b76e-30cecf85c48d None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:38.013354 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73549550-6480-42cd-b76e-30cecf85c48d None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:38.013450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73549550-6480-42cd-b76e-30cecf85c48d None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:38.014777 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 620/1233] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:39:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:39:38.020401 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098af8f-d4a4-4af0-855f-4a0c0a567b4c None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:38.020790 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098af8f-d4a4-4af0-855f-4a0c0a567b4c None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:38.020980 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098af8f-d4a4-4af0-855f-4a0c0a567b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:38.037989 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-5098af8f-d4a4-4af0-855f-4a0c0a567b4c None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:38.039260 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-5098af8f-d4a4-4af0-855f-4a0c0a567b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:38.116574 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 614/1234] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:39:38 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:39:38.143721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73549550-6480-42cd-b76e-30cecf85c48d None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:38.168433 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:38.241607 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73549550-6480-42cd-b76e-30cecf85c48d None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:38.275584 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e5cb1-c4a7-4aa4-86fb-bf5721e91c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:38.276279 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e5cb1-c4a7-4aa4-86fb-bf5721e91c23 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:38.276566 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e5cb1-c4a7-4aa4-86fb-bf5721e91c23 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:38.276846 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e5cb1-c4a7-4aa4-86fb-bf5721e91c23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:38.287191 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e5cb1-c4a7-4aa4-86fb-bf5721e91c23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:39:38.295309 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-318e5cb1-c4a7-4aa4-86fb-bf5721e91c23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:39:38.295309 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:38.295309 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:38.295309 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:38.295309 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:38.295309 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:38.295309 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:38.295309 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:38.295309 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:38.295309 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:38.295309 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:38.295309 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:38.295309 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:39:38.295309 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:39:38.295309 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:39:38.295309 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:39:38.296494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:39:38.296494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:39:38.296494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:39:38.296494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:39:38.296494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:38.296494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:38.296494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:38.296494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:38.296494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:38.296494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:38.296494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:38.296494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:38.296494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:38.296494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:38.296494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:38.296494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:38.297518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:38.297518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:38.297518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:38.297518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:38.297518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:39:38.297518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:39:38.297518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:39:38.297518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:39:38.297518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:39:38.297518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:39:38.297518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:39:38.297518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:39:38.297518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 621/1235] 10.222.0.119 () {56 vars in 1107 bytes} [Thu Jul 14 15:39:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:38.302603 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098af8f-d4a4-4af0-855f-4a0c0a567b4c None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:38.350503 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:38.408004 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098af8f-d4a4-4af0-855f-4a0c0a567b4c None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:38.445974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c871606-6d77-4d2c-865d-7b7effede1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:38.447116 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c871606-6d77-4d2c-865d-7b7effede1ff None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:38.447569 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c871606-6d77-4d2c-865d-7b7effede1ff None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:38.448065 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c871606-6d77-4d2c-865d-7b7effede1ff None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:38.449951 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c871606-6d77-4d2c-865d-7b7effede1ff None admin] RBAC: Adding query filter params (name=service) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:38.450427 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c871606-6d77-4d2c-865d-7b7effede1ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:38.452678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c871606-6d77-4d2c-865d-7b7effede1ff None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:38.463321 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 615/1236] 10.222.0.119 () {56 vars in 1108 bytes} [Thu Jul 14 15:39:38 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:38.469936 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e5cb1-c4a7-4aa4-86fb-bf5721e91c23 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:38.556420 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:38.572548 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e5cb1-c4a7-4aa4-86fb-bf5721e91c23 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:38.605633 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec46b1-3d78-4712-a506-8337ddb6a327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:38.606472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec46b1-3d78-4712-a506-8337ddb6a327 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:38.606754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec46b1-3d78-4712-a506-8337ddb6a327 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:38.607032 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec46b1-3d78-4712-a506-8337ddb6a327 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:38.617293 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec46b1-3d78-4712-a506-8337ddb6a327 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:38.618839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec46b1-3d78-4712-a506-8337ddb6a327 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:38.635886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-cfec46b1-3d78-4712-a506-8337ddb6a327 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:39:38.635886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:38.635886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:38.635886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:38.635886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:38.635886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:38.635886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:38.635886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:38.635886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:38.635886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:38.635886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:38.635886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:38.635886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:39:38.635886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:39:38.635886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:39:38.641576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:39:38.641576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:38.641576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:38.641576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:38.641576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:38.641576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:38.641576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:38.641576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:38.641576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:38.641576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:38.641576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:38.641576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:38.641576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:38.641576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:38.641576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:38.641576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:38.641576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:38.642644 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:39:38.642644 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:39:38.642644 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:39:38.642644 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:39:38.642644 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 622/1237] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:38.643314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c871606-6d77-4d2c-865d-7b7effede1ff None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:38.742643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c871606-6d77-4d2c-865d-7b7effede1ff None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:38.755212 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:38.790317 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcc570-c8f0-4e49-975a-006fad111895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:38.790996 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcc570-c8f0-4e49-975a-006fad111895 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:38.791285 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcc570-c8f0-4e49-975a-006fad111895 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:38.791567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcc570-c8f0-4e49-975a-006fad111895 None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:38.792332 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dcc570-c8f0-4e49-975a-006fad111895 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:38.793155 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dcc570-c8f0-4e49-975a-006fad111895 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:38.794702 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dcc570-c8f0-4e49-975a-006fad111895 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:38.807481 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 616/1238] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:39:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:38.813747 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec46b1-3d78-4712-a506-8337ddb6a327 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:38.914667 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec46b1-3d78-4712-a506-8337ddb6a327 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:38.948011 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6362f96-f29d-4e90-9dc6-db18f9699429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:38.948883 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6362f96-f29d-4e90-9dc6-db18f9699429 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:38.949119 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6362f96-f29d-4e90-9dc6-db18f9699429 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:38.949403 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6362f96-f29d-4e90-9dc6-db18f9699429 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:38.952265 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:38.957386 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6362f96-f29d-4e90-9dc6-db18f9699429 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:38.958897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6362f96-f29d-4e90-9dc6-db18f9699429 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:38.973721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-b6362f96-f29d-4e90-9dc6-db18f9699429 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:39:38.973721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:38.973721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:38.973721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:38.973721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:38.973721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:38.973721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:38.973721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:38.973721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:38.973721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:38.973721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:38.973721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:38.973721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:39:38.973721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:39:38.973721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:39:38.973721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:39:38.975800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:38.975800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:38.975800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:39:38.975800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:39:38.975800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:39:38.975800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:39:38.975800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:38.975800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:38.975800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:38.975800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:38.975800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:38.975800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:38.975800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:38.975800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:38.975800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:38.975800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:38.975800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:38.975800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:38.977006 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:38.977006 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:38.977006 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:39:38.977006 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:39:38.977006 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:39:38.977006 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:39:38.977006 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:39:38.977006 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:39:38.977006 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:39:38.977006 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:39:38.977006 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 623/1239] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:39:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:38.981761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcc570-c8f0-4e49-975a-006fad111895 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:39.078318 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcc570-c8f0-4e49-975a-006fad111895 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:39.112689 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487772b-6b9b-4c3c-a2a4-009921de82de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:39.113404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487772b-6b9b-4c3c-a2a4-009921de82de None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:39.113691 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487772b-6b9b-4c3c-a2a4-009921de82de None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:39.113975 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487772b-6b9b-4c3c-a2a4-009921de82de None admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:39.114807 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487772b-6b9b-4c3c-a2a4-009921de82de None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:39.115125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487772b-6b9b-4c3c-a2a4-009921de82de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:39.116579 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487772b-6b9b-4c3c-a2a4-009921de82de None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:39.134066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 617/1240] 10.222.0.119 () {56 vars in 1148 bytes} [Thu Jul 14 15:39:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:39.140230 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6362f96-f29d-4e90-9dc6-db18f9699429 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:39.237849 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6362f96-f29d-4e90-9dc6-db18f9699429 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:39.270067 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d92188-af04-4a47-82cf-a8185300ae17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:39.270710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d92188-af04-4a47-82cf-a8185300ae17 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:39.270997 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d92188-af04-4a47-82cf-a8185300ae17 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:39.271274 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d92188-af04-4a47-82cf-a8185300ae17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:39.335727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d92188-af04-4a47-82cf-a8185300ae17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:39.337128 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d92188-af04-4a47-82cf-a8185300ae17 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:39.400948 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:39.435036 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 624/1241] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:39:39 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:39:39.441106 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487772b-6b9b-4c3c-a2a4-009921de82de None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:39.470046 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:39.541985 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487772b-6b9b-4c3c-a2a4-009921de82de None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:39.576900 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a31c97-bc85-4d73-b50b-9f2934738bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:39.577687 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a31c97-bc85-4d73-b50b-9f2934738bc0 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:39.577974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a31c97-bc85-4d73-b50b-9f2934738bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:39.578250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a31c97-bc85-4d73-b50b-9f2934738bc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:39.588316 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a31c97-bc85-4d73-b50b-9f2934738bc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:39.590274 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a31c97-bc85-4d73-b50b-9f2934738bc0 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:39.608150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-d0a31c97-bc85-4d73-b50b-9f2934738bc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:39:39.608150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:39.608150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:39.608150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:39.608150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:39.608150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:39.608150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:39.608150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:39.608150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:39.608150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:39.608150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:39.608150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:39.608150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:39:39.608150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:39:39.608150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:39:39.609785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:39:39.609785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:39.609785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:39.609785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:39.609785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:39.609785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:39.609785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:39.609785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:39.609785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:39.609785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:39.609785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:39.609785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:39.609785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:39.609785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:39.609785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:39.609785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:39.609785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:39.611523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:39:39.611523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:39:39.611523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:39:39.611523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:39:39.611523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 618/1242] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:39.616465 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d92188-af04-4a47-82cf-a8185300ae17 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:39.713239 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:39.719447 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d92188-af04-4a47-82cf-a8185300ae17 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:39.754013 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfdfc8-8d5c-4f06-a1e4-52e1b07ceef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:39.754673 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfdfc8-8d5c-4f06-a1e4-52e1b07ceef9 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:39.754964 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfdfc8-8d5c-4f06-a1e4-52e1b07ceef9 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:39.755248 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfdfc8-8d5c-4f06-a1e4-52e1b07ceef9 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:39.755976 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cfdfc8-8d5c-4f06-a1e4-52e1b07ceef9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:39.756317 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cfdfc8-8d5c-4f06-a1e4-52e1b07ceef9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:39.757688 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cfdfc8-8d5c-4f06-a1e4-52e1b07ceef9 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:39.769457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 625/1243] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:39:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:39.775034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a31c97-bc85-4d73-b50b-9f2934738bc0 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:39.854749 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:39.876504 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a31c97-bc85-4d73-b50b-9f2934738bc0 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:39.910565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755d877-609c-4a7c-a337-c1f0f7a90565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:39.911394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755d877-609c-4a7c-a337-c1f0f7a90565 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:39.911655 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755d877-609c-4a7c-a337-c1f0f7a90565 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:39.911926 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755d877-609c-4a7c-a337-c1f0f7a90565 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:39.919404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755d877-609c-4a7c-a337-c1f0f7a90565 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:39.921300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755d877-609c-4a7c-a337-c1f0f7a90565 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:39.936357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-4755d877-609c-4a7c-a337-c1f0f7a90565 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:39:39.936357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:39.936357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:39.936357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:39.936357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:39.936357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:39.936357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:39.936357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:39.936357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:39.936357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:39.936357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:39.936357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:39.936357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:39:39.936357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:39:39.936357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:39:39.943024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:39:39.943024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:39.943024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:39.943024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:39.943024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:39.943024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:39.943024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:39.943024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:39.943024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:39.943024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:39.943024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:39.943024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:39.943024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:39.943024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:39.943024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:39.943024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:39.943024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:39.944257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:39:39.944257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:39:39.944257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:39:39.944257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:39:39.944257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:39:39.944257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:39:39.944257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:39:39.944257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:39:39.944257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 619/1244] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:39:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:39.944954 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfdfc8-8d5c-4f06-a1e4-52e1b07ceef9 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:40.043659 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfdfc8-8d5c-4f06-a1e4-52e1b07ceef9 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:40.077377 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60822045-23a7-4de0-a832-74bfee53d24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:40.078035 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60822045-23a7-4de0-a832-74bfee53d24c None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:40.078319 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60822045-23a7-4de0-a832-74bfee53d24c None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:40.078594 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60822045-23a7-4de0-a832-74bfee53d24c None admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:40.079375 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60822045-23a7-4de0-a832-74bfee53d24c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:40.079683 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60822045-23a7-4de0-a832-74bfee53d24c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:40.081141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60822045-23a7-4de0-a832-74bfee53d24c None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:40.094448 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 626/1245] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:39:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:40.101019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755d877-609c-4a7c-a337-c1f0f7a90565 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:40.201860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755d877-609c-4a7c-a337-c1f0f7a90565 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:40.234903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ad7d7-635f-4e3a-b838-138e400a6e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:40.235556 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ad7d7-635f-4e3a-b838-138e400a6e9c None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:40.235840 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ad7d7-635f-4e3a-b838-138e400a6e9c None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:40.236162 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ad7d7-635f-4e3a-b838-138e400a6e9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:40.237067 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ad7d7-635f-4e3a-b838-138e400a6e9c None admin] RBAC: Adding query filter params (role.id=92c47f3813b04366b3019ba2a56337eb, scope.project.id=07652ced88cf4f069d1765176be5130b, user.id=716cbbfeede34885b0411e5b9b25df47) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:40.237380 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ad7d7-635f-4e3a-b838-138e400a6e9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:40.238910 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ad7d7-635f-4e3a-b838-138e400a6e9c None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:40.244741 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 620/1246] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:39:40 2022] GET /identity/v3/role_assignments?user.id=716cbbfeede34885b0411e5b9b25df47&scope.project.id=07652ced88cf4f069d1765176be5130b&role.id=92c47f3813b04366b3019ba2a56337eb => generated 610 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:42.364152 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b8666-18fe-4f82-b190-ad92c81b367f None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:42.364706 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b8666-18fe-4f82-b190-ad92c81b367f None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:42.364706 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b8666-18fe-4f82-b190-ad92c81b367f None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:42.366107 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 627/1247] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:39:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:39:42.371991 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d06391-db77-4680-86ce-88d51d521570 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:42.372455 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d06391-db77-4680-86ce-88d51d521570 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:42.372579 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d06391-db77-4680-86ce-88d51d521570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:42.377610 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:42.389383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-17d06391-db77-4680-86ce-88d51d521570 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:42.390560 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-17d06391-db77-4680-86ce-88d51d521570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:42.455311 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 621/1248] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:39:42 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:39:42.479129 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b8666-18fe-4f82-b190-ad92c81b367f None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:42.504231 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:42.592623 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b8666-18fe-4f82-b190-ad92c81b367f None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:42.627925 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145faa5e-f83a-4de8-8551-a7ce1aad8860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:42.628658 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145faa5e-f83a-4de8-8551-a7ce1aad8860 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:42.628944 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145faa5e-f83a-4de8-8551-a7ce1aad8860 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:42.629218 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145faa5e-f83a-4de8-8551-a7ce1aad8860 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:42.639612 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145faa5e-f83a-4de8-8551-a7ce1aad8860 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:39:42.647475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-145faa5e-f83a-4de8-8551-a7ce1aad8860 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:39:42.647475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:42.647475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:42.647475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:42.647475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:42.647475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:42.647475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:42.647475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:42.647475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:42.647475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:42.647475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:42.647475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:42.647475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:39:42.647475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:39:42.647475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:39:42.647475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:39:42.648442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:39:42.648442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:39:42.648442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:39:42.648442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:39:42.648442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:42.648442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:42.648442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:42.648442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:42.648442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:42.648442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:42.648442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:42.648442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:42.648442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:42.648442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:42.648442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:42.648442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:42.649457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:42.649457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:42.649457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:42.649457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:42.649457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:39:42.649457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:39:42.649457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:39:42.649457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:39:42.649457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:39:42.649457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:39:42.649457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:39:42.649457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:39:42.649457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 628/1249] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:39:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:42.655753 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d06391-db77-4680-86ce-88d51d521570 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:42.758280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d06391-db77-4680-86ce-88d51d521570 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:42.787835 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:42.793118 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c291c6-3a1f-4af3-ab5c-ab6dd1f21719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:42.794277 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c291c6-3a1f-4af3-ab5c-ab6dd1f21719 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:42.794566 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c291c6-3a1f-4af3-ab5c-ab6dd1f21719 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:42.794841 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c291c6-3a1f-4af3-ab5c-ab6dd1f21719 None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:42.795583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c291c6-3a1f-4af3-ab5c-ab6dd1f21719 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:42.795891 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c291c6-3a1f-4af3-ab5c-ab6dd1f21719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:42.797283 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c291c6-3a1f-4af3-ab5c-ab6dd1f21719 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:42.805196 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 622/1250] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:39:42 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:42.811203 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145faa5e-f83a-4de8-8551-a7ce1aad8860 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:42.888267 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:42.910927 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145faa5e-f83a-4de8-8551-a7ce1aad8860 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:42.943452 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0758b76-48a5-4afe-9d2c-ff2340eddb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:42.944326 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0758b76-48a5-4afe-9d2c-ff2340eddb24 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:42.950684 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0758b76-48a5-4afe-9d2c-ff2340eddb24 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:42.950684 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0758b76-48a5-4afe-9d2c-ff2340eddb24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:42.955644 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0758b76-48a5-4afe-9d2c-ff2340eddb24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:42.957290 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0758b76-48a5-4afe-9d2c-ff2340eddb24 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:42.975251 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-b0758b76-48a5-4afe-9d2c-ff2340eddb24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:39:42.975251 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:42.975251 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:42.975251 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:42.975251 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:42.975251 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:42.975251 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:42.975251 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:42.975251 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:42.975251 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:42.975251 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:42.975251 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:42.975251 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:39:42.975251 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:39:42.975251 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:39:42.976180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:39:42.976180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:42.976180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:42.976180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:42.976180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:42.976180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:42.976180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:42.976180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:42.976180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:42.976180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:42.976180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:42.976180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:42.976180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:42.976180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:42.976180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:42.976180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:42.976180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:42.977358 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:39:42.977358 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:39:42.977358 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:39:42.977358 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:39:42.977358 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 629/1251] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:42.983149 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c291c6-3a1f-4af3-ab5c-ab6dd1f21719 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:43.080373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c291c6-3a1f-4af3-ab5c-ab6dd1f21719 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:43.113906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6fb68-c50a-489f-b40c-b9691923f45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:43.114563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6fb68-c50a-489f-b40c-b9691923f45c None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:43.114845 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6fb68-c50a-489f-b40c-b9691923f45c None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:43.115118 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6fb68-c50a-489f-b40c-b9691923f45c None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:43.115827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6fb68-c50a-489f-b40c-b9691923f45c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:43.116256 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6fb68-c50a-489f-b40c-b9691923f45c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:43.117502 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6fb68-c50a-489f-b40c-b9691923f45c None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:43.129344 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 623/1252] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:39:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:43.135159 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0758b76-48a5-4afe-9d2c-ff2340eddb24 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:43.236819 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0758b76-48a5-4afe-9d2c-ff2340eddb24 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:43.261889 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:43.270249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1f794-e3c4-4d82-b1de-82c7fceab8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:43.272651 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1f794-e3c4-4d82-b1de-82c7fceab8fe None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:43.272651 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1f794-e3c4-4d82-b1de-82c7fceab8fe None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:43.272651 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1f794-e3c4-4d82-b1de-82c7fceab8fe None admin] PATH_INFO: `/v3/users/placement` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:43.279585 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1f794-e3c4-4d82-b1de-82c7fceab8fe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:43.281127 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1f794-e3c4-4d82-b1de-82c7fceab8fe None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:43.295484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-5ec1f794-e3c4-4d82-b1de-82c7fceab8fe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:39:43.295484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:43.295484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:43.295484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:43.295484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:43.295484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:43.295484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:43.295484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:43.295484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:43.295484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:43.295484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:43.295484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:43.295484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:39:43.295484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:39:43.295484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:39:43.295484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:39:43.296596 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:43.296596 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:43.296596 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:39:43.296596 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:39:43.296596 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:39:43.296596 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:39:43.296596 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:43.296596 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:43.296596 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:43.296596 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:43.296596 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:43.296596 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:43.296596 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:43.296596 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:43.296596 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:43.296596 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:43.296596 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:43.296596 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:43.297713 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:43.297713 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:43.297713 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:39:43.297713 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:39:43.297713 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:39:43.297713 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:39:43.297713 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:39:43.297713 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:39:43.297713 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:39:43.297713 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:39:43.297713 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 630/1253] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:39:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:43.302612 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6fb68-c50a-489f-b40c-b9691923f45c None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:43.359250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:43.402705 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6fb68-c50a-489f-b40c-b9691923f45c None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:43.436190 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3a088-c7ea-4525-8c7d-595fa26f5afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:43.436872 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3a088-c7ea-4525-8c7d-595fa26f5afd None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:43.437158 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3a088-c7ea-4525-8c7d-595fa26f5afd None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:43.437439 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3a088-c7ea-4525-8c7d-595fa26f5afd None admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:43.438279 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3a088-c7ea-4525-8c7d-595fa26f5afd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:43.438586 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3a088-c7ea-4525-8c7d-595fa26f5afd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:43.440009 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3a088-c7ea-4525-8c7d-595fa26f5afd None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:43.457643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 624/1254] 10.222.0.119 () {56 vars in 1148 bytes} [Thu Jul 14 15:39:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:43.463560 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1f794-e3c4-4d82-b1de-82c7fceab8fe None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:43.564068 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1f794-e3c4-4d82-b1de-82c7fceab8fe None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:43.597555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bca74-1bd4-4f8f-ab83-150efd04ad49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:43.598461 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bca74-1bd4-4f8f-ab83-150efd04ad49 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:43.598748 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bca74-1bd4-4f8f-ab83-150efd04ad49 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:43.599030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bca74-1bd4-4f8f-ab83-150efd04ad49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:43.653686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:43.665626 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9bca74-1bd4-4f8f-ab83-150efd04ad49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:43.667110 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9bca74-1bd4-4f8f-ab83-150efd04ad49 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:43.767263 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 631/1255] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:39:43 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:39:43.773114 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3a088-c7ea-4525-8c7d-595fa26f5afd None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:43.874065 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3a088-c7ea-4525-8c7d-595fa26f5afd None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:43.888302 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:43.915817 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd0f0e-52d7-4c41-a712-6c4c35fe5bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:43.916729 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd0f0e-52d7-4c41-a712-6c4c35fe5bf7 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:43.917016 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd0f0e-52d7-4c41-a712-6c4c35fe5bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:43.917297 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd0f0e-52d7-4c41-a712-6c4c35fe5bf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:43.928207 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd0f0e-52d7-4c41-a712-6c4c35fe5bf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:43.929872 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd0f0e-52d7-4c41-a712-6c4c35fe5bf7 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:43.948393 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-9ddd0f0e-52d7-4c41-a712-6c4c35fe5bf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:39:43.948393 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:43.948393 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:43.948393 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:43.948393 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:43.948393 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:43.948393 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:43.948393 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:43.948393 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:43.948393 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:43.948393 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:43.948393 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:43.948393 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:39:43.948393 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:39:43.948393 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:39:43.949461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:39:43.949461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:43.949461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:43.949461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:43.949461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:43.949461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:43.949461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:43.949461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:43.949461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:43.949461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:43.949461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:43.949461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:43.949461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:43.949461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:43.949461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:43.949461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:43.949461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:43.950525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:39:43.950525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:39:43.950525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:39:43.950525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:39:43.950525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 625/1256] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:43.957240 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bca74-1bd4-4f8f-ab83-150efd04ad49 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:44.044636 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:44.056585 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bca74-1bd4-4f8f-ab83-150efd04ad49 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:44.091212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11224c-3b9a-45c8-9d6c-ae20acbd8d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:44.091878 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11224c-3b9a-45c8-9d6c-ae20acbd8d73 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:44.092196 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11224c-3b9a-45c8-9d6c-ae20acbd8d73 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:44.092480 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11224c-3b9a-45c8-9d6c-ae20acbd8d73 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:44.093206 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11224c-3b9a-45c8-9d6c-ae20acbd8d73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:44.093519 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11224c-3b9a-45c8-9d6c-ae20acbd8d73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:44.094905 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11224c-3b9a-45c8-9d6c-ae20acbd8d73 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:44.106879 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 632/1257] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:39:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:44.112725 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd0f0e-52d7-4c41-a712-6c4c35fe5bf7 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:44.214369 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd0f0e-52d7-4c41-a712-6c4c35fe5bf7 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:44.263191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0a55d-11d7-4dc8-82b2-e1f91cbeaa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:44.263997 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0a55d-11d7-4dc8-82b2-e1f91cbeaa57 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:44.264315 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0a55d-11d7-4dc8-82b2-e1f91cbeaa57 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:44.264592 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0a55d-11d7-4dc8-82b2-e1f91cbeaa57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:44.271888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0a55d-11d7-4dc8-82b2-e1f91cbeaa57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:44.273528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0a55d-11d7-4dc8-82b2-e1f91cbeaa57 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:44.287802 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-77d0a55d-11d7-4dc8-82b2-e1f91cbeaa57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:39:44.287802 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:44.287802 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:44.287802 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:44.287802 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:44.287802 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:44.287802 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:44.287802 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:44.287802 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:44.287802 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:44.287802 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:44.287802 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:44.287802 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:39:44.287802 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:39:44.287802 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:39:44.288921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:39:44.288921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:44.288921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:44.288921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:44.288921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:44.288921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:44.288921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:44.288921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:44.288921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:44.288921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:44.288921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:44.288921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:44.288921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:44.288921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:44.288921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:44.288921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:44.288921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:44.289921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:39:44.289921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:39:44.289921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:39:44.289921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:39:44.289921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:39:44.289921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:39:44.289921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:39:44.289921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:39:44.289921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 626/1258] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:39:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:44.296049 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11224c-3b9a-45c8-9d6c-ae20acbd8d73 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:44.395755 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11224c-3b9a-45c8-9d6c-ae20acbd8d73 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:44.429021 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c30a7-c621-48ba-ab02-41dbbedeeec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:44.429683 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c30a7-c621-48ba-ab02-41dbbedeeec6 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:44.429971 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c30a7-c621-48ba-ab02-41dbbedeeec6 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:44.430252 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c30a7-c621-48ba-ab02-41dbbedeeec6 None admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:44.431041 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c30a7-c621-48ba-ab02-41dbbedeeec6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:44.431356 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c30a7-c621-48ba-ab02-41dbbedeeec6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:44.432828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c30a7-c621-48ba-ab02-41dbbedeeec6 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:44.444975 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 633/1259] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:39:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:44.451540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0a55d-11d7-4dc8-82b2-e1f91cbeaa57 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:44.478299 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:44.555642 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0a55d-11d7-4dc8-82b2-e1f91cbeaa57 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:44.589182 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260a341-ccb3-4a00-8cb7-b09b7a798458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:44.589840 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260a341-ccb3-4a00-8cb7-b09b7a798458 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:44.590123 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260a341-ccb3-4a00-8cb7-b09b7a798458 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:44.591118 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260a341-ccb3-4a00-8cb7-b09b7a798458 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:44.592021 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260a341-ccb3-4a00-8cb7-b09b7a798458 None admin] RBAC: Adding query filter params (role.id=07aaf007cde043318319928d151bdc75, scope.project.id=07652ced88cf4f069d1765176be5130b, user.id=716cbbfeede34885b0411e5b9b25df47) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:44.592362 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260a341-ccb3-4a00-8cb7-b09b7a798458 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:44.593814 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260a341-ccb3-4a00-8cb7-b09b7a798458 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:44.599583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 627/1260] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:39:44 2022] GET /identity/v3/role_assignments?user.id=716cbbfeede34885b0411e5b9b25df47&scope.project.id=07652ced88cf4f069d1765176be5130b&role.id=07aaf007cde043318319928d151bdc75 => generated 260 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:46.619992 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b8a73-21f0-4ed9-80ce-c2b7a0d916c0 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:46.620570 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b8a73-21f0-4ed9-80ce-c2b7a0d916c0 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:46.620708 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b8a73-21f0-4ed9-80ce-c2b7a0d916c0 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:46.622370 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 634/1261] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:39:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:39:46.627667 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ce097-178d-4e0c-bef4-a874dc3ed6fb None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:46.628172 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ce097-178d-4e0c-bef4-a874dc3ed6fb None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:46.633062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ce097-178d-4e0c-bef4-a874dc3ed6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:46.645047 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-990ce097-178d-4e0c-bef4-a874dc3ed6fb None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:46.646222 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-990ce097-178d-4e0c-bef4-a874dc3ed6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:46.712190 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 628/1262] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:39:46 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:39:46.736369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b8a73-21f0-4ed9-80ce-c2b7a0d916c0 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:46.747347 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:46.836025 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b8a73-21f0-4ed9-80ce-c2b7a0d916c0 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:46.875424 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47a625-8586-43e1-aa3e-24722b7640e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:46.876254 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47a625-8586-43e1-aa3e-24722b7640e4 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:46.876541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47a625-8586-43e1-aa3e-24722b7640e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:46.876822 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47a625-8586-43e1-aa3e-24722b7640e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:46.887009 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47a625-8586-43e1-aa3e-24722b7640e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:39:46.895329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-cb47a625-8586-43e1-aa3e-24722b7640e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:39:46.895329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:46.895329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:46.895329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:46.895329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:46.895329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:46.895329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:46.895329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:46.895329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:46.895329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:46.895329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:46.895329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:46.895329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:39:46.895329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:39:46.895329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:39:46.895329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:39:46.896471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:39:46.896471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:39:46.896471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:39:46.896471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:39:46.896471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:46.896471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:46.896471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:46.896471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:46.896471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:46.896471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:46.896471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:46.896471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:46.896471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:46.896471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:46.896471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:46.896471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:46.897564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:46.897564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:46.897564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:46.897564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:46.897564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:39:46.897564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:39:46.897564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:39:46.897564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:39:46.897564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:39:46.897564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:39:46.897564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:39:46.897564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:39:46.897564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 635/1263] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:39:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:46.902927 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ce097-178d-4e0c-bef4-a874dc3ed6fb None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:46.921997 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:47.001346 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ce097-178d-4e0c-bef4-a874dc3ed6fb None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:47.035452 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78984ada-ae17-46bd-be9e-423a96853fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:47.036126 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78984ada-ae17-46bd-be9e-423a96853fbc None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:47.036415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78984ada-ae17-46bd-be9e-423a96853fbc None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:47.036689 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78984ada-ae17-46bd-be9e-423a96853fbc None admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:47.037430 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78984ada-ae17-46bd-be9e-423a96853fbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:47.037737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78984ada-ae17-46bd-be9e-423a96853fbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:47.039088 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78984ada-ae17-46bd-be9e-423a96853fbc None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:47.048239 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 629/1264] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:39:46 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:39:47.054124 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47a625-8586-43e1-aa3e-24722b7640e4 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:47.119495 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:47.156902 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47a625-8586-43e1-aa3e-24722b7640e4 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:47.192746 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11193df-a7ae-4b2c-9ec4-4dd27aeac6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:47.193551 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11193df-a7ae-4b2c-9ec4-4dd27aeac6f1 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:47.193841 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11193df-a7ae-4b2c-9ec4-4dd27aeac6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:47.194123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11193df-a7ae-4b2c-9ec4-4dd27aeac6f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:47.205587 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11193df-a7ae-4b2c-9ec4-4dd27aeac6f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:47.207122 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11193df-a7ae-4b2c-9ec4-4dd27aeac6f1 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:47.225047 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-a11193df-a7ae-4b2c-9ec4-4dd27aeac6f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:39:47.225047 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:47.225047 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:47.225047 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:47.225047 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:47.225047 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:47.225047 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:47.225047 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:47.225047 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:47.225047 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:47.225047 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:47.225047 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:47.225047 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:39:47.225047 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:39:47.225047 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:39:47.226101 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:39:47.226101 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:47.226101 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:47.226101 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:47.226101 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:47.226101 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:47.226101 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:47.226101 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:47.226101 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:47.226101 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:47.226101 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:47.226101 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:47.226101 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:47.226101 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:47.226101 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:47.226101 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:47.226101 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:47.227166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:39:47.227166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:39:47.227166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:39:47.227166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:39:47.227166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 636/1265] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:47.233572 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78984ada-ae17-46bd-be9e-423a96853fbc None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:47.315395 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:47.334060 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78984ada-ae17-46bd-be9e-423a96853fbc None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:47.370326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce7c62-c3f2-40fd-9017-3e3b1df6e1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:47.370928 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce7c62-c3f2-40fd-9017-3e3b1df6e1e6 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:47.371213 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce7c62-c3f2-40fd-9017-3e3b1df6e1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:47.371489 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce7c62-c3f2-40fd-9017-3e3b1df6e1e6 None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:47.372829 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce7c62-c3f2-40fd-9017-3e3b1df6e1e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:47.373083 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce7c62-c3f2-40fd-9017-3e3b1df6e1e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:47.374437 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce7c62-c3f2-40fd-9017-3e3b1df6e1e6 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:47.385943 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 630/1266] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:39:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:47.392429 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11193df-a7ae-4b2c-9ec4-4dd27aeac6f1 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:47.494121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11193df-a7ae-4b2c-9ec4-4dd27aeac6f1 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:47.522097 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:47.536878 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48e2ed-36a2-4349-91a9-316db854e880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:47.537691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48e2ed-36a2-4349-91a9-316db854e880 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:47.537980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48e2ed-36a2-4349-91a9-316db854e880 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:47.538261 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48e2ed-36a2-4349-91a9-316db854e880 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:47.546545 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b48e2ed-36a2-4349-91a9-316db854e880 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:47.547996 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b48e2ed-36a2-4349-91a9-316db854e880 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:47.563645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-5b48e2ed-36a2-4349-91a9-316db854e880 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:39:47.563645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:47.563645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:47.563645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:47.563645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:47.563645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:47.563645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:47.563645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:47.563645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:47.563645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:47.563645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:47.563645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:47.563645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:39:47.563645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:39:47.563645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:39:47.563645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:39:47.564758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:47.564758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:47.564758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:39:47.564758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:39:47.564758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:39:47.564758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:39:47.564758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:47.564758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:47.564758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:47.564758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:47.564758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:47.564758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:47.564758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:47.564758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:47.564758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:47.564758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:47.564758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:47.564758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:47.565775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:47.565775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:47.565775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:39:47.565775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:39:47.565775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:39:47.565775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:39:47.565775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:39:47.565775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:39:47.565775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:39:47.565775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:39:47.565775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 637/1267] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:39:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:47.571043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce7c62-c3f2-40fd-9017-3e3b1df6e1e6 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:47.669770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce7c62-c3f2-40fd-9017-3e3b1df6e1e6 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:47.703365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99d52a-7ea9-46ce-8551-5b92440ac14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:47.704034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99d52a-7ea9-46ce-8551-5b92440ac14a None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:47.704344 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99d52a-7ea9-46ce-8551-5b92440ac14a None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:47.704621 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99d52a-7ea9-46ce-8551-5b92440ac14a None admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:47.705443 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99d52a-7ea9-46ce-8551-5b92440ac14a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:47.705748 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99d52a-7ea9-46ce-8551-5b92440ac14a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:47.707159 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99d52a-7ea9-46ce-8551-5b92440ac14a None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:47.716222 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:47.724771 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 631/1268] 10.222.0.119 () {56 vars in 1148 bytes} [Thu Jul 14 15:39:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:47.730485 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48e2ed-36a2-4349-91a9-316db854e880 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:47.828642 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48e2ed-36a2-4349-91a9-316db854e880 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:47.862523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f7f0c-3698-48fd-8657-12a953876bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:47.863319 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f7f0c-3698-48fd-8657-12a953876bf2 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:47.863604 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f7f0c-3698-48fd-8657-12a953876bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:47.863883 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f7f0c-3698-48fd-8657-12a953876bf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:47.874982 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f7f0c-3698-48fd-8657-12a953876bf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:47.876460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f7f0c-3698-48fd-8657-12a953876bf2 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:47.893679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-075f7f0c-3698-48fd-8657-12a953876bf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:39:47.893679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:47.893679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:47.893679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:47.893679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:47.893679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:47.893679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:47.893679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:47.893679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:47.893679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:47.893679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:47.893679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:47.893679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:39:47.893679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:39:47.893679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:39:47.894749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:39:47.894749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:47.894749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:47.894749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:47.894749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:47.894749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:47.894749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:47.894749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:47.894749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:47.894749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:47.894749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:47.894749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:47.894749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:47.894749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:47.894749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:47.894749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:47.894749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:47.895705 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:39:47.895705 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:39:47.895705 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:39:47.895705 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:39:47.895705 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 638/1269] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:47.900653 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99d52a-7ea9-46ce-8551-5b92440ac14a None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:47.998935 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99d52a-7ea9-46ce-8551-5b92440ac14a None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:48.034563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d5368-faba-499b-a6b4-54efa0c3d395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:48.035220 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d5368-faba-499b-a6b4-54efa0c3d395 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:48.035507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d5368-faba-499b-a6b4-54efa0c3d395 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:48.035796 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d5368-faba-499b-a6b4-54efa0c3d395 None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:48.036537 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d5368-faba-499b-a6b4-54efa0c3d395 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:48.036853 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d5368-faba-499b-a6b4-54efa0c3d395 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:48.038202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d5368-faba-499b-a6b4-54efa0c3d395 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:48.049321 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 632/1270] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:39:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:48.055167 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f7f0c-3698-48fd-8657-12a953876bf2 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:48.087645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:48.156187 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f7f0c-3698-48fd-8657-12a953876bf2 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:48.189547 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cee187-cea2-4252-b96e-a62e1ac1dd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:48.190426 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cee187-cea2-4252-b96e-a62e1ac1dd2d None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:48.190715 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cee187-cea2-4252-b96e-a62e1ac1dd2d None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:48.190999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cee187-cea2-4252-b96e-a62e1ac1dd2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:48.197674 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cee187-cea2-4252-b96e-a62e1ac1dd2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:48.199198 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cee187-cea2-4252-b96e-a62e1ac1dd2d None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:48.214389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-72cee187-cea2-4252-b96e-a62e1ac1dd2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:39:48.214389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:48.214389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:48.214389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:48.214389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:48.214389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:48.214389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:48.214389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:48.214389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:48.214389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:48.214389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:48.214389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:48.214389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:39:48.214389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:39:48.214389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:39:48.228331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:39:48.228331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:48.228331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:48.228331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:48.228331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:48.228331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:48.228331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:48.228331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:48.228331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:48.228331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:48.228331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:48.228331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:48.228331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:48.228331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:48.228331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:48.228331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:48.228331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:48.229506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:39:48.229506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:39:48.229506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:39:48.229506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:39:48.229506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:39:48.229506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:39:48.229506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:39:48.229506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:39:48.229506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 639/1271] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:39:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:48.230109 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d5368-faba-499b-a6b4-54efa0c3d395 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:48.281114 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:48.322345 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d5368-faba-499b-a6b4-54efa0c3d395 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:48.356973 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781fae2-cca8-45c4-97f7-87895577a597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:48.357727 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781fae2-cca8-45c4-97f7-87895577a597 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:48.358012 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781fae2-cca8-45c4-97f7-87895577a597 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:48.358292 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781fae2-cca8-45c4-97f7-87895577a597 None admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:48.359092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e781fae2-cca8-45c4-97f7-87895577a597 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:48.359409 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e781fae2-cca8-45c4-97f7-87895577a597 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:48.360877 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e781fae2-cca8-45c4-97f7-87895577a597 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:48.375545 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 633/1272] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:39:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:48.382053 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cee187-cea2-4252-b96e-a62e1ac1dd2d None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:48.476541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:48.485763 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cee187-cea2-4252-b96e-a62e1ac1dd2d None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:48.519148 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f0873-75e7-47fc-b719-6ad7906df379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:48.520037 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f0873-75e7-47fc-b719-6ad7906df379 None admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:48.520351 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f0873-75e7-47fc-b719-6ad7906df379 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:48.520629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f0873-75e7-47fc-b719-6ad7906df379 None admin] PATH_INFO: `/v3/projects/07652ced88cf4f069d1765176be5130b/users/716cbbfeede34885b0411e5b9b25df47/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:48.522586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f0873-75e7-47fc-b719-6ad7906df379 None admin] RBAC: Authorizing `identity:create_grant(project_id=07652ced88cf4f069d1765176be5130b, user_id=716cbbfeede34885b0411e5b9b25df47, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:48.524024 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f0873-75e7-47fc-b719-6ad7906df379 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:48.619935 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 640/1273] 10.222.0.119 () {58 vars in 1444 bytes} [Thu Jul 14 15:39:48 2022] PUT /identity/v3/projects/07652ced88cf4f069d1765176be5130b/users/716cbbfeede34885b0411e5b9b25df47/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:50.643922 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b9446-0ea1-4d70-aa38-52664abb1990 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:50.644492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b9446-0ea1-4d70-aa38-52664abb1990 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:50.644492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b9446-0ea1-4d70-aa38-52664abb1990 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:50.645893 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 634/1274] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:39:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:39:50.651021 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c795b-0b48-45e2-b0b5-ea0d86c17614 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:50.651445 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c795b-0b48-45e2-b0b5-ea0d86c17614 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:50.651585 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c795b-0b48-45e2-b0b5-ea0d86c17614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:50.667844 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-3b3c795b-0b48-45e2-b0b5-ea0d86c17614 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:50.669652 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-3b3c795b-0b48-45e2-b0b5-ea0d86c17614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:50.737482 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 641/1275] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:39:50 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:39:50.762351 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b9446-0ea1-4d70-aa38-52664abb1990 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:50.865251 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b9446-0ea1-4d70-aa38-52664abb1990 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:50.882330 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:50.898462 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0663f7-dc16-49bd-95af-288eb6fc8551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:50.899244 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0663f7-dc16-49bd-95af-288eb6fc8551 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:50.899527 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0663f7-dc16-49bd-95af-288eb6fc8551 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:50.899801 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0663f7-dc16-49bd-95af-288eb6fc8551 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:50.910535 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0663f7-dc16-49bd-95af-288eb6fc8551 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:39:50.918168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-cc0663f7-dc16-49bd-95af-288eb6fc8551 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:39:50.918168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:50.918168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:50.918168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:50.918168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:50.918168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:50.918168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:50.918168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:50.918168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:50.918168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:50.918168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:50.918168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:50.918168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:39:50.918168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:39:50.918168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:39:50.918168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:39:50.919828 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:39:50.919828 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:39:50.919828 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:39:50.919828 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:39:50.919828 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:50.919828 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:50.919828 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:50.919828 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:50.919828 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:50.919828 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:50.919828 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:50.919828 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:50.919828 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:50.919828 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:50.919828 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:50.919828 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:50.921118 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:50.921118 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:50.921118 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:50.921118 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:50.921118 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:39:50.921118 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:39:50.921118 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:39:50.921118 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:39:50.921118 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:39:50.921118 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:39:50.921118 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:39:50.921118 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:39:50.921118 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 635/1276] 10.222.0.119 () {56 vars in 1101 bytes} [Thu Jul 14 15:39:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:50.926059 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c795b-0b48-45e2-b0b5-ea0d86c17614 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:51.006374 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:51.023934 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c795b-0b48-45e2-b0b5-ea0d86c17614 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:51.058486 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71d7e4-c15c-4eac-9afd-b808c9592e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:51.059175 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71d7e4-c15c-4eac-9afd-b808c9592e19 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:51.059583 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71d7e4-c15c-4eac-9afd-b808c9592e19 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:51.059860 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71d7e4-c15c-4eac-9afd-b808c9592e19 None admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:51.060637 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71d7e4-c15c-4eac-9afd-b808c9592e19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:51.060948 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71d7e4-c15c-4eac-9afd-b808c9592e19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:51.062347 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71d7e4-c15c-4eac-9afd-b808c9592e19 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:51.070544 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 642/1277] 10.222.0.119 () {56 vars in 1104 bytes} [Thu Jul 14 15:39:50 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:51.076297 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0663f7-dc16-49bd-95af-288eb6fc8551 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:51.177196 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0663f7-dc16-49bd-95af-288eb6fc8551 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:51.210280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a6d60-12bb-43cd-82e0-9c373afb002e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:51.211071 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a6d60-12bb-43cd-82e0-9c373afb002e None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:51.211354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a6d60-12bb-43cd-82e0-9c373afb002e None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:51.211708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a6d60-12bb-43cd-82e0-9c373afb002e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:51.229767 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a6d60-12bb-43cd-82e0-9c373afb002e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:51.231939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a6d60-12bb-43cd-82e0-9c373afb002e None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:51.257834 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-c18a6d60-12bb-43cd-82e0-9c373afb002e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:39:51.257834 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:51.257834 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:51.257834 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:51.257834 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:51.257834 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:51.257834 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:51.257834 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:51.257834 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:51.257834 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:51.257834 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:51.257834 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:51.257834 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:39:51.257834 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:39:51.257834 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:39:51.258843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:39:51.258843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:51.258843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:51.258843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:51.258843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:51.258843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:51.258843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:51.258843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:51.258843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:51.258843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:51.258843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:51.258843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:51.258843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:51.258843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:51.258843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:51.258843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:51.258843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:51.259920 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:39:51.259920 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:39:51.259920 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:39:51.259920 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:39:51.259920 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 636/1278] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:51.265682 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71d7e4-c15c-4eac-9afd-b808c9592e19 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:51.369830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71d7e4-c15c-4eac-9afd-b808c9592e19 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:51.403882 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfc7e0-fd27-413b-834e-374c9d270ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:51.405256 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfc7e0-fd27-413b-834e-374c9d270ba5 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:51.405542 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfc7e0-fd27-413b-834e-374c9d270ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:51.405821 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfc7e0-fd27-413b-834e-374c9d270ba5 None admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:51.406557 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfc7e0-fd27-413b-834e-374c9d270ba5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:51.406866 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfc7e0-fd27-413b-834e-374c9d270ba5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:51.408389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfc7e0-fd27-413b-834e-374c9d270ba5 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:51.420858 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 643/1279] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:39:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:51.426756 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a6d60-12bb-43cd-82e0-9c373afb002e None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:51.457403 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:51.529217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a6d60-12bb-43cd-82e0-9c373afb002e None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:51.563699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba618b-eb44-4f1f-90ec-bcb9245d2453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:51.564951 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba618b-eb44-4f1f-90ec-bcb9245d2453 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:51.565259 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba618b-eb44-4f1f-90ec-bcb9245d2453 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:51.565537 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba618b-eb44-4f1f-90ec-bcb9245d2453 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:51.573120 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba618b-eb44-4f1f-90ec-bcb9245d2453 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:51.577611 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba618b-eb44-4f1f-90ec-bcb9245d2453 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:51.594619 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-ffba618b-eb44-4f1f-90ec-bcb9245d2453 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:39:51.594619 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:51.594619 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:51.594619 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:51.594619 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:51.594619 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:51.594619 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:51.594619 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:51.594619 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:51.594619 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:51.594619 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:51.594619 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:51.594619 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:39:51.594619 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:39:51.594619 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:39:51.594619 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:39:51.596294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:51.596294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:51.596294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:39:51.596294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:39:51.596294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:39:51.596294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:39:51.596294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:51.596294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:51.596294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:51.596294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:51.596294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:51.596294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:51.596294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:51.596294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:51.596294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:51.596294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:51.596294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:51.596294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:51.597709 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:51.597709 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:51.597709 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:39:51.597709 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:39:51.597709 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:39:51.597709 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:39:51.597709 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:39:51.597709 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:39:51.597709 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:39:51.597709 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:39:51.597709 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 637/1280] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:39:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:51.602982 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfc7e0-fd27-413b-834e-374c9d270ba5 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:51.610734 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:51.705211 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfc7e0-fd27-413b-834e-374c9d270ba5 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:51.739243 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8dc87-1b84-46f7-a866-7f3629835a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:51.739996 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8dc87-1b84-46f7-a866-7f3629835a5f None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:51.740305 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8dc87-1b84-46f7-a866-7f3629835a5f None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:51.740581 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8dc87-1b84-46f7-a866-7f3629835a5f None admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:51.741410 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8dc87-1b84-46f7-a866-7f3629835a5f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:51.741719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8dc87-1b84-46f7-a866-7f3629835a5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:51.743160 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8dc87-1b84-46f7-a866-7f3629835a5f None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:51.760427 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 644/1281] 10.222.0.119 () {56 vars in 1148 bytes} [Thu Jul 14 15:39:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:51.767765 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba618b-eb44-4f1f-90ec-bcb9245d2453 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:51.856737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:51.866450 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba618b-eb44-4f1f-90ec-bcb9245d2453 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:51.902452 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7e961-08b8-4ac5-9c72-83e7c501e0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:51.903705 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7e961-08b8-4ac5-9c72-83e7c501e0e9 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:51.903826 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7e961-08b8-4ac5-9c72-83e7c501e0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:51.904142 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7e961-08b8-4ac5-9c72-83e7c501e0e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:51.976243 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7e961-08b8-4ac5-9c72-83e7c501e0e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:51.977601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7e961-08b8-4ac5-9c72-83e7c501e0e9 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:52.070850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:52.081192 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 638/1282] 10.222.0.119 () {58 vars in 1287 bytes} [Thu Jul 14 15:39:51 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:39:52.087059 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8dc87-1b84-46f7-a866-7f3629835a5f None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:52.150380 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:52.188130 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8dc87-1b84-46f7-a866-7f3629835a5f None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:52.223038 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151de0e8-98d0-4602-82bb-4675e7e20672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:52.224112 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151de0e8-98d0-4602-82bb-4675e7e20672 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:52.224418 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151de0e8-98d0-4602-82bb-4675e7e20672 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:52.224703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151de0e8-98d0-4602-82bb-4675e7e20672 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:52.234960 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151de0e8-98d0-4602-82bb-4675e7e20672 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:52.236348 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151de0e8-98d0-4602-82bb-4675e7e20672 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:52.255574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-151de0e8-98d0-4602-82bb-4675e7e20672 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:39:52.255574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:52.255574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:52.255574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:52.255574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:52.255574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:52.255574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:52.255574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:52.255574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:52.255574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:52.255574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:52.255574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:52.255574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:39:52.255574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:39:52.255574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:39:52.256790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:39:52.256790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:52.256790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:52.256790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:52.256790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:52.256790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:52.256790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:52.256790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:52.256790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:52.256790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:52.256790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:52.256790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:52.256790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:52.256790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:52.256790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:52.256790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:52.256790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:52.257751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:39:52.257751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:39:52.257751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:39:52.257751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:39:52.257751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 645/1283] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:52.263651 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7e961-08b8-4ac5-9c72-83e7c501e0e9 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:52.363258 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7e961-08b8-4ac5-9c72-83e7c501e0e9 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:52.399025 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7413e51-6e75-4631-bcd4-275ff9cf1ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:52.399681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7413e51-6e75-4631-bcd4-275ff9cf1ad3 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:52.399964 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7413e51-6e75-4631-bcd4-275ff9cf1ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:52.400268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7413e51-6e75-4631-bcd4-275ff9cf1ad3 None admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:52.400985 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7413e51-6e75-4631-bcd4-275ff9cf1ad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:52.401289 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7413e51-6e75-4631-bcd4-275ff9cf1ad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:52.402640 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7413e51-6e75-4631-bcd4-275ff9cf1ad3 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:52.413748 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 639/1284] 10.222.0.119 () {56 vars in 1114 bytes} [Thu Jul 14 15:39:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:52.419598 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151de0e8-98d0-4602-82bb-4675e7e20672 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:52.522550 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151de0e8-98d0-4602-82bb-4675e7e20672 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:52.536811 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:52.556885 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3065115-c9a5-4d5e-97d5-fd52c1105649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:52.557680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3065115-c9a5-4d5e-97d5-fd52c1105649 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:52.557967 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3065115-c9a5-4d5e-97d5-fd52c1105649 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:52.558252 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3065115-c9a5-4d5e-97d5-fd52c1105649 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:52.565494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3065115-c9a5-4d5e-97d5-fd52c1105649 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:52.566943 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3065115-c9a5-4d5e-97d5-fd52c1105649 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:52.581417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application [None req-b3065115-c9a5-4d5e-97d5-fd52c1105649 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:39:52.581417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:52.581417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:52.581417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:52.581417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:52.581417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:52.581417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:52.581417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:52.581417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:52.581417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:52.581417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:52.581417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:52.581417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:39:52.581417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:39:52.581417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:39:52.584751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:39:52.584751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:52.584751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:52.584751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:52.584751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:52.584751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:52.584751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:52.584751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:52.584751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:52.584751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:52.584751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:52.584751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:52.584751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:52.584751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:52.584751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:52.584751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:52.584751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:52.585914 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:39:52.585914 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:39:52.585914 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:39:52.585914 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:39:52.585914 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:39:52.585914 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:39:52.585914 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:39:52.585914 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: ERROR keystone.server.flask.application Jul 14 15:39:52.585914 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 646/1285] 10.222.0.119 () {56 vars in 1116 bytes} [Thu Jul 14 15:39:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:52.588662 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7413e51-6e75-4631-bcd4-275ff9cf1ad3 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:52.639325 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:52.686651 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7413e51-6e75-4631-bcd4-275ff9cf1ad3 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:52.719323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aadbcc-8ee4-4060-ae5d-817a2624870b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:52.719987 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aadbcc-8ee4-4060-ae5d-817a2624870b None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:52.720305 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aadbcc-8ee4-4060-ae5d-817a2624870b None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:52.720585 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aadbcc-8ee4-4060-ae5d-817a2624870b None admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:52.721363 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aadbcc-8ee4-4060-ae5d-817a2624870b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:52.721672 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aadbcc-8ee4-4060-ae5d-817a2624870b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:52.723086 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aadbcc-8ee4-4060-ae5d-817a2624870b None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:52.736773 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 640/1286] 10.222.0.119 () {56 vars in 1153 bytes} [Thu Jul 14 15:39:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:52.743102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3065115-c9a5-4d5e-97d5-fd52c1105649 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:52.843160 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3065115-c9a5-4d5e-97d5-fd52c1105649 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:52.877306 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d41558-99bd-4e5a-b886-9c16338401a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:52.877961 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d41558-99bd-4e5a-b886-9c16338401a7 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:52.878247 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d41558-99bd-4e5a-b886-9c16338401a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:52.878523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d41558-99bd-4e5a-b886-9c16338401a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:52.879348 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d41558-99bd-4e5a-b886-9c16338401a7 None admin] RBAC: Adding query filter params (role.id=07aaf007cde043318319928d151bdc75, scope.project.id=07652ced88cf4f069d1765176be5130b, user.id=716cbbfeede34885b0411e5b9b25df47) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:52.879660 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d41558-99bd-4e5a-b886-9c16338401a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:52.881116 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d41558-99bd-4e5a-b886-9c16338401a7 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:52.886822 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 647/1287] 10.222.0.119 () {56 vars in 1379 bytes} [Thu Jul 14 15:39:52 2022] GET /identity/v3/role_assignments?user.id=716cbbfeede34885b0411e5b9b25df47&scope.project.id=07652ced88cf4f069d1765176be5130b&role.id=07aaf007cde043318319928d151bdc75 => generated 610 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:54.990956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3cabc-98a8-40ea-b521-1ff488d3d23c None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:54.991490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3cabc-98a8-40ea-b521-1ff488d3d23c None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:54.991615 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3cabc-98a8-40ea-b521-1ff488d3d23c None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:54.992960 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 641/1288] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:39:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:39:54.999025 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7896ee-629b-4f8d-97df-704f51d22640 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:54.999444 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7896ee-629b-4f8d-97df-704f51d22640 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:54.999586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7896ee-629b-4f8d-97df-704f51d22640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:55.016462 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-5e7896ee-629b-4f8d-97df-704f51d22640 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:55.017663 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-5e7896ee-629b-4f8d-97df-704f51d22640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:55.048210 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:55.085598 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 648/1289] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:39:54 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:39:55.109083 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3cabc-98a8-40ea-b521-1ff488d3d23c None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:55.212438 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3cabc-98a8-40ea-b521-1ff488d3d23c None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:55.223035 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:55.246779 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c963fc3-cc74-47eb-af4a-5f48a873def9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:55.248181 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c963fc3-cc74-47eb-af4a-5f48a873def9 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:55.248468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c963fc3-cc74-47eb-af4a-5f48a873def9 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:55.248748 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c963fc3-cc74-47eb-af4a-5f48a873def9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:55.249395 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c963fc3-cc74-47eb-af4a-5f48a873def9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:55.250752 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c963fc3-cc74-47eb-af4a-5f48a873def9 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:55.262606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-6c963fc3-cc74-47eb-af4a-5f48a873def9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 15:39:55.262606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:55.262606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:39:55.262606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:39:55.262606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:39:55.262606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:39:55.262606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:39:55.262606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:39:55.262606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 15:39:55.262606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:39:55.262606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:39:55.262606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:39:55.262606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:39:55.262606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:39:55.262606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:39:55.262606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:39:55.262606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:39:55.263948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:39:55.263948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:39:55.263948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:39:55.263948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:39:55.263948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:39:55.263948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:39:55.263948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:39:55.263948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:39:55.263948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:39:55.263948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:39:55.263948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:39:55.263948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:39:55.263948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:39:55.263948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:39:55.263948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:39:55.263948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:39:55.264860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:39:55.264860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:39:55.264860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:39:55.264860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:39:55.264860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:39:55.264860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:39:55.264860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:39:55.264860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:39:55.264860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:39:55.264860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:39:55.264860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:39:55.264860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:39:55.264860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 15:39:55.264860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:39:55.264860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 642/1290] 10.222.0.119 () {56 vars in 1122 bytes} [Thu Jul 14 15:39:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:39:55.269790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7896ee-629b-4f8d-97df-704f51d22640 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:55.370501 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7896ee-629b-4f8d-97df-704f51d22640 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:55.405544 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb5874-ab33-49fd-b866-36eb51293d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:55.406213 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb5874-ab33-49fd-b866-36eb51293d49 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:55.406504 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb5874-ab33-49fd-b866-36eb51293d49 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:55.406783 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb5874-ab33-49fd-b866-36eb51293d49 None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:55.407484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb5874-ab33-49fd-b866-36eb51293d49 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:55.407792 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb5874-ab33-49fd-b866-36eb51293d49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:55.409199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb5874-ab33-49fd-b866-36eb51293d49 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:55.413959 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 649/1291] 10.222.0.119 () {56 vars in 1121 bytes} [Thu Jul 14 15:39:55 2022] GET /identity/v3/services?name=placement => generated 127 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:55.420304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c963fc3-cc74-47eb-af4a-5f48a873def9 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:55.518575 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c963fc3-cc74-47eb-af4a-5f48a873def9 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:55.552803 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe94fd-1f80-41cd-bd62-712233cd6e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:55.553472 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe94fd-1f80-41cd-bd62-712233cd6e45 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:55.553760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe94fd-1f80-41cd-bd62-712233cd6e45 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:55.554041 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe94fd-1f80-41cd-bd62-712233cd6e45 None admin] PATH_INFO: `/v3/services` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:55.554739 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe94fd-1f80-41cd-bd62-712233cd6e45 None admin] RBAC: Adding query filter params (type=placement) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:55.555049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe94fd-1f80-41cd-bd62-712233cd6e45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:55.556533 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe94fd-1f80-41cd-bd62-712233cd6e45 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:55.560997 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 643/1292] 10.222.0.119 () {56 vars in 1121 bytes} [Thu Jul 14 15:39:55 2022] GET /identity/v3/services?type=placement => generated 127 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:57.623152 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6460d1-ec26-49a9-b96b-373a916151f8 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:57.623747 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6460d1-ec26-49a9-b96b-373a916151f8 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:57.623747 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6460d1-ec26-49a9-b96b-373a916151f8 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:57.625144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 650/1293] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:39:57 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:39:57.630311 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa38888-f63e-40c1-b772-5ffdc70924cb None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:57.630727 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa38888-f63e-40c1-b772-5ffdc70924cb None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:57.630964 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa38888-f63e-40c1-b772-5ffdc70924cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:57.648172 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-2aa38888-f63e-40c1-b772-5ffdc70924cb None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:57.649367 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-2aa38888-f63e-40c1-b772-5ffdc70924cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:57.678090 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:57.714933 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 644/1294] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:39:57 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:39:57.737750 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6460d1-ec26-49a9-b96b-373a916151f8 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:57.770770 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:57.841248 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6460d1-ec26-49a9-b96b-373a916151f8 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:57.874728 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d46a10-320d-4cd9-9567-b927e3c3b7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:57.875396 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d46a10-320d-4cd9-9567-b927e3c3b7b8 None admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:57.875687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d46a10-320d-4cd9-9567-b927e3c3b7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:57.875969 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d46a10-320d-4cd9-9567-b927e3c3b7b8 None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:57.876735 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d46a10-320d-4cd9-9567-b927e3c3b7b8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:57.878108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d46a10-320d-4cd9-9567-b927e3c3b7b8 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:58.020528 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 651/1295] 10.222.0.119 () {60 vars in 1146 bytes} [Thu Jul 14 15:39:57 2022] POST /identity/v3/services => generated 247 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:40:00.117772 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addd4b5-1ac2-4f0c-b245-540fa2e674f9 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:00.118308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addd4b5-1ac2-4f0c-b245-540fa2e674f9 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:00.118308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addd4b5-1ac2-4f0c-b245-540fa2e674f9 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:00.119781 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 645/1296] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:40:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:40:00.126280 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48329f3c-0d86-4d82-b8a2-4f9a1af14f39 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:00.129794 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48329f3c-0d86-4d82-b8a2-4f9a1af14f39 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:00.129794 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48329f3c-0d86-4d82-b8a2-4f9a1af14f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:00.144523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-48329f3c-0d86-4d82-b8a2-4f9a1af14f39 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:00.145719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-48329f3c-0d86-4d82-b8a2-4f9a1af14f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:00.221942 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 652/1297] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:40:00 2022] POST /identity/v3/auth/tokens => generated 2216 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:40:00.246100 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addd4b5-1ac2-4f0c-b245-540fa2e674f9 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:00.346840 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addd4b5-1ac2-4f0c-b245-540fa2e674f9 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:00.380090 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4abf42-8129-4a41-8488-278b32ae3c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:00.380841 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4abf42-8129-4a41-8488-278b32ae3c21 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:00.381128 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4abf42-8129-4a41-8488-278b32ae3c21 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:00.381408 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4abf42-8129-4a41-8488-278b32ae3c21 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:00.382053 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4abf42-8129-4a41-8488-278b32ae3c21 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:00.383411 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4abf42-8129-4a41-8488-278b32ae3c21 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:00.395760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-0b4abf42-8129-4a41-8488-278b32ae3c21 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 15:40:00.395760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:40:00.395760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:40:00.395760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:40:00.395760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:40:00.395760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:40:00.395760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:40:00.395760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:40:00.395760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 15:40:00.395760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:40:00.395760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:40:00.395760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:40:00.395760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:40:00.395760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:40:00.395760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:40:00.395760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:40:00.395760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:40:00.397069 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:40:00.397069 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:40:00.397069 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:40:00.397069 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:40:00.397069 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:40:00.397069 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:40:00.397069 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:40:00.397069 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:40:00.397069 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:40:00.397069 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:40:00.397069 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:40:00.397069 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:40:00.397069 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:40:00.397069 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:40:00.397069 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:40:00.397069 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:40:00.398058 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:40:00.398058 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:40:00.398058 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:40:00.398058 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:40:00.398058 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:40:00.398058 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:40:00.398058 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:40:00.398058 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:40:00.398058 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:40:00.398058 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:40:00.398058 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:40:00.398058 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:40:00.398058 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 15:40:00.398058 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:40:00.398058 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 646/1298] 10.222.0.119 () {56 vars in 1122 bytes} [Thu Jul 14 15:40:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:40:00.403018 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48329f3c-0d86-4d82-b8a2-4f9a1af14f39 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:00.421886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:00.501188 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48329f3c-0d86-4d82-b8a2-4f9a1af14f39 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:00.538661 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa278501-af59-4ee4-a689-fd4bdc2491d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:00.539322 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa278501-af59-4ee4-a689-fd4bdc2491d2 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:00.539610 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa278501-af59-4ee4-a689-fd4bdc2491d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:00.539884 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa278501-af59-4ee4-a689-fd4bdc2491d2 None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:00.540615 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa278501-af59-4ee4-a689-fd4bdc2491d2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:40:00.540922 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa278501-af59-4ee4-a689-fd4bdc2491d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:00.542283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa278501-af59-4ee4-a689-fd4bdc2491d2 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:00.547459 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 653/1299] 10.222.0.119 () {56 vars in 1121 bytes} [Thu Jul 14 15:40:00 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:40:00.553499 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4abf42-8129-4a41-8488-278b32ae3c21 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:00.585321 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:00.652437 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4abf42-8129-4a41-8488-278b32ae3c21 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:00.686308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc4db5-946a-410e-b9a1-e8ff2ff92a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:00.686961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc4db5-946a-410e-b9a1-e8ff2ff92a2d None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:00.687317 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc4db5-946a-410e-b9a1-e8ff2ff92a2d None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:00.687604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc4db5-946a-410e-b9a1-e8ff2ff92a2d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:00.688420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc4db5-946a-410e-b9a1-e8ff2ff92a2d None admin] RBAC: Adding query filter params (interface=public, service_id=1df480c6618248378c28d42a2a3d491e, region_id=RegionOne) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:40:00.688732 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc4db5-946a-410e-b9a1-e8ff2ff92a2d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:00.690087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc4db5-946a-410e-b9a1-e8ff2ff92a2d None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:00.695065 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 647/1300] 10.222.0.119 () {56 vars in 1256 bytes} [Thu Jul 14 15:40:00 2022] GET /identity/v3/endpoints?service_id=1df480c6618248378c28d42a2a3d491e&interface=public®ion_id=RegionOne => generated 195 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:40:00.701641 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa278501-af59-4ee4-a689-fd4bdc2491d2 None admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:00.782300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:00.799792 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa278501-af59-4ee4-a689-fd4bdc2491d2 None admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:00.833897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944c63a-2cd9-4b1f-b1c7-52180f6306fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:00.834556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944c63a-2cd9-4b1f-b1c7-52180f6306fe None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:00.834841 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944c63a-2cd9-4b1f-b1c7-52180f6306fe None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:00.835118 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944c63a-2cd9-4b1f-b1c7-52180f6306fe None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:00.835853 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944c63a-2cd9-4b1f-b1c7-52180f6306fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:00.837302 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944c63a-2cd9-4b1f-b1c7-52180f6306fe None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:00.844053 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 654/1301] 10.222.0.119 () {56 vars in 1092 bytes} [Thu Jul 14 15:40:00 2022] GET /identity/v3/services => generated 2201 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:40:02.903534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a4303-101e-4c7e-8168-802a619da70e None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:02.904064 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a4303-101e-4c7e-8168-802a619da70e None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:02.904307 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a4303-101e-4c7e-8168-802a619da70e None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:02.905666 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 648/1302] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:40:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:40:02.911045 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6466ee-3ec0-4985-b694-0daf97473b99 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:02.911459 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6466ee-3ec0-4985-b694-0daf97473b99 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:02.911603 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6466ee-3ec0-4985-b694-0daf97473b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:02.927971 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-ef6466ee-3ec0-4985-b694-0daf97473b99 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:02.929193 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-ef6466ee-3ec0-4985-b694-0daf97473b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:02.996389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 655/1303] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:40:02 2022] POST /identity/v3/auth/tokens => generated 2216 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:40:03.024552 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a4303-101e-4c7e-8168-802a619da70e None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:03.130168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:03.136838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a4303-101e-4c7e-8168-802a619da70e None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:03.170971 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450be84-c6b4-4b7f-b92d-67a7d2c9e087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:03.171703 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450be84-c6b4-4b7f-b92d-67a7d2c9e087 None admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:03.171984 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450be84-c6b4-4b7f-b92d-67a7d2c9e087 None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:03.172288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450be84-c6b4-4b7f-b92d-67a7d2c9e087 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:03.172931 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450be84-c6b4-4b7f-b92d-67a7d2c9e087 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:03.174279 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450be84-c6b4-4b7f-b92d-67a7d2c9e087 None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:03.185901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application [None req-5450be84-c6b4-4b7f-b92d-67a7d2c9e087 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 15:40:03.185901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:40:03.185901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:40:03.185901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:40:03.185901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:40:03.185901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:40:03.185901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:40:03.185901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:40:03.185901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 15:40:03.185901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:40:03.185901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:40:03.185901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:40:03.185901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:40:03.185901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:40:03.185901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:40:03.185901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:40:03.185901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:40:03.188918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:40:03.188918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:40:03.188918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:40:03.188918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:40:03.188918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:40:03.188918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:40:03.188918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:40:03.188918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:40:03.188918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:40:03.188918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:40:03.188918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:40:03.188918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:40:03.188918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:40:03.188918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:40:03.188918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:40:03.188918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:40:03.189956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:40:03.189956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application with Lock( Jul 14 15:40:03.189956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:40:03.189956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:40:03.189956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:40:03.189956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:40:03.189956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:40:03.189956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:40:03.189956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:40:03.189956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:40:03.189956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:40:03.189956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:40:03.189956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 15:40:03.189956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: ERROR keystone.server.flask.application Jul 14 15:40:03.189956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 649/1304] 10.222.0.119 () {56 vars in 1122 bytes} [Thu Jul 14 15:40:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:40:03.193972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6466ee-3ec0-4985-b694-0daf97473b99 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:03.270590 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:03.293016 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6466ee-3ec0-4985-b694-0daf97473b99 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:03.324964 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5336a-7d72-4495-803d-3613af669fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:03.326136 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5336a-7d72-4495-803d-3613af669fd0 None admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:03.326421 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5336a-7d72-4495-803d-3613af669fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:03.326697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5336a-7d72-4495-803d-3613af669fd0 None admin] PATH_INFO: `/v3/services` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:03.327400 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f5336a-7d72-4495-803d-3613af669fd0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:40:03.327710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f5336a-7d72-4495-803d-3613af669fd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:03.329116 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f5336a-7d72-4495-803d-3613af669fd0 None admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:03.334096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 656/1305] 10.222.0.119 () {56 vars in 1121 bytes} [Thu Jul 14 15:40:03 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:40:03.340035 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450be84-c6b4-4b7f-b92d-67a7d2c9e087 None admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:03.444764 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450be84-c6b4-4b7f-b92d-67a7d2c9e087 None admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:03.478690 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bd535-a7c6-41c5-af0d-556ab5e5626a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:03.479397 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bd535-a7c6-41c5-af0d-556ab5e5626a None admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:03.479668 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bd535-a7c6-41c5-af0d-556ab5e5626a None admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:03.479948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bd535-a7c6-41c5-af0d-556ab5e5626a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:03.480736 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bd535-a7c6-41c5-af0d-556ab5e5626a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:03.482243 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bd535-a7c6-41c5-af0d-556ab5e5626a None admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:03.628155 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 650/1306] 10.222.0.119 () {60 vars in 1149 bytes} [Thu Jul 14 15:40:03 2022] POST /identity/v3/endpoints => generated 333 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:40:13.452430 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=30 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:13.622177 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:33.682006 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae9278-56ef-44bc-93a7-385ffa9717c6 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:33.682541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae9278-56ef-44bc-93a7-385ffa9717c6 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:33.682541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae9278-56ef-44bc-93a7-385ffa9717c6 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:33.689909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cd070-65db-4347-b194-178957d9a879 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:33.697420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cd070-65db-4347-b194-178957d9a879 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:33.697420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cd070-65db-4347-b194-178957d9a879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:33.697606 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 657/1307] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:47:33 2022] GET /identity => generated 271 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:47:33.822706 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-7f2cd070-65db-4347-b194-178957d9a879 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:47:33.824242 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-7f2cd070-65db-4347-b194-178957d9a879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:34.023398 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 651/1308] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:47:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:47:34.074576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d5e6c-a9b0-4ca9-919c-5b46337567e1 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:34.075027 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d5e6c-a9b0-4ca9-919c-5b46337567e1 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:34.075419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d5e6c-a9b0-4ca9-919c-5b46337567e1 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:34.077610 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 658/1309] 10.222.0.119 () {54 vars in 969 bytes} [Thu Jul 14 15:47:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:47:34.084384 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804154dd-55bc-49a9-b427-7df666de4a87 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:34.084838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804154dd-55bc-49a9-b427-7df666de4a87 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:34.085189 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804154dd-55bc-49a9-b427-7df666de4a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:34.164677 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-804154dd-55bc-49a9-b427-7df666de4a87 None None] MFA Rules not processed for user `70559c2ce32043dd9a902837ab444622`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:47:34.165962 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-804154dd-55bc-49a9-b427-7df666de4a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:34.188331 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:34.246603 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 652/1310] 10.222.0.119 () {58 vars in 1066 bytes} [Thu Jul 14 15:47:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:47:34.256458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d5e6c-a9b0-4ca9-919c-5b46337567e1 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:34.258391 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-3f5d5e6c-a9b0-4ca9-919c-5b46337567e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:34.380333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d5e6c-a9b0-4ca9-919c-5b46337567e1 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:34.461518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169d2e3-29ff-4240-a978-06e48bfb6052 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:34.462187 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169d2e3-29ff-4240-a978-06e48bfb6052 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:34.462546 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169d2e3-29ff-4240-a978-06e48bfb6052 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:34.462899 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169d2e3-29ff-4240-a978-06e48bfb6052 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:34.464859 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-8169d2e3-29ff-4240-a978-06e48bfb6052 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:34.530666 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:34.589067 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169d2e3-29ff-4240-a978-06e48bfb6052 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:34.590609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169d2e3-29ff-4240-a978-06e48bfb6052 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:34.612394 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 659/1311] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:47:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:47:36.978391 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1759a-dc3e-4f6c-826b-01990b0bd670 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:36.978925 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1759a-dc3e-4f6c-826b-01990b0bd670 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:36.979010 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1759a-dc3e-4f6c-826b-01990b0bd670 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:36.980518 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 653/1312] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:47:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:47:36.986057 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70949677-aaa5-4d52-9818-f34691862e5d None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:36.986503 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70949677-aaa5-4d52-9818-f34691862e5d None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:36.986682 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70949677-aaa5-4d52-9818-f34691862e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:37.072160 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-70949677-aaa5-4d52-9818-f34691862e5d None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:47:37.073638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-70949677-aaa5-4d52-9818-f34691862e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:37.199084 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 660/1313] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:47:37.239881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1759a-dc3e-4f6c-826b-01990b0bd670 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:37.241605 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-24a1759a-dc3e-4f6c-826b-01990b0bd670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:37.357050 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1759a-dc3e-4f6c-826b-01990b0bd670 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:37.439949 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:37.442947 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e91c26-4db0-41f8-92c2-49e3c1319533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:37.443692 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e91c26-4db0-41f8-92c2-49e3c1319533 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:37.444039 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e91c26-4db0-41f8-92c2-49e3c1319533 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:37.444349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e91c26-4db0-41f8-92c2-49e3c1319533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:37.446038 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-d5e91c26-4db0-41f8-92c2-49e3c1319533 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:37.569710 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e91c26-4db0-41f8-92c2-49e3c1319533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:37.571261 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e91c26-4db0-41f8-92c2-49e3c1319533 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:37.591423 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 654/1314] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:47:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:47:40.225289 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7ae38-95a8-4e40-b9c5-792c065d45f5 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:40.225873 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7ae38-95a8-4e40-b9c5-792c065d45f5 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:40.225873 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7ae38-95a8-4e40-b9c5-792c065d45f5 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:40.227223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 661/1315] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:47:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:47:40.232361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae9939-42e4-4dfc-9a2b-5f8d981168a0 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:40.232763 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae9939-42e4-4dfc-9a2b-5f8d981168a0 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:40.233025 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae9939-42e4-4dfc-9a2b-5f8d981168a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:40.299174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-55ae9939-42e4-4dfc-9a2b-5f8d981168a0 None None] MFA Rules not processed for user `cdfa06df351a47d0a2012673e01f5556`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:47:40.300411 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-55ae9939-42e4-4dfc-9a2b-5f8d981168a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:40.351480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:40.394646 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 655/1316] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:47:40 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:47:40.435244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7ae38-95a8-4e40-b9c5-792c065d45f5 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:40.436856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-4fd7ae38-95a8-4e40-b9c5-792c065d45f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:40.446692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:40.540877 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7ae38-95a8-4e40-b9c5-792c065d45f5 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:40.618755 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edf196-893a-4da3-8c0e-78f6d17809ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:40.619404 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edf196-893a-4da3-8c0e-78f6d17809ca service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:40.619695 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edf196-893a-4da3-8c0e-78f6d17809ca service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:40.619979 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edf196-893a-4da3-8c0e-78f6d17809ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:40.621674 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-82edf196-893a-4da3-8c0e-78f6d17809ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:40.683614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:40.729814 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82edf196-893a-4da3-8c0e-78f6d17809ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:40.731262 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82edf196-893a-4da3-8c0e-78f6d17809ca service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:40.749802 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 662/1317] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:47:40 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:47:43.642440 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecd9bb-c360-4f16-85e9-44a0af0307df None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:43.643002 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecd9bb-c360-4f16-85e9-44a0af0307df None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:43.643002 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecd9bb-c360-4f16-85e9-44a0af0307df None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:43.644431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 656/1318] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:47:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:47:43.649729 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df21045-e5e1-4fcd-a573-7e21ecd2ad3a None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:43.650133 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df21045-e5e1-4fcd-a573-7e21ecd2ad3a None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:43.650283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df21045-e5e1-4fcd-a573-7e21ecd2ad3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:43.715219 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-1df21045-e5e1-4fcd-a573-7e21ecd2ad3a None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:47:43.716445 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-1df21045-e5e1-4fcd-a573-7e21ecd2ad3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:43.809505 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 663/1319] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:47:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:47:43.849375 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecd9bb-c360-4f16-85e9-44a0af0307df None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:43.850913 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-43ecd9bb-c360-4f16-85e9-44a0af0307df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:43.954551 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecd9bb-c360-4f16-85e9-44a0af0307df None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:44.026461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2450a-bef4-4d3a-b892-536c498f0695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:44.027114 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2450a-bef4-4d3a-b892-536c498f0695 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:44.027401 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2450a-bef4-4d3a-b892-536c498f0695 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:44.027675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2450a-bef4-4d3a-b892-536c498f0695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:44.029335 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-d1f2450a-bef4-4d3a-b892-536c498f0695 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:44.037296 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:44.137164 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2450a-bef4-4d3a-b892-536c498f0695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:44.138600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2450a-bef4-4d3a-b892-536c498f0695 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:44.156956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 657/1320] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:47:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:47:47.415741 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6e1e9-64ef-451b-a17f-56b7bf2cded9 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:47.416484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6e1e9-64ef-451b-a17f-56b7bf2cded9 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:47.416484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6e1e9-64ef-451b-a17f-56b7bf2cded9 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:47.417754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 664/1321] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:47:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:47:47.423526 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bf68b-b6e5-46bf-b3a8-14e821df54cd None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:47.423937 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bf68b-b6e5-46bf-b3a8-14e821df54cd None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:47.424160 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bf68b-b6e5-46bf-b3a8-14e821df54cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:47.490900 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-952bf68b-b6e5-46bf-b3a8-14e821df54cd None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:47:47.492149 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-952bf68b-b6e5-46bf-b3a8-14e821df54cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:47.566188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:47.605175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 658/1322] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:47:47.642968 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6e1e9-64ef-451b-a17f-56b7bf2cded9 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:47.644660 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-84c6e1e9-64ef-451b-a17f-56b7bf2cded9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:47.667830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:47.760339 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6e1e9-64ef-451b-a17f-56b7bf2cded9 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:47.839201 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657f060-273e-4762-8327-d25475762d91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:47.839775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657f060-273e-4762-8327-d25475762d91 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:47.840062 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657f060-273e-4762-8327-d25475762d91 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:47.840369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657f060-273e-4762-8327-d25475762d91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:47.842006 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-a657f060-273e-4762-8327-d25475762d91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:47.915653 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:47.955332 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657f060-273e-4762-8327-d25475762d91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:47.956758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657f060-273e-4762-8327-d25475762d91 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:47.975607 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 665/1323] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:47:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:47:50.076986 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f49464-5430-4b35-822a-1a527a16a8b2 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:50.077553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f49464-5430-4b35-822a-1a527a16a8b2 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:50.077643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f49464-5430-4b35-822a-1a527a16a8b2 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:50.079360 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 659/1324] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:47:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:47:50.084626 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de38197-d8c2-4a91-8743-6929c875095c None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:50.085072 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de38197-d8c2-4a91-8743-6929c875095c None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:50.085321 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de38197-d8c2-4a91-8743-6929c875095c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:50.149967 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-0de38197-d8c2-4a91-8743-6929c875095c None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:47:50.151081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-0de38197-d8c2-4a91-8743-6929c875095c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:50.246907 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 666/1325] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:47:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:47:50.285445 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f49464-5430-4b35-822a-1a527a16a8b2 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:50.286971 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-d2f49464-5430-4b35-822a-1a527a16a8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:50.391702 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f49464-5430-4b35-822a-1a527a16a8b2 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:50.465284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31afded-543a-47d2-9842-f88a1d9753bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:50.465853 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31afded-543a-47d2-9842-f88a1d9753bf service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:50.466139 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31afded-543a-47d2-9842-f88a1d9753bf service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:50.466415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31afded-543a-47d2-9842-f88a1d9753bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:50.468767 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-d31afded-543a-47d2-9842-f88a1d9753bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:50.485447 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:50.586365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31afded-543a-47d2-9842-f88a1d9753bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:50.588021 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31afded-543a-47d2-9842-f88a1d9753bf service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:50.606941 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 660/1326] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:47:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:47:52.724380 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20838f0e-c32c-4b7a-a53e-b5413069b598 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:52.724984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20838f0e-c32c-4b7a-a53e-b5413069b598 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:52.724984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20838f0e-c32c-4b7a-a53e-b5413069b598 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:52.726297 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 667/1327] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:47:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:47:52.731542 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc739070-a29c-482c-a6ff-eb9685b685c5 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:52.732002 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc739070-a29c-482c-a6ff-eb9685b685c5 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:52.732120 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc739070-a29c-482c-a6ff-eb9685b685c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:52.802016 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-cc739070-a29c-482c-a6ff-eb9685b685c5 None None] MFA Rules not processed for user `cdfa06df351a47d0a2012673e01f5556`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:47:52.803157 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-cc739070-a29c-482c-a6ff-eb9685b685c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:52.866969 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:52.899389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 661/1328] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:47:52 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:47:52.938370 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20838f0e-c32c-4b7a-a53e-b5413069b598 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:52.939920 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-20838f0e-c32c-4b7a-a53e-b5413069b598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:52.972280 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:53.051314 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20838f0e-c32c-4b7a-a53e-b5413069b598 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:53.126011 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c189164-fb6c-4fd5-aae2-069c0199bdc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:53.126747 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c189164-fb6c-4fd5-aae2-069c0199bdc5 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:53.127039 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c189164-fb6c-4fd5-aae2-069c0199bdc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:53.127323 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c189164-fb6c-4fd5-aae2-069c0199bdc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:53.129244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-3c189164-fb6c-4fd5-aae2-069c0199bdc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:53.209811 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:53.242630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c189164-fb6c-4fd5-aae2-069c0199bdc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:53.244487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c189164-fb6c-4fd5-aae2-069c0199bdc5 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:53.267736 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 668/1329] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:47:52 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:47:55.925401 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72aacd-e8ae-4ccc-9d5d-a8f6afcc1784 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:55.925967 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72aacd-e8ae-4ccc-9d5d-a8f6afcc1784 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:55.925967 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72aacd-e8ae-4ccc-9d5d-a8f6afcc1784 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:55.927343 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 662/1330] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:47:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:47:55.932607 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e66de-76a5-4ca7-b059-4324cf711105 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:55.933028 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e66de-76a5-4ca7-b059-4324cf711105 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:55.933163 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e66de-76a5-4ca7-b059-4324cf711105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:55.997481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-9b2e66de-76a5-4ca7-b059-4324cf711105 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:47:55.999383 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-9b2e66de-76a5-4ca7-b059-4324cf711105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:56.094131 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 669/1331] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:47:56.131788 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72aacd-e8ae-4ccc-9d5d-a8f6afcc1784 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:56.133413 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-4b72aacd-e8ae-4ccc-9d5d-a8f6afcc1784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:56.238007 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72aacd-e8ae-4ccc-9d5d-a8f6afcc1784 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:56.309458 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38155bfc-c051-4e71-9d03-44d653e53e96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:56.310098 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38155bfc-c051-4e71-9d03-44d653e53e96 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:56.310384 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38155bfc-c051-4e71-9d03-44d653e53e96 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:56.310660 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38155bfc-c051-4e71-9d03-44d653e53e96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:56.312460 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-38155bfc-c051-4e71-9d03-44d653e53e96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:56.338711 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:56.418235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38155bfc-c051-4e71-9d03-44d653e53e96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:56.419653 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38155bfc-c051-4e71-9d03-44d653e53e96 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:56.437862 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 663/1332] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:47:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:47:58.557685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d11bcd-9c7e-40d2-926e-d08575fd5053 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:58.558211 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d11bcd-9c7e-40d2-926e-d08575fd5053 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:58.558211 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d11bcd-9c7e-40d2-926e-d08575fd5053 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:58.559604 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 670/1333] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:47:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:47:58.565492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45efc9-b8aa-45ad-b870-9b7b12d3eb2f None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:58.565920 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45efc9-b8aa-45ad-b870-9b7b12d3eb2f None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:58.566056 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45efc9-b8aa-45ad-b870-9b7b12d3eb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:58.631476 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-6a45efc9-b8aa-45ad-b870-9b7b12d3eb2f None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:47:58.632703 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-6a45efc9-b8aa-45ad-b870-9b7b12d3eb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:58.707812 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:58.729998 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 664/1334] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:47:58.770963 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d11bcd-9c7e-40d2-926e-d08575fd5053 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:58.772630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-b3d11bcd-9c7e-40d2-926e-d08575fd5053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:58.812685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:58.876070 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d11bcd-9c7e-40d2-926e-d08575fd5053 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:58.947369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61ca3d-b2ad-4068-b899-98140af8ead7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:58.948014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61ca3d-b2ad-4068-b899-98140af8ead7 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:58.948329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61ca3d-b2ad-4068-b899-98140af8ead7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:58.948603 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61ca3d-b2ad-4068-b899-98140af8ead7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:58.950224 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-3b61ca3d-b2ad-4068-b899-98140af8ead7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:59.033720 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:59.059310 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61ca3d-b2ad-4068-b899-98140af8ead7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:59.060801 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61ca3d-b2ad-4068-b899-98140af8ead7 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:59.079958 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 671/1335] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:47:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:01.792502 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10302b0d-00ac-4797-beb7-05bd6784316b None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:01.793028 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10302b0d-00ac-4797-beb7-05bd6784316b None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:01.793028 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10302b0d-00ac-4797-beb7-05bd6784316b None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:01.794354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 665/1336] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:48:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:48:01.800559 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ea11f-0589-4235-846e-f620bfb8b88d None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:01.800959 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ea11f-0589-4235-846e-f620bfb8b88d None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:01.801136 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ea11f-0589-4235-846e-f620bfb8b88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:01.866072 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-8b6ea11f-0589-4235-846e-f620bfb8b88d None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:01.867293 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-8b6ea11f-0589-4235-846e-f620bfb8b88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:01.963337 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 672/1337] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:48:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:48:02.000812 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10302b0d-00ac-4797-beb7-05bd6784316b None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:02.002334 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-10302b0d-00ac-4797-beb7-05bd6784316b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:02.103645 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10302b0d-00ac-4797-beb7-05bd6784316b None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:02.176050 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330ba7a-0b86-4eb6-884d-bce0279c3842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:02.176724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330ba7a-0b86-4eb6-884d-bce0279c3842 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:02.177006 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330ba7a-0b86-4eb6-884d-bce0279c3842 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:02.177286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330ba7a-0b86-4eb6-884d-bce0279c3842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:02.178927 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-c330ba7a-0b86-4eb6-884d-bce0279c3842 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:02.215210 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:02.288954 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330ba7a-0b86-4eb6-884d-bce0279c3842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:02.290401 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330ba7a-0b86-4eb6-884d-bce0279c3842 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:02.311995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 666/1338] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:48:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:06.556999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820d3a9-2adc-4f34-bdec-8fead1fbc0e6 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:06.557521 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820d3a9-2adc-4f34-bdec-8fead1fbc0e6 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:06.557790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820d3a9-2adc-4f34-bdec-8fead1fbc0e6 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:06.560591 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 673/1339] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:48:06 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:48:06.566285 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad59a1-6a02-4616-993a-cbf21e4e97b4 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:06.566733 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad59a1-6a02-4616-993a-cbf21e4e97b4 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:06.566850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad59a1-6a02-4616-993a-cbf21e4e97b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:06.642300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-76ad59a1-6a02-4616-993a-cbf21e4e97b4 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:06.643514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-76ad59a1-6a02-4616-993a-cbf21e4e97b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:06.733179 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:06.744283 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 667/1340] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:48:06.799474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fe929-8577-4a58-a12b-ab7bdb3e1d5a None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:06.799767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fe929-8577-4a58-a12b-ab7bdb3e1d5a None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:06.800048 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fe929-8577-4a58-a12b-ab7bdb3e1d5a None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:06.801466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 674/1341] 10.222.0.119 () {54 vars in 969 bytes} [Thu Jul 14 15:48:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:48:06.807562 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f481c6-2878-493d-be88-3ba259a44d50 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:06.807990 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f481c6-2878-493d-be88-3ba259a44d50 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:06.808297 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f481c6-2878-493d-be88-3ba259a44d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:06.885226 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-d3f481c6-2878-493d-be88-3ba259a44d50 None None] MFA Rules not processed for user `70559c2ce32043dd9a902837ab444622`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:06.886346 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-d3f481c6-2878-493d-be88-3ba259a44d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:06.964542 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 668/1342] 10.222.0.119 () {58 vars in 1066 bytes} [Thu Jul 14 15:48:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:48:06.974038 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fe929-8577-4a58-a12b-ab7bdb3e1d5a None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:06.975598 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-880fe929-8577-4a58-a12b-ab7bdb3e1d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:07.028362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:07.106332 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fe929-8577-4a58-a12b-ab7bdb3e1d5a None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:07.182379 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a76ff-17a7-441f-8a06-5dc3bd069766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:07.183027 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a76ff-17a7-441f-8a06-5dc3bd069766 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:07.183311 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a76ff-17a7-441f-8a06-5dc3bd069766 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:07.183595 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a76ff-17a7-441f-8a06-5dc3bd069766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:07.185260 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-900a76ff-17a7-441f-8a06-5dc3bd069766 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:07.295433 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:07.312369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a76ff-17a7-441f-8a06-5dc3bd069766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:07.313844 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a76ff-17a7-441f-8a06-5dc3bd069766 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:07.333109 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 675/1343] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:48:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:11.069944 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05037d2b-abd9-4f6e-bfa6-5e5f6732ab4e None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:11.070536 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05037d2b-abd9-4f6e-bfa6-5e5f6732ab4e None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:11.070536 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05037d2b-abd9-4f6e-bfa6-5e5f6732ab4e None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:11.071932 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 669/1344] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:48:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:48:11.078920 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1da25-7555-47e5-bb56-b59d63d65989 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:11.079496 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1da25-7555-47e5-bb56-b59d63d65989 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:11.079496 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1da25-7555-47e5-bb56-b59d63d65989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:11.145887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-bbc1da25-7555-47e5-bb56-b59d63d65989 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:11.147096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-bbc1da25-7555-47e5-bb56-b59d63d65989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:11.247007 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 676/1345] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:48:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:48:11.287947 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05037d2b-abd9-4f6e-bfa6-5e5f6732ab4e None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:11.290382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-05037d2b-abd9-4f6e-bfa6-5e5f6732ab4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:11.382725 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:11.399608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05037d2b-abd9-4f6e-bfa6-5e5f6732ab4e None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:11.501511 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf174dd-2cf1-42a5-950f-3b1f1c9458e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:11.502097 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf174dd-2cf1-42a5-950f-3b1f1c9458e6 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:11.502383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf174dd-2cf1-42a5-950f-3b1f1c9458e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:11.502661 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf174dd-2cf1-42a5-950f-3b1f1c9458e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:11.504379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-6cf174dd-2cf1-42a5-950f-3b1f1c9458e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:11.649613 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf174dd-2cf1-42a5-950f-3b1f1c9458e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:11.655635 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf174dd-2cf1-42a5-950f-3b1f1c9458e6 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:11.672436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 670/1346] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:48:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:15.974249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b2e74-5ed6-485b-bbbb-f61c1dbb0164 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:15.974768 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b2e74-5ed6-485b-bbbb-f61c1dbb0164 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:15.974892 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b2e74-5ed6-485b-bbbb-f61c1dbb0164 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:15.976378 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 677/1347] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:48:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:48:15.981713 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965cf7e-3807-474f-b962-adc1136700f6 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:15.982186 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965cf7e-3807-474f-b962-adc1136700f6 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:15.982814 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965cf7e-3807-474f-b962-adc1136700f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:15.997776 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:16.056531 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-4965cf7e-3807-474f-b962-adc1136700f6 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:16.057694 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-4965cf7e-3807-474f-b962-adc1136700f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:16.157871 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 671/1348] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:48:16.199102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b2e74-5ed6-485b-bbbb-f61c1dbb0164 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:16.200675 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f78b2e74-5ed6-485b-bbbb-f61c1dbb0164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:16.266058 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:16.313954 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b2e74-5ed6-485b-bbbb-f61c1dbb0164 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:16.386467 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff263c7f-b102-4061-9e92-344f7af0903e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:16.387107 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff263c7f-b102-4061-9e92-344f7af0903e service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:16.387395 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff263c7f-b102-4061-9e92-344f7af0903e service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:16.387674 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff263c7f-b102-4061-9e92-344f7af0903e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:16.389471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-ff263c7f-b102-4061-9e92-344f7af0903e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:16.493486 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:16.497247 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff263c7f-b102-4061-9e92-344f7af0903e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:16.499189 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff263c7f-b102-4061-9e92-344f7af0903e service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:16.518197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 678/1349] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:48:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:21.499848 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dbaf1-cc1a-4fd6-b193-ce0f3f0597de None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:21.500386 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dbaf1-cc1a-4fd6-b193-ce0f3f0597de None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:21.500495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dbaf1-cc1a-4fd6-b193-ce0f3f0597de None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:21.502242 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 672/1350] 10.222.0.119 () {54 vars in 926 bytes} [Thu Jul 14 15:48:21 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:48:21.521997 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef28c5-5a2c-48fa-8016-a57875dc75ee None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:21.522478 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef28c5-5a2c-48fa-8016-a57875dc75ee None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:21.522558 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef28c5-5a2c-48fa-8016-a57875dc75ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:21.617247 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-85ef28c5-5a2c-48fa-8016-a57875dc75ee None None] MFA Rules not processed for user `716cbbfeede34885b0411e5b9b25df47`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:21.618454 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-85ef28c5-5a2c-48fa-8016-a57875dc75ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:21.738361 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 679/1351] 10.222.0.119 () {58 vars in 1023 bytes} [Thu Jul 14 15:48:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:48:25.982920 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a733e3-c397-4d4e-8dd3-e25d2bedfb13 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:25.984088 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a733e3-c397-4d4e-8dd3-e25d2bedfb13 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:25.984088 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a733e3-c397-4d4e-8dd3-e25d2bedfb13 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:25.985691 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 673/1352] 10.222.0.119 () {54 vars in 926 bytes} [Thu Jul 14 15:48:25 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:48:25.991255 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d38a8-0d8a-4d1a-97e0-90c29da126c0 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:25.991718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d38a8-0d8a-4d1a-97e0-90c29da126c0 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:25.991866 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d38a8-0d8a-4d1a-97e0-90c29da126c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:26.056044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:26.082851 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-491d38a8-0d8a-4d1a-97e0-90c29da126c0 None None] MFA Rules not processed for user `716cbbfeede34885b0411e5b9b25df47`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:26.084350 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-491d38a8-0d8a-4d1a-97e0-90c29da126c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:26.156252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=59 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:26.202464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 680/1353] 10.222.0.119 () {58 vars in 1023 bytes} [Thu Jul 14 15:48:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:48:27.583991 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26183984-9474-42a2-a185-5731d78fa400 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:27.584535 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26183984-9474-42a2-a185-5731d78fa400 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:27.584645 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26183984-9474-42a2-a185-5731d78fa400 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:27.585975 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 674/1354] 10.222.0.119 () {54 vars in 926 bytes} [Thu Jul 14 15:48:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:48:27.591169 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57c00b-a750-4d68-8556-443b18324d1d None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:27.592134 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57c00b-a750-4d68-8556-443b18324d1d None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:27.592363 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57c00b-a750-4d68-8556-443b18324d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:27.670829 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-ca57c00b-a750-4d68-8556-443b18324d1d None None] MFA Rules not processed for user `716cbbfeede34885b0411e5b9b25df47`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:27.672119 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-ca57c00b-a750-4d68-8556-443b18324d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:27.713326 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:27.778119 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 681/1355] 10.222.0.119 () {58 vars in 1023 bytes} [Thu Jul 14 15:48:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:48:31.277687 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a96e3e-2893-4a67-874c-801a606b4547 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:31.278212 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a96e3e-2893-4a67-874c-801a606b4547 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:31.278212 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a96e3e-2893-4a67-874c-801a606b4547 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:31.279765 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 675/1356] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:48:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:48:31.286112 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c8d8c-d30d-4b01-82ef-9ec4a204a4be None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:31.286989 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c8d8c-d30d-4b01-82ef-9ec4a204a4be None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:31.287473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c8d8c-d30d-4b01-82ef-9ec4a204a4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:31.365832 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-222c8d8c-d30d-4b01-82ef-9ec4a204a4be None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:31.367032 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-222c8d8c-d30d-4b01-82ef-9ec4a204a4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:31.472901 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 682/1357] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:48:31.530846 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f280f-229e-4409-85e0-b1e18b829f87 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:31.531661 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f280f-229e-4409-85e0-b1e18b829f87 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:31.532218 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f280f-229e-4409-85e0-b1e18b829f87 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:31.534057 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 676/1358] 10.222.0.119 () {54 vars in 966 bytes} [Thu Jul 14 15:48:31 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:48:31.541089 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e59d1-7677-4f7d-87f8-7377eebd9707 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:31.541379 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e59d1-7677-4f7d-87f8-7377eebd9707 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:31.541831 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e59d1-7677-4f7d-87f8-7377eebd9707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:31.562192 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:31.635735 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-986e59d1-7677-4f7d-87f8-7377eebd9707 None None] MFA Rules not processed for user `a1e4c833a4684561ab52eda5734a7766`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:31.637104 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-986e59d1-7677-4f7d-87f8-7377eebd9707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:31.764020 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 683/1359] 10.222.0.119 () {58 vars in 1063 bytes} [Thu Jul 14 15:48:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:48:31.773382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f280f-229e-4409-85e0-b1e18b829f87 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:31.775303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-6c3f280f-229e-4409-85e0-b1e18b829f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:31.941476 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f280f-229e-4409-85e0-b1e18b829f87 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:32.028286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:32.067756 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1226c-ef55-438e-8cc0-dc37394820d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:32.068462 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1226c-ef55-438e-8cc0-dc37394820d0 service nova] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:32.068749 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1226c-ef55-438e-8cc0-dc37394820d0 service nova] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:32.069027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1226c-ef55-438e-8cc0-dc37394820d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:32.070654 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-deb1226c-ef55-438e-8cc0-dc37394820d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:32.167431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1226c-ef55-438e-8cc0-dc37394820d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:32.170113 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1226c-ef55-438e-8cc0-dc37394820d0 service nova] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:32.190734 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 677/1360] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:48:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:34.494241 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a85fb-cdc7-4177-97c9-51a2a0c8cafe None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:34.494691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a85fb-cdc7-4177-97c9-51a2a0c8cafe None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:34.494815 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a85fb-cdc7-4177-97c9-51a2a0c8cafe None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:34.496225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 684/1361] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:48:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:48:34.502443 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94289d-f0e2-4ec9-a4fd-74d84680985b None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:34.502852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94289d-f0e2-4ec9-a4fd-74d84680985b None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:34.503080 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94289d-f0e2-4ec9-a4fd-74d84680985b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:34.574852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-8c94289d-f0e2-4ec9-a4fd-74d84680985b None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:34.577071 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-8c94289d-f0e2-4ec9-a4fd-74d84680985b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:34.617819 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:34.681401 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 678/1362] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:48:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:48:34.728867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a85fb-cdc7-4177-97c9-51a2a0c8cafe None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:34.730850 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-d41a85fb-cdc7-4177-97c9-51a2a0c8cafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:34.807436 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:34.897580 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a85fb-cdc7-4177-97c9-51a2a0c8cafe None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:35.022726 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b28f1c-a52c-470e-bde7-c1f8fd018276 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:35.023521 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b28f1c-a52c-470e-bde7-c1f8fd018276 service nova] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:35.024295 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b28f1c-a52c-470e-bde7-c1f8fd018276 service nova] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:35.024589 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b28f1c-a52c-470e-bde7-c1f8fd018276 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:35.026499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-01b28f1c-a52c-470e-bde7-c1f8fd018276 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:35.052945 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:35.126869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b28f1c-a52c-470e-bde7-c1f8fd018276 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:35.128594 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b28f1c-a52c-470e-bde7-c1f8fd018276 service nova] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:35.147815 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 685/1363] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:48:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:37.663429 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e329836-f8e5-4df7-a882-21c754fc3f35 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:37.663984 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e329836-f8e5-4df7-a882-21c754fc3f35 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:37.664368 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e329836-f8e5-4df7-a882-21c754fc3f35 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:37.665866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 679/1364] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:48:37 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:48:37.672368 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed702f73-39a4-41bc-a8fc-b28dc3414aab None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:37.672851 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed702f73-39a4-41bc-a8fc-b28dc3414aab None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:37.673093 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed702f73-39a4-41bc-a8fc-b28dc3414aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:37.758880 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-ed702f73-39a4-41bc-a8fc-b28dc3414aab None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:37.760481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-ed702f73-39a4-41bc-a8fc-b28dc3414aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:37.870312 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:37.873816 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 686/1365] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:48:37.922612 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906f5b3-c4b9-4e73-b9aa-f59332f09af8 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:37.922909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906f5b3-c4b9-4e73-b9aa-f59332f09af8 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:37.923471 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906f5b3-c4b9-4e73-b9aa-f59332f09af8 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:37.925557 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 680/1366] 10.222.0.119 () {54 vars in 966 bytes} [Thu Jul 14 15:48:37 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:48:37.931320 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76eb8f-d8b2-4bf9-893b-2350a3758f29 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:37.931635 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76eb8f-d8b2-4bf9-893b-2350a3758f29 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:37.931904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76eb8f-d8b2-4bf9-893b-2350a3758f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:38.014051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-3f76eb8f-d8b2-4bf9-893b-2350a3758f29 None None] MFA Rules not processed for user `a1e4c833a4684561ab52eda5734a7766`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:38.015556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-3f76eb8f-d8b2-4bf9-893b-2350a3758f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:38.141648 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 687/1367] 10.222.0.119 () {58 vars in 1063 bytes} [Thu Jul 14 15:48:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:48:38.149367 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906f5b3-c4b9-4e73-b9aa-f59332f09af8 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:38.150996 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-7906f5b3-c4b9-4e73-b9aa-f59332f09af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:38.315959 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906f5b3-c4b9-4e73-b9aa-f59332f09af8 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:38.337944 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:38.441912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ee6bf-a435-4587-b31a-3b163edbafa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:38.442486 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ee6bf-a435-4587-b31a-3b163edbafa3 service nova] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:38.442779 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ee6bf-a435-4587-b31a-3b163edbafa3 service nova] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:38.443056 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ee6bf-a435-4587-b31a-3b163edbafa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:38.444733 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-2f6ee6bf-a435-4587-b31a-3b163edbafa3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:38.552989 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ee6bf-a435-4587-b31a-3b163edbafa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:38.554593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ee6bf-a435-4587-b31a-3b163edbafa3 service nova] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:38.574327 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 681/1368] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:48:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:39.631040 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81338b44-2303-4e13-8430-691eca20d5f4 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:39.631576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81338b44-2303-4e13-8430-691eca20d5f4 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:39.631842 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81338b44-2303-4e13-8430-691eca20d5f4 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:39.633362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 688/1369] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:48:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:48:39.638962 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a719e55-9634-401b-be8f-d77786459767 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:39.639403 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a719e55-9634-401b-be8f-d77786459767 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:39.639598 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a719e55-9634-401b-be8f-d77786459767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:39.673480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:39.709131 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-1a719e55-9634-401b-be8f-d77786459767 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:39.710349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-1a719e55-9634-401b-be8f-d77786459767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:39.820260 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 682/1370] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:48:40.173238 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e6832-5b88-4744-9eb6-b6f921cf215b None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:40.173238 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e6832-5b88-4744-9eb6-b6f921cf215b None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:40.173238 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e6832-5b88-4744-9eb6-b6f921cf215b None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:40.174615 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 689/1371] 10.222.0.119 () {54 vars in 968 bytes} [Thu Jul 14 15:48:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:48:40.178580 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492bffc-91f6-4442-ac1b-18ae27179daf None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:40.179924 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492bffc-91f6-4442-ac1b-18ae27179daf None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:40.179924 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492bffc-91f6-4442-ac1b-18ae27179daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:40.259846 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-8492bffc-91f6-4442-ac1b-18ae27179daf None None] MFA Rules not processed for user `d96e2cb043e64d04b3f7628a3419a064`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:40.261105 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-8492bffc-91f6-4442-ac1b-18ae27179daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:40.313227 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:40.351752 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 683/1372] 10.222.0.119 () {58 vars in 1065 bytes} [Thu Jul 14 15:48:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:48:40.360152 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e6832-5b88-4744-9eb6-b6f921cf215b None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:40.361666 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-df8e6832-5b88-4744-9eb6-b6f921cf215b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:40.415889 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:40.478032 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e6832-5b88-4744-9eb6-b6f921cf215b None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:40.565357 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662554a9-a3bc-4fbb-bd3a-a5f3918d2706 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:40.566021 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662554a9-a3bc-4fbb-bd3a-a5f3918d2706 service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:40.566365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662554a9-a3bc-4fbb-bd3a-a5f3918d2706 service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:40.566651 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662554a9-a3bc-4fbb-bd3a-a5f3918d2706 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:40.568340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-662554a9-a3bc-4fbb-bd3a-a5f3918d2706 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:40.672138 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:40.689144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662554a9-a3bc-4fbb-bd3a-a5f3918d2706 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:40.690735 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662554a9-a3bc-4fbb-bd3a-a5f3918d2706 service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:40.712897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 690/1373] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:48:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:40.932381 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e242f-7d05-4f3d-ab11-651f3570979f None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:40.932892 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e242f-7d05-4f3d-ab11-651f3570979f None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:40.933289 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e242f-7d05-4f3d-ab11-651f3570979f None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:40.934668 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 684/1374] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:48:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:48:40.940000 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fea1f-4d4f-4320-b61b-688651079fc8 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:40.940460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fea1f-4d4f-4320-b61b-688651079fc8 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:40.941064 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fea1f-4d4f-4320-b61b-688651079fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:41.037909 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-511fea1f-4d4f-4320-b61b-688651079fc8 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:41.039260 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-511fea1f-4d4f-4320-b61b-688651079fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:41.162412 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 691/1375] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:48:41.208282 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e242f-7d05-4f3d-ab11-651f3570979f None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:41.209853 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-f37e242f-7d05-4f3d-ab11-651f3570979f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:41.359112 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e242f-7d05-4f3d-ab11-651f3570979f None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:41.416352 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:41.481474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a9e0d-4bcd-467a-b232-62e37333b33b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:41.482740 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a9e0d-4bcd-467a-b232-62e37333b33b service nova] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:41.483025 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a9e0d-4bcd-467a-b232-62e37333b33b service nova] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:41.483497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a9e0d-4bcd-467a-b232-62e37333b33b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:41.485361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-724a9e0d-4bcd-467a-b232-62e37333b33b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:41.575994 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a9e0d-4bcd-467a-b232-62e37333b33b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:41.577695 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a9e0d-4bcd-467a-b232-62e37333b33b service nova] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:41.597840 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 685/1376] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:48:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:43.818564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a74db-d594-496c-bc2d-e33bf0c9cb19 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:43.819090 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a74db-d594-496c-bc2d-e33bf0c9cb19 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:43.819197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a74db-d594-496c-bc2d-e33bf0c9cb19 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:43.820556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 692/1377] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:48:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:48:43.825765 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564c9fd-c973-4fcb-b691-af00bbb09ad6 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:43.826304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564c9fd-c973-4fcb-b691-af00bbb09ad6 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:43.826433 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564c9fd-c973-4fcb-b691-af00bbb09ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:43.892126 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-f564c9fd-c973-4fcb-b691-af00bbb09ad6 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:43.893444 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-f564c9fd-c973-4fcb-b691-af00bbb09ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:43.900214 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:44.002688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 686/1378] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:48:44.056442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a74db-d594-496c-bc2d-e33bf0c9cb19 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:44.058037 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-556a74db-d594-496c-bc2d-e33bf0c9cb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:44.120315 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:44.207811 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a74db-d594-496c-bc2d-e33bf0c9cb19 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:44.325253 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec39085-4fac-4671-9bfd-e327d802501f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:44.326698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec39085-4fac-4671-9bfd-e327d802501f service nova] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:44.326698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec39085-4fac-4671-9bfd-e327d802501f service nova] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:44.327253 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec39085-4fac-4671-9bfd-e327d802501f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:44.329443 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-bec39085-4fac-4671-9bfd-e327d802501f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:44.348463 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:44.438811 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec39085-4fac-4671-9bfd-e327d802501f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:44.440469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec39085-4fac-4671-9bfd-e327d802501f service nova] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:44.474513 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 693/1379] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:48:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:46.797179 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fcbe8-af38-4c72-b9e7-87e5e6f3cbee None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:46.797711 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fcbe8-af38-4c72-b9e7-87e5e6f3cbee None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:46.797711 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fcbe8-af38-4c72-b9e7-87e5e6f3cbee None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:46.799161 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 687/1380] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:48:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:48:46.804245 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058104cf-eaf3-473d-a32b-89cd79b5e3ec None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:46.804639 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058104cf-eaf3-473d-a32b-89cd79b5e3ec None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:46.804849 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058104cf-eaf3-473d-a32b-89cd79b5e3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:46.871039 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-058104cf-eaf3-473d-a32b-89cd79b5e3ec None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:46.872271 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-058104cf-eaf3-473d-a32b-89cd79b5e3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:46.970580 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:46.976810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 694/1381] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:48:47.021976 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2fcbe8-af38-4c72-b9e7-87e5e6f3cbee None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:47.023569 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-fa2fcbe8-af38-4c72-b9e7-87e5e6f3cbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:47.160868 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:47.171270 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2fcbe8-af38-4c72-b9e7-87e5e6f3cbee None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:47.290669 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a711d-2e7a-461c-bb0e-e8d324aed25c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:47.291829 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a711d-2e7a-461c-bb0e-e8d324aed25c service nova] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:47.292350 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a711d-2e7a-461c-bb0e-e8d324aed25c service nova] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:47.292959 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a711d-2e7a-461c-bb0e-e8d324aed25c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:47.295071 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-9c1a711d-2e7a-461c-bb0e-e8d324aed25c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:47.394633 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a711d-2e7a-461c-bb0e-e8d324aed25c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:47.396601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a711d-2e7a-461c-bb0e-e8d324aed25c service nova] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:47.408219 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:47.417327 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 688/1382] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:48:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:49.905601 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25f45d-63fa-4f56-af60-ebc8a7b8e216 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:49.906191 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25f45d-63fa-4f56-af60-ebc8a7b8e216 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:49.906337 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25f45d-63fa-4f56-af60-ebc8a7b8e216 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:49.908308 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 695/1383] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:48:49 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:48:49.913485 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51740c6a-750e-4969-ac3a-1dd2909e9dbf None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:49.913924 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51740c6a-750e-4969-ac3a-1dd2909e9dbf None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:49.914035 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51740c6a-750e-4969-ac3a-1dd2909e9dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:49.983301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-51740c6a-750e-4969-ac3a-1dd2909e9dbf None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:49.984615 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-51740c6a-750e-4969-ac3a-1dd2909e9dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:50.098298 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 689/1384] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:48:50.141292 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25f45d-63fa-4f56-af60-ebc8a7b8e216 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:50.143360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-5a25f45d-63fa-4f56-af60-ebc8a7b8e216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:50.314580 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25f45d-63fa-4f56-af60-ebc8a7b8e216 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:50.387818 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:50.437580 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988aea3e-0417-4331-ade7-96b34a488670 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:50.438237 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aea3e-0417-4331-ade7-96b34a488670 service nova] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:50.438520 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aea3e-0417-4331-ade7-96b34a488670 service nova] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:50.438845 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aea3e-0417-4331-ade7-96b34a488670 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:50.440568 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-988aea3e-0417-4331-ade7-96b34a488670 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:50.544074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988aea3e-0417-4331-ade7-96b34a488670 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:50.546417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988aea3e-0417-4331-ade7-96b34a488670 service nova] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:50.569003 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 696/1385] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:48:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:52.692132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d3c0f-2afd-441f-84ba-86539c3ecdd1 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:52.692674 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d3c0f-2afd-441f-84ba-86539c3ecdd1 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:52.692864 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d3c0f-2afd-441f-84ba-86539c3ecdd1 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:52.694236 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 690/1386] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:48:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:48:52.699669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001c7fd-0f5c-4df2-a1a5-e86a7ab144a4 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:52.700171 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001c7fd-0f5c-4df2-a1a5-e86a7ab144a4 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:52.700267 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001c7fd-0f5c-4df2-a1a5-e86a7ab144a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:52.768350 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-d001c7fd-0f5c-4df2-a1a5-e86a7ab144a4 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:52.769415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-d001c7fd-0f5c-4df2-a1a5-e86a7ab144a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:52.804482 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:52.874561 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 697/1387] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:48:52.917983 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d3c0f-2afd-441f-84ba-86539c3ecdd1 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:52.920654 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-729d3c0f-2afd-441f-84ba-86539c3ecdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:53.015945 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:53.090699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d3c0f-2afd-441f-84ba-86539c3ecdd1 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:53.250754 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b469cb-d0c1-428c-b8b2-6755ec2fc4a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:53.251468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b469cb-d0c1-428c-b8b2-6755ec2fc4a4 service nova] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:53.251707 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b469cb-d0c1-428c-b8b2-6755ec2fc4a4 service nova] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:53.252000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b469cb-d0c1-428c-b8b2-6755ec2fc4a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:53.254175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-93b469cb-d0c1-428c-b8b2-6755ec2fc4a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:53.303934 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:53.397083 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b469cb-d0c1-428c-b8b2-6755ec2fc4a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:53.397083 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b469cb-d0c1-428c-b8b2-6755ec2fc4a4 service nova] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:53.397083 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 691/1388] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:48:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:55.743589 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cb724-a889-437d-a69a-f460fd8f1e31 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:55.744199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cb724-a889-437d-a69a-f460fd8f1e31 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:55.744199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cb724-a889-437d-a69a-f460fd8f1e31 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:55.745538 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 698/1389] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:48:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:48:55.750931 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d28745-6d92-4ce6-b7f6-6d112d41c66a None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:55.751354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d28745-6d92-4ce6-b7f6-6d112d41c66a None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:55.751499 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d28745-6d92-4ce6-b7f6-6d112d41c66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:55.815770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-67d28745-6d92-4ce6-b7f6-6d112d41c66a None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:55.816915 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-67d28745-6d92-4ce6-b7f6-6d112d41c66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:55.918257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 692/1390] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:48:55.963220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cb724-a889-437d-a69a-f460fd8f1e31 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:55.964793 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-686cb724-a889-437d-a69a-f460fd8f1e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:56.119295 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cb724-a889-437d-a69a-f460fd8f1e31 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:56.136798 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:56.233934 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef9e8a-d8d1-483e-95c8-0cede9e7a2a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:56.234597 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef9e8a-d8d1-483e-95c8-0cede9e7a2a7 service nova] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:56.234882 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef9e8a-d8d1-483e-95c8-0cede9e7a2a7 service nova] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:56.235155 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef9e8a-d8d1-483e-95c8-0cede9e7a2a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:56.236969 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-ddef9e8a-d8d1-483e-95c8-0cede9e7a2a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:56.327785 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef9e8a-d8d1-483e-95c8-0cede9e7a2a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:56.329674 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef9e8a-d8d1-483e-95c8-0cede9e7a2a7 service nova] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:56.348269 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 699/1391] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:48:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:56.524559 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bb04e-edf4-46d0-949b-c67073a66650 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:56.524850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bb04e-edf4-46d0-949b-c67073a66650 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:56.525128 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bb04e-edf4-46d0-949b-c67073a66650 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:56.526601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 693/1392] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:48:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:48:56.532708 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c8d66-79ae-4557-8bbc-8e4d0d2da83d None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:56.533003 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c8d66-79ae-4557-8bbc-8e4d0d2da83d None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:56.533284 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c8d66-79ae-4557-8bbc-8e4d0d2da83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:56.557318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:56.598372 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-cf3c8d66-79ae-4557-8bbc-8e4d0d2da83d None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:56.599578 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-cf3c8d66-79ae-4557-8bbc-8e4d0d2da83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:56.710054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 700/1393] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:48:56.769472 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52c711-9e56-4547-8841-08259b3e890b None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:56.769972 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52c711-9e56-4547-8841-08259b3e890b None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:56.770080 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52c711-9e56-4547-8841-08259b3e890b None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:56.771380 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 694/1394] 10.222.0.119 () {54 vars in 967 bytes} [Thu Jul 14 15:48:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:48:56.776282 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839c12a-f86f-4461-a5ae-619b604efc7a None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:56.776695 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839c12a-f86f-4461-a5ae-619b604efc7a None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:56.776845 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839c12a-f86f-4461-a5ae-619b604efc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:56.852758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-7839c12a-f86f-4461-a5ae-619b604efc7a None None] MFA Rules not processed for user `40b236c66c184d3ca40c2069dc316664`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:56.853963 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-7839c12a-f86f-4461-a5ae-619b604efc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:56.895963 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:56.932998 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 701/1395] 10.222.0.119 () {58 vars in 1064 bytes} [Thu Jul 14 15:48:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:48:56.940601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52c711-9e56-4547-8841-08259b3e890b None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:56.942143 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-6b52c711-9e56-4547-8841-08259b3e890b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:56.956387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:57.050773 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52c711-9e56-4547-8841-08259b3e890b None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:57.127624 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296702a-b8e9-4e4f-97b6-581da67c46f2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b236c66c184d3ca40c2069dc316664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:57.128313 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296702a-b8e9-4e4f-97b6-581da67c46f2 service glance] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:57.128601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296702a-b8e9-4e4f-97b6-581da67c46f2 service glance] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:57.128877 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296702a-b8e9-4e4f-97b6-581da67c46f2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:57.130513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-7296702a-b8e9-4e4f-97b6-581da67c46f2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:57.201160 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:57.242259 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296702a-b8e9-4e4f-97b6-581da67c46f2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:57.243706 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296702a-b8e9-4e4f-97b6-581da67c46f2 service glance] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:57.262970 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 695/1396] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:48:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:58.213703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9d8e5-fa43-4fbc-ad4a-2245f7656c48 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:58.214194 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9d8e5-fa43-4fbc-ad4a-2245f7656c48 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:58.214306 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9d8e5-fa43-4fbc-ad4a-2245f7656c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:58.282408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-67c9d8e5-fa43-4fbc-ad4a-2245f7656c48 None None] MFA Rules not processed for user `4a1474b39e0b477daff5833491cd6df5`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:58.283624 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-67c9d8e5-fa43-4fbc-ad4a-2245f7656c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:58.372085 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 702/1397] 10.222.0.119 () {58 vars in 1014 bytes} [Thu Jul 14 15:48:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:48:58.420513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9d689-296f-4344-8210-d38f16c8051f None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:58.421172 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9d689-296f-4344-8210-d38f16c8051f None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:58.421470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9d689-296f-4344-8210-d38f16c8051f None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:58.422960 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 696/1398] 10.222.0.119 () {54 vars in 947 bytes} [Thu Jul 14 15:48:58 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:48:58.429565 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04266703-9d17-4530-a6da-e8f9182d47f8 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:58.429858 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04266703-9d17-4530-a6da-e8f9182d47f8 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:58.430136 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04266703-9d17-4530-a6da-e8f9182d47f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:58.504771 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:58.515007 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-04266703-9d17-4530-a6da-e8f9182d47f8 None None] MFA Rules not processed for user `28a5c169576e432c8174a562ae358e8b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:58.519645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-04266703-9d17-4530-a6da-e8f9182d47f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:58.643462 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 703/1399] 10.222.0.119 () {58 vars in 1044 bytes} [Thu Jul 14 15:48:58 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:48:58.652579 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9d689-296f-4344-8210-d38f16c8051f None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:58.654606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-efc9d689-296f-4344-8210-d38f16c8051f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:58.678278 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0eae1-d94d-4edc-993f-3e42d9dccee9 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:58.678561 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0eae1-d94d-4edc-993f-3e42d9dccee9 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:58.679013 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0eae1-d94d-4edc-993f-3e42d9dccee9 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:58.681236 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 704/1400] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:48:58 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:48:58.687512 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75905d3-49e2-4923-9b00-e473e7a2d4d0 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:58.687901 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75905d3-49e2-4923-9b00-e473e7a2d4d0 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:58.688394 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75905d3-49e2-4923-9b00-e473e7a2d4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:58.766716 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-d75905d3-49e2-4923-9b00-e473e7a2d4d0 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:58.767869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-d75905d3-49e2-4923-9b00-e473e7a2d4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:58.802177 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9d689-296f-4344-8210-d38f16c8051f None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:58.833288 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:58.840777 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:58.870455 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 705/1401] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:48:58.912721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ea08f-06eb-4bfd-9511-feb45985bf64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a5c169576e432c8174a562ae358e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:58.913375 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ea08f-06eb-4bfd-9511-feb45985bf64 service swift] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:58.913659 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ea08f-06eb-4bfd-9511-feb45985bf64 service swift] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:58.913932 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ea08f-06eb-4bfd-9511-feb45985bf64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:58.915590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-8f9ea08f-06eb-4bfd-9511-feb45985bf64 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:58.916511 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75905d3-49e2-4923-9b00-e473e7a2d4d0 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:58.917719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-d75905d3-49e2-4923-9b00-e473e7a2d4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:59.002198 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ea08f-06eb-4bfd-9511-feb45985bf64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:59.003898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ea08f-06eb-4bfd-9511-feb45985bf64 service swift] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:59.011903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 697/1402] 10.222.0.119 () {60 vars in 1389 bytes} [Thu Jul 14 15:48:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:48:59.040092 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75905d3-49e2-4923-9b00-e473e7a2d4d0 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:59.115454 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:59.155640 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81ad3a-2af8-476a-9da3-2029bc98376e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:59.156317 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81ad3a-2af8-476a-9da3-2029bc98376e service nova] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:59.156603 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81ad3a-2af8-476a-9da3-2029bc98376e service nova] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:59.156880 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81ad3a-2af8-476a-9da3-2029bc98376e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:59.158513 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-8d81ad3a-2af8-476a-9da3-2029bc98376e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:59.248018 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81ad3a-2af8-476a-9da3-2029bc98376e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:59.249658 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81ad3a-2af8-476a-9da3-2029bc98376e service nova] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:59.268283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 706/1403] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:48:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:49:01.543349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba23ef-43a6-4ef5-9342-c3207e5b19f3 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:01.543909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba23ef-43a6-4ef5-9342-c3207e5b19f3 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:01.543909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba23ef-43a6-4ef5-9342-c3207e5b19f3 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:01.546319 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 698/1404] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:49:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:49:01.551450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19672fb-4023-4bb2-8812-7a4b71d57e2e None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:01.552887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19672fb-4023-4bb2-8812-7a4b71d57e2e None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:01.552887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19672fb-4023-4bb2-8812-7a4b71d57e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:01.634007 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-e19672fb-4023-4bb2-8812-7a4b71d57e2e None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:49:01.635216 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-e19672fb-4023-4bb2-8812-7a4b71d57e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:01.679701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:01.750143 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 707/1405] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:49:01.802231 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba23ef-43a6-4ef5-9342-c3207e5b19f3 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:01.804043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-c5ba23ef-43a6-4ef5-9342-c3207e5b19f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:01.893323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:01.986594 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba23ef-43a6-4ef5-9342-c3207e5b19f3 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:02.156963 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2a72a-7b9e-4829-ac2d-af60a4d988c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:02.158037 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2a72a-7b9e-4829-ac2d-af60a4d988c6 service nova] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:02.158550 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2a72a-7b9e-4829-ac2d-af60a4d988c6 service nova] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:02.159101 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2a72a-7b9e-4829-ac2d-af60a4d988c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:02.161873 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-51a2a72a-7b9e-4829-ac2d-af60a4d988c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:02.201302 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:02.270125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2a72a-7b9e-4829-ac2d-af60a4d988c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:02.271749 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2a72a-7b9e-4829-ac2d-af60a4d988c6 service nova] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:02.291891 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 699/1406] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:49:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:05.449228 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7babe-929e-4e25-902c-93f6702b52b0 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:05.449806 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7babe-929e-4e25-902c-93f6702b52b0 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:05.449908 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7babe-929e-4e25-902c-93f6702b52b0 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:05.452390 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 708/1407] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:49:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:49:05.458555 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36662565-4853-4ae8-a87b-65a215624a5b None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:05.459394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36662565-4853-4ae8-a87b-65a215624a5b None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:05.459682 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36662565-4853-4ae8-a87b-65a215624a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:05.539448 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-36662565-4853-4ae8-a87b-65a215624a5b None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:49:05.543337 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-36662565-4853-4ae8-a87b-65a215624a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:05.652372 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 700/1408] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:49:05.698545 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7babe-929e-4e25-902c-93f6702b52b0 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:05.700223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-7eb7babe-929e-4e25-902c-93f6702b52b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:05.886618 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7babe-929e-4e25-902c-93f6702b52b0 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:05.908621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:06.017827 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d02083-c5df-4293-a1bf-465178cb78de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:06.018392 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d02083-c5df-4293-a1bf-465178cb78de service nova] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:06.018682 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d02083-c5df-4293-a1bf-465178cb78de service nova] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:06.018968 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d02083-c5df-4293-a1bf-465178cb78de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:06.020657 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-63d02083-c5df-4293-a1bf-465178cb78de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:06.129548 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d02083-c5df-4293-a1bf-465178cb78de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:06.131177 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d02083-c5df-4293-a1bf-465178cb78de service nova] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:06.164282 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 709/1409] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:49:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:15.650509 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:16.148423 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=88 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:23.044514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f10e40-0ba3-43e9-a184-b17d6c024dcc None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:23.045062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f10e40-0ba3-43e9-a184-b17d6c024dcc None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:23.045062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f10e40-0ba3-43e9-a184-b17d6c024dcc None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:23.046496 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 701/1410] 10.222.0.119 () {54 vars in 923 bytes} [Thu Jul 14 15:49:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:49:23.051739 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9deca-6ecd-4509-88d9-ab350a6eec69 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:23.052158 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9deca-6ecd-4509-88d9-ab350a6eec69 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:23.052528 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9deca-6ecd-4509-88d9-ab350a6eec69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:23.142084 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-72d9deca-6ecd-4509-88d9-ab350a6eec69 None None] MFA Rules not processed for user `716cbbfeede34885b0411e5b9b25df47`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:49:23.143286 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-72d9deca-6ecd-4509-88d9-ab350a6eec69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:23.249597 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 710/1411] 10.222.0.119 () {58 vars in 1020 bytes} [Thu Jul 14 15:49:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:49:23.266148 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4de10-57cf-4951-9767-1c7cf8bd2d4a None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:23.266438 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4de10-57cf-4951-9767-1c7cf8bd2d4a None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:23.266716 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4de10-57cf-4951-9767-1c7cf8bd2d4a None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:23.268073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 702/1412] 10.222.0.119 () {54 vars in 923 bytes} [Thu Jul 14 15:49:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:49:23.273071 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f371391-1a85-473a-b148-aef7e20bfbf8 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:23.274040 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f371391-1a85-473a-b148-aef7e20bfbf8 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:23.274040 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f371391-1a85-473a-b148-aef7e20bfbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:23.347129 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:23.351502 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-1f371391-1a85-473a-b148-aef7e20bfbf8 None None] MFA Rules not processed for user `a1e4c833a4684561ab52eda5734a7766`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:49:23.352740 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-1f371391-1a85-473a-b148-aef7e20bfbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:23.471634 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 711/1413] 10.222.0.119 () {58 vars in 1020 bytes} [Thu Jul 14 15:49:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:49:26.005339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ea783-d6a1-4929-bd47-e9e850b0a193 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:26.005935 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ea783-d6a1-4929-bd47-e9e850b0a193 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:26.005935 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ea783-d6a1-4929-bd47-e9e850b0a193 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:26.007314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:49:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:49:26.012673 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af66e06-666a-4b43-a1a1-333e7f99861c None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:26.013127 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af66e06-666a-4b43-a1a1-333e7f99861c None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:26.013416 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af66e06-666a-4b43-a1a1-333e7f99861c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:26.078168 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-6af66e06-666a-4b43-a1a1-333e7f99861c None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:49:26.079645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-6af66e06-666a-4b43-a1a1-333e7f99861c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:26.133667 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:26.176908 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:49:26.222925 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ea783-d6a1-4929-bd47-e9e850b0a193 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:26.224482 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-2d2ea783-d6a1-4929-bd47-e9e850b0a193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:26.371551 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ea783-d6a1-4929-bd47-e9e850b0a193 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:26.443337 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:26.484783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79862dc3-307e-4c11-a0e0-67cc06069fb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:26.485429 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79862dc3-307e-4c11-a0e0-67cc06069fb7 service nova] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:26.485713 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79862dc3-307e-4c11-a0e0-67cc06069fb7 service nova] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:26.485987 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79862dc3-307e-4c11-a0e0-67cc06069fb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:26.487612 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-79862dc3-307e-4c11-a0e0-67cc06069fb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:26.576770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79862dc3-307e-4c11-a0e0-67cc06069fb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:26.578615 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79862dc3-307e-4c11-a0e0-67cc06069fb7 service nova] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:26.596920 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 704/1416] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:49:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:27.569007 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2bef9-98e8-4bde-8b05-fa9707a5a5a4 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:27.569561 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2bef9-98e8-4bde-8b05-fa9707a5a5a4 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:27.569561 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2bef9-98e8-4bde-8b05-fa9707a5a5a4 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:27.571146 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:49:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:49:27.577090 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615cea3-d217-42c6-a83f-116cc217cc9e None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:27.577524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615cea3-d217-42c6-a83f-116cc217cc9e None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:27.577842 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615cea3-d217-42c6-a83f-116cc217cc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:27.652509 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-0615cea3-d217-42c6-a83f-116cc217cc9e None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:49:27.653987 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-0615cea3-d217-42c6-a83f-116cc217cc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:27.681143 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:27.755821 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:49:27.906869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2bef9-98e8-4bde-8b05-fa9707a5a5a4 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:27.908427 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-02c2bef9-98e8-4bde-8b05-fa9707a5a5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:28.056133 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2bef9-98e8-4bde-8b05-fa9707a5a5a4 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:28.098539 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:28.171514 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d7136-65f0-4142-b2d0-d507846f8362 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:28.172199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d7136-65f0-4142-b2d0-d507846f8362 service nova] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:28.172490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d7136-65f0-4142-b2d0-d507846f8362 service nova] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:28.172772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d7136-65f0-4142-b2d0-d507846f8362 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:28.174415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-6b9d7136-65f0-4142-b2d0-d507846f8362 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:28.266956 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d7136-65f0-4142-b2d0-d507846f8362 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:28.268608 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d7136-65f0-4142-b2d0-d507846f8362 service nova] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:28.287010 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 714/1419] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:49:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:29.189840 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87e674-aacf-4204-8c67-b69d49dc9a4d None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:29.190379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87e674-aacf-4204-8c67-b69d49dc9a4d None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:29.190379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87e674-aacf-4204-8c67-b69d49dc9a4d None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:29.191741 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:49:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:49:29.196759 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abc0de-a508-494f-bbbf-5bc61d67357d None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:29.197207 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abc0de-a508-494f-bbbf-5bc61d67357d None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:29.197305 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abc0de-a508-494f-bbbf-5bc61d67357d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:29.250642 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:29.271951 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-97abc0de-a508-494f-bbbf-5bc61d67357d None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:49:29.273222 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-97abc0de-a508-494f-bbbf-5bc61d67357d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:29.381040 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:49:29.556247 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87e674-aacf-4204-8c67-b69d49dc9a4d None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:29.557774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-5c87e674-aacf-4204-8c67-b69d49dc9a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:29.702981 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87e674-aacf-4204-8c67-b69d49dc9a4d None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:29.715199 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:29.833288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707c7a0-a2a1-4b8b-9649-3dec168ac997 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:29.833941 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707c7a0-a2a1-4b8b-9649-3dec168ac997 service nova] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:29.834229 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707c7a0-a2a1-4b8b-9649-3dec168ac997 service nova] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:29.834507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707c7a0-a2a1-4b8b-9649-3dec168ac997 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:29.836161 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-c707c7a0-a2a1-4b8b-9649-3dec168ac997 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:29.927409 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c707c7a0-a2a1-4b8b-9649-3dec168ac997 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:29.929044 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c707c7a0-a2a1-4b8b-9649-3dec168ac997 service nova] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:29.947405 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 707/1422] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:49:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:30.819556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810baba7-c7ed-46cd-96b7-7ca75ea4c186 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:30.820140 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810baba7-c7ed-46cd-96b7-7ca75ea4c186 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:30.820140 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810baba7-c7ed-46cd-96b7-7ca75ea4c186 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:30.821460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:49:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:49:30.826653 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b9712-5734-44ec-ad1b-6fee6b2e9c25 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:30.827038 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b9712-5734-44ec-ad1b-6fee6b2e9c25 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:30.827221 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b9712-5734-44ec-ad1b-6fee6b2e9c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:30.846635 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:30.904723 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-3e4b9712-5734-44ec-ad1b-6fee6b2e9c25 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:49:30.905952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-3e4b9712-5734-44ec-ad1b-6fee6b2e9c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:31.003230 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:49:31.155216 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810baba7-c7ed-46cd-96b7-7ca75ea4c186 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:31.156753 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-810baba7-c7ed-46cd-96b7-7ca75ea4c186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:31.265180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:31.301614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810baba7-c7ed-46cd-96b7-7ca75ea4c186 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:31.413471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e46f9-18b9-42a8-b31f-857bab7b1c2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:31.414042 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e46f9-18b9-42a8-b31f-857bab7b1c2c service nova] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:31.414327 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e46f9-18b9-42a8-b31f-857bab7b1c2c service nova] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:31.414604 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e46f9-18b9-42a8-b31f-857bab7b1c2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:31.416269 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-bf9e46f9-18b9-42a8-b31f-857bab7b1c2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:31.495299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:31.509513 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e46f9-18b9-42a8-b31f-857bab7b1c2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:31.511333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e46f9-18b9-42a8-b31f-857bab7b1c2c service nova] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:31.530462 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 717/1425] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:49:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:49:32.411123 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe9d08-8513-46c8-abea-dc531e2821d4 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:32.411687 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe9d08-8513-46c8-abea-dc531e2821d4 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:32.411687 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe9d08-8513-46c8-abea-dc531e2821d4 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:32.413153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:49:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:49:32.418002 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960cd76-da06-4c5c-8a89-230cd6c0279e None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:32.418430 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960cd76-da06-4c5c-8a89-230cd6c0279e None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:32.418568 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960cd76-da06-4c5c-8a89-230cd6c0279e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:32.493352 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-4960cd76-da06-4c5c-8a89-230cd6c0279e None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:49:32.495863 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-4960cd76-da06-4c5c-8a89-230cd6c0279e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:32.593492 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:49:32.741852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe9d08-8513-46c8-abea-dc531e2821d4 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:32.743511 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-1afe9d08-8513-46c8-abea-dc531e2821d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:32.829132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:32.891461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe9d08-8513-46c8-abea-dc531e2821d4 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:33.006220 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09629e5d-493d-44d5-82ae-b4935e7bad5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:33.006802 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09629e5d-493d-44d5-82ae-b4935e7bad5e service nova] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:33.007090 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09629e5d-493d-44d5-82ae-b4935e7bad5e service nova] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:33.007370 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09629e5d-493d-44d5-82ae-b4935e7bad5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:33.009133 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-09629e5d-493d-44d5-82ae-b4935e7bad5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:33.057566 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:33.099099 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09629e5d-493d-44d5-82ae-b4935e7bad5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:33.100757 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09629e5d-493d-44d5-82ae-b4935e7bad5e service nova] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:33.119313 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 710/1428] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:49:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:33.995256 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d1b96-29a8-4018-b098-63ec3a9c2242 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:33.995799 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d1b96-29a8-4018-b098-63ec3a9c2242 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:33.995799 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d1b96-29a8-4018-b098-63ec3a9c2242 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:33.997241 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:49:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:49:34.002320 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6378f0-3446-4ee9-a68e-f47c3a313060 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:34.002738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6378f0-3446-4ee9-a68e-f47c3a313060 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:34.002871 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6378f0-3446-4ee9-a68e-f47c3a313060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:34.078695 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-2c6378f0-3446-4ee9-a68e-f47c3a313060 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:49:34.079926 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-2c6378f0-3446-4ee9-a68e-f47c3a313060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:34.178543 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:49:34.331585 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d1b96-29a8-4018-b098-63ec3a9c2242 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:34.333490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-d87d1b96-29a8-4018-b098-63ec3a9c2242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:34.387053 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:34.488345 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d1b96-29a8-4018-b098-63ec3a9c2242 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:34.603821 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4d4d7-8b4d-49ba-96c2-2b1ab3084969 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:34.604424 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4d4d7-8b4d-49ba-96c2-2b1ab3084969 service nova] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:34.604714 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4d4d7-8b4d-49ba-96c2-2b1ab3084969 service nova] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:34.604995 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4d4d7-8b4d-49ba-96c2-2b1ab3084969 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:34.607182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-16b4d4d7-8b4d-49ba-96c2-2b1ab3084969 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:34.614030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:34.696440 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b4d4d7-8b4d-49ba-96c2-2b1ab3084969 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:34.698050 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b4d4d7-8b4d-49ba-96c2-2b1ab3084969 service nova] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:34.717143 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 720/1431] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:35.585097 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170c649-d777-4bac-8c35-57883bb40320 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:35.585507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170c649-d777-4bac-8c35-57883bb40320 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:35.585659 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170c649-d777-4bac-8c35-57883bb40320 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:35.587046 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:49:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:49:35.592936 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a444bd3-e8d5-4fb3-9944-48de93f05f02 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:35.600928 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a444bd3-e8d5-4fb3-9944-48de93f05f02 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:35.600928 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a444bd3-e8d5-4fb3-9944-48de93f05f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:35.667864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-9a444bd3-e8d5-4fb3-9944-48de93f05f02 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:49:35.669020 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-9a444bd3-e8d5-4fb3-9944-48de93f05f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:35.736220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:35.765256 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:49:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:49:35.916184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170c649-d777-4bac-8c35-57883bb40320 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:35.917739 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-7170c649-d777-4bac-8c35-57883bb40320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:35.936195 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:36.063150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170c649-d777-4bac-8c35-57883bb40320 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:36.148774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:36.173999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73d24f-c68f-437c-83b1-0f3c2f7b726b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:36.174727 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73d24f-c68f-437c-83b1-0f3c2f7b726b service nova] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:36.174931 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73d24f-c68f-437c-83b1-0f3c2f7b726b service nova] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:36.175213 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73d24f-c68f-437c-83b1-0f3c2f7b726b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:36.176998 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-5e73d24f-c68f-437c-83b1-0f3c2f7b726b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:36.268516 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73d24f-c68f-437c-83b1-0f3c2f7b726b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:36.270041 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73d24f-c68f-437c-83b1-0f3c2f7b726b service nova] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:36.288092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 713/1434] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:49:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:37.183538 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c16d7-d44d-4f23-b315-01315fa76f0b None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:37.184122 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c16d7-d44d-4f23-b315-01315fa76f0b None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:37.184122 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c16d7-d44d-4f23-b315-01315fa76f0b None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:37.185677 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:49:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:49:37.190647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796fead-a646-405e-80cf-7a7b1e4d7aee None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:37.191080 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796fead-a646-405e-80cf-7a7b1e4d7aee None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:37.191211 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796fead-a646-405e-80cf-7a7b1e4d7aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:37.268683 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-b796fead-a646-405e-80cf-7a7b1e4d7aee None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:49:37.269893 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b796fead-a646-405e-80cf-7a7b1e4d7aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:37.314745 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:37.370660 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:49:37.522247 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c16d7-d44d-4f23-b315-01315fa76f0b None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:37.523763 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-736c16d7-d44d-4f23-b315-01315fa76f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:37.670564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c16d7-d44d-4f23-b315-01315fa76f0b None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:37.724418 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:37.783582 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfd6fa-213d-46c5-b554-fffe4d4b021f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:37.784178 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfd6fa-213d-46c5-b554-fffe4d4b021f service nova] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:37.784463 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfd6fa-213d-46c5-b554-fffe4d4b021f service nova] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:37.784743 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfd6fa-213d-46c5-b554-fffe4d4b021f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:37.786388 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-09cfd6fa-213d-46c5-b554-fffe4d4b021f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:37.876593 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfd6fa-213d-46c5-b554-fffe4d4b021f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:37.878204 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfd6fa-213d-46c5-b554-fffe4d4b021f service nova] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:37.896113 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 723/1437] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:49:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:38.772286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87eb58d-e914-4b3d-ad7f-42837c63c60e None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:38.772803 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87eb58d-e914-4b3d-ad7f-42837c63c60e None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:38.772803 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87eb58d-e914-4b3d-ad7f-42837c63c60e None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:38.774203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:49:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:49:38.779951 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41ecf8-a170-4196-b54e-23351dfef1e7 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:38.780403 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41ecf8-a170-4196-b54e-23351dfef1e7 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:38.780557 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41ecf8-a170-4196-b54e-23351dfef1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:38.854996 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-4b41ecf8-a170-4196-b54e-23351dfef1e7 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:49:38.856274 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-4b41ecf8-a170-4196-b54e-23351dfef1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:38.858425 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:38.953812 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:49:39.103651 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87eb58d-e914-4b3d-ad7f-42837c63c60e None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:39.105195 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-c87eb58d-e914-4b3d-ad7f-42837c63c60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:39.257179 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87eb58d-e914-4b3d-ad7f-42837c63c60e None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:39.283626 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:39.369417 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e7a04-d9af-40e9-89c9-c184722a5299 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:39.369978 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e7a04-d9af-40e9-89c9-c184722a5299 service nova] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:39.370262 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e7a04-d9af-40e9-89c9-c184722a5299 service nova] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:39.370538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e7a04-d9af-40e9-89c9-c184722a5299 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:39.372999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-d25e7a04-d9af-40e9-89c9-c184722a5299 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:39.464805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e7a04-d9af-40e9-89c9-c184722a5299 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:39.466525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e7a04-d9af-40e9-89c9-c184722a5299 service nova] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:39.484994 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 716/1440] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:49:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:41.473299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90da7a1-5d63-44e7-ab3c-4235de9e6a3a None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:41.473863 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90da7a1-5d63-44e7-ab3c-4235de9e6a3a None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:41.474001 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90da7a1-5d63-44e7-ab3c-4235de9e6a3a None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:41.475278 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:49:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:49:41.480712 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45968f4d-f751-4448-acde-cd95cdcf4ee0 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:41.482840 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45968f4d-f751-4448-acde-cd95cdcf4ee0 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:41.482840 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45968f4d-f751-4448-acde-cd95cdcf4ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:41.527012 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:41.552890 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-45968f4d-f751-4448-acde-cd95cdcf4ee0 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:49:41.554080 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-45968f4d-f751-4448-acde-cd95cdcf4ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:41.653532 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:49:41.692533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90da7a1-5d63-44e7-ab3c-4235de9e6a3a None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:41.694064 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-e90da7a1-5d63-44e7-ab3c-4235de9e6a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:41.798433 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90da7a1-5d63-44e7-ab3c-4235de9e6a3a None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:41.831520 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:41.874523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b07d0e-1541-4599-933e-001a576d4fac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:41.875181 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b07d0e-1541-4599-933e-001a576d4fac service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:41.875472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b07d0e-1541-4599-933e-001a576d4fac service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:41.875754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b07d0e-1541-4599-933e-001a576d4fac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:41.877455 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-24b07d0e-1541-4599-933e-001a576d4fac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:41.988285 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b07d0e-1541-4599-933e-001a576d4fac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:41.989740 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b07d0e-1541-4599-933e-001a576d4fac service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:42.008167 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 726/1443] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:49:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:44.294287 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43713693-826d-461f-8534-7c5c3daa86c6 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:44.294886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43713693-826d-461f-8534-7c5c3daa86c6 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:44.294886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43713693-826d-461f-8534-7c5c3daa86c6 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:44.296254 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:49:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:49:44.301567 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089445b-7bb8-4cb6-a4ad-6d50833af8d0 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:44.301994 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089445b-7bb8-4cb6-a4ad-6d50833af8d0 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:44.302123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089445b-7bb8-4cb6-a4ad-6d50833af8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:44.366697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-3089445b-7bb8-4cb6-a4ad-6d50833af8d0 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:49:44.367904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-3089445b-7bb8-4cb6-a4ad-6d50833af8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:44.381005 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:44.468268 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:49:44.507051 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43713693-826d-461f-8534-7c5c3daa86c6 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:44.508738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-43713693-826d-461f-8534-7c5c3daa86c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:44.611477 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43713693-826d-461f-8534-7c5c3daa86c6 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:44.624075 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:44.697547 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06327033-5b39-4018-82f8-d4b3baa4a26d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:44.698205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06327033-5b39-4018-82f8-d4b3baa4a26d service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:44.698493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06327033-5b39-4018-82f8-d4b3baa4a26d service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:44.698774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06327033-5b39-4018-82f8-d4b3baa4a26d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:44.700705 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-06327033-5b39-4018-82f8-d4b3baa4a26d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:44.810264 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06327033-5b39-4018-82f8-d4b3baa4a26d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:44.811939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06327033-5b39-4018-82f8-d4b3baa4a26d service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:44.830186 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 719/1446] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:49:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:47.257091 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246351c-9f97-44f1-b9b6-bc568c8dc4ea None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:47.257669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246351c-9f97-44f1-b9b6-bc568c8dc4ea None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:47.257669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246351c-9f97-44f1-b9b6-bc568c8dc4ea None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:47.259031 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:49:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:49:47.264722 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f66922-ef54-4f2f-97e1-b7b6566778e1 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:47.265116 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f66922-ef54-4f2f-97e1-b7b6566778e1 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:47.265295 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f66922-ef54-4f2f-97e1-b7b6566778e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:47.313024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:47.331757 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-e2f66922-ef54-4f2f-97e1-b7b6566778e1 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:49:47.333005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-e2f66922-ef54-4f2f-97e1-b7b6566778e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:47.444874 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:49:47.485194 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246351c-9f97-44f1-b9b6-bc568c8dc4ea None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:47.486734 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-9246351c-9f97-44f1-b9b6-bc568c8dc4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:47.592204 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246351c-9f97-44f1-b9b6-bc568c8dc4ea None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:47.632152 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:47.667988 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3fb59-6a9e-4197-a8e4-3f2bcd9d29a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:47.668670 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3fb59-6a9e-4197-a8e4-3f2bcd9d29a7 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:47.669445 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3fb59-6a9e-4197-a8e4-3f2bcd9d29a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:47.669739 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3fb59-6a9e-4197-a8e4-3f2bcd9d29a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:47.671450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-96a3fb59-6a9e-4197-a8e4-3f2bcd9d29a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:47.791092 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3fb59-6a9e-4197-a8e4-3f2bcd9d29a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:47.792405 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3fb59-6a9e-4197-a8e4-3f2bcd9d29a7 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:47.810291 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 729/1449] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:49:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:50.002843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9e70b-0085-4669-8591-7883ba880160 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:50.003437 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9e70b-0085-4669-8591-7883ba880160 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:50.003437 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9e70b-0085-4669-8591-7883ba880160 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:50.004841 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:49:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:49:50.010146 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796eee2-7035-43da-80d9-4cb3f1124e38 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:50.010588 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796eee2-7035-43da-80d9-4cb3f1124e38 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:50.010706 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796eee2-7035-43da-80d9-4cb3f1124e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:50.074763 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-1796eee2-7035-43da-80d9-4cb3f1124e38 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:49:50.076532 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-1796eee2-7035-43da-80d9-4cb3f1124e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:50.097387 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:50.173237 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:49:50.213662 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9e70b-0085-4669-8591-7883ba880160 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:50.215196 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-e6c9e70b-0085-4669-8591-7883ba880160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:50.319730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9e70b-0085-4669-8591-7883ba880160 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:50.340051 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:50.394304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022c424-6fe9-4335-baa5-6909cff75ebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:50.394948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022c424-6fe9-4335-baa5-6909cff75ebf service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:50.395238 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022c424-6fe9-4335-baa5-6909cff75ebf service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:50.395516 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022c424-6fe9-4335-baa5-6909cff75ebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:50.397226 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b022c424-6fe9-4335-baa5-6909cff75ebf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:50.509446 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022c424-6fe9-4335-baa5-6909cff75ebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:50.510911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022c424-6fe9-4335-baa5-6909cff75ebf service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:50.530678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 722/1452] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:49:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:52.628359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a7717-525a-477a-a0b7-746d63f15cef None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:52.628925 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a7717-525a-477a-a0b7-746d63f15cef None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:52.628925 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a7717-525a-477a-a0b7-746d63f15cef None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:52.630363 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:49:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:49:52.635528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95bcab-5757-41ea-bb3e-8235091c0e4e None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:52.635903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95bcab-5757-41ea-bb3e-8235091c0e4e None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:52.636115 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95bcab-5757-41ea-bb3e-8235091c0e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:52.697551 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:52.702217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-aa95bcab-5757-41ea-bb3e-8235091c0e4e None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:49:52.703685 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-aa95bcab-5757-41ea-bb3e-8235091c0e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:52.808861 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:49:52.847548 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a7717-525a-477a-a0b7-746d63f15cef None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:52.849116 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-ef0a7717-525a-477a-a0b7-746d63f15cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:52.952554 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a7717-525a-477a-a0b7-746d63f15cef None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:53.003955 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:53.028651 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0ed08-f8ef-48ef-8a1f-8de6b2c20608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:53.029553 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0ed08-f8ef-48ef-8a1f-8de6b2c20608 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:53.030020 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0ed08-f8ef-48ef-8a1f-8de6b2c20608 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:53.030595 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0ed08-f8ef-48ef-8a1f-8de6b2c20608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:53.032300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-16e0ed08-f8ef-48ef-8a1f-8de6b2c20608 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:53.140054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0ed08-f8ef-48ef-8a1f-8de6b2c20608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:53.141563 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0ed08-f8ef-48ef-8a1f-8de6b2c20608 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:53.160357 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 732/1455] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:49:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:55.302585 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d9c81-139c-4521-8a11-14038c318904 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:55.303155 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d9c81-139c-4521-8a11-14038c318904 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:55.303155 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d9c81-139c-4521-8a11-14038c318904 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:55.304603 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:49:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:49:55.310072 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4d07a-bfcf-4b94-b880-38dd2bf8a364 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:55.310504 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4d07a-bfcf-4b94-b880-38dd2bf8a364 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:55.310631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4d07a-bfcf-4b94-b880-38dd2bf8a364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:55.376663 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-eac4d07a-bfcf-4b94-b880-38dd2bf8a364 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:49:55.377865 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-eac4d07a-bfcf-4b94-b880-38dd2bf8a364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:55.407106 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:55.474354 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:49:55.517306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d9c81-139c-4521-8a11-14038c318904 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:55.518995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-664d9c81-139c-4521-8a11-14038c318904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:55.625631 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d9c81-139c-4521-8a11-14038c318904 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:55.655041 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:55.701555 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3d6a6-7f3d-4d6f-828e-bf582e5d0af5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:55.702204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3d6a6-7f3d-4d6f-828e-bf582e5d0af5 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:55.702492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3d6a6-7f3d-4d6f-828e-bf582e5d0af5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:55.702770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3d6a6-7f3d-4d6f-828e-bf582e5d0af5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:55.704707 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b3b3d6a6-7f3d-4d6f-828e-bf582e5d0af5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:55.814246 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3d6a6-7f3d-4d6f-828e-bf582e5d0af5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:55.815691 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3d6a6-7f3d-4d6f-828e-bf582e5d0af5 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:55.834531 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 725/1458] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:49:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:57.965927 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1219a3-8151-4a10-8840-784001392047 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:57.966457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1219a3-8151-4a10-8840-784001392047 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:57.966457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1219a3-8151-4a10-8840-784001392047 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:57.967791 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:49:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:49:57.973028 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3669ac-a2df-462e-99b6-99196fed9fdd None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:57.973407 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3669ac-a2df-462e-99b6-99196fed9fdd None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:57.973598 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3669ac-a2df-462e-99b6-99196fed9fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:58.040579 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-7c3669ac-a2df-462e-99b6-99196fed9fdd None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:49:58.041799 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-7c3669ac-a2df-462e-99b6-99196fed9fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:58.050692 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:58.140357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:49:58.178030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1219a3-8151-4a10-8840-784001392047 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:58.179570 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-5a1219a3-8151-4a10-8840-784001392047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:58.282609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1219a3-8151-4a10-8840-784001392047 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:58.337896 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:58.357117 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925cd78-10b8-41d4-9ebb-6ab2e78836a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:58.357774 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925cd78-10b8-41d4-9ebb-6ab2e78836a6 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:58.358063 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925cd78-10b8-41d4-9ebb-6ab2e78836a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:58.358345 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925cd78-10b8-41d4-9ebb-6ab2e78836a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:58.359994 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-9925cd78-10b8-41d4-9ebb-6ab2e78836a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:58.468762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925cd78-10b8-41d4-9ebb-6ab2e78836a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:58.470215 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925cd78-10b8-41d4-9ebb-6ab2e78836a6 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:58.489216 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 735/1461] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:49:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:50:00.588202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ff09c-4724-4b87-85f8-d73f0d7f4368 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:00.588202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ff09c-4724-4b87-85f8-d73f0d7f4368 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:00.588672 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ff09c-4724-4b87-85f8-d73f0d7f4368 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:00.589657 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:50:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:50:00.596158 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44b1ca-f623-4874-a459-bb109348aeef None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:00.596616 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44b1ca-f623-4874-a459-bb109348aeef None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:00.596723 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44b1ca-f623-4874-a459-bb109348aeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:00.687800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-ea44b1ca-f623-4874-a459-bb109348aeef None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:50:00.689563 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-ea44b1ca-f623-4874-a459-bb109348aeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:00.729739 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:00.788197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:50:00.826898 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ff09c-4724-4b87-85f8-d73f0d7f4368 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:50:00.828724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-426ff09c-4724-4b87-85f8-d73f0d7f4368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:00.930454 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ff09c-4724-4b87-85f8-d73f0d7f4368 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:50:00.970325 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:01.008706 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bd60d-9892-437c-9639-57c63e7cc51e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:50:01.009361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bd60d-9892-437c-9639-57c63e7cc51e service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:01.009656 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bd60d-9892-437c-9639-57c63e7cc51e service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:01.009944 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bd60d-9892-437c-9639-57c63e7cc51e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:01.011591 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-c89bd60d-9892-437c-9639-57c63e7cc51e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:01.119783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89bd60d-9892-437c-9639-57c63e7cc51e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:50:01.121251 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89bd60d-9892-437c-9639-57c63e7cc51e service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:50:01.140044 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 728/1464] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:50:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:50:03.203536 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abf865-01da-49b7-8c95-d1ea110c3679 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:03.204075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abf865-01da-49b7-8c95-d1ea110c3679 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:03.204075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abf865-01da-49b7-8c95-d1ea110c3679 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:03.205413 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:50:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:50:03.210757 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0980244-500e-4fd0-bb86-745e1540e97e None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:03.211188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0980244-500e-4fd0-bb86-745e1540e97e None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:03.211325 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0980244-500e-4fd0-bb86-745e1540e97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:03.280531 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-e0980244-500e-4fd0-bb86-745e1540e97e None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:50:03.281769 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-e0980244-500e-4fd0-bb86-745e1540e97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:03.300816 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:03.390311 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:50:03.428074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abf865-01da-49b7-8c95-d1ea110c3679 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:50:03.429698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-c0abf865-01da-49b7-8c95-d1ea110c3679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:03.535035 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abf865-01da-49b7-8c95-d1ea110c3679 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:50:03.602747 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:03.610129 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d032129-c738-42a8-8673-0afe1deb391b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:50:03.610793 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d032129-c738-42a8-8673-0afe1deb391b service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:03.611084 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d032129-c738-42a8-8673-0afe1deb391b service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:03.611363 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d032129-c738-42a8-8673-0afe1deb391b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:03.613082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-6d032129-c738-42a8-8673-0afe1deb391b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:03.722958 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d032129-c738-42a8-8673-0afe1deb391b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:50:03.724435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d032129-c738-42a8-8673-0afe1deb391b service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:50:03.742209 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 738/1467] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:50:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:50:05.831017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaf7d9-eb9a-4834-9e16-410472adf3b7 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:05.831615 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaf7d9-eb9a-4834-9e16-410472adf3b7 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:05.831615 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaf7d9-eb9a-4834-9e16-410472adf3b7 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:05.833020 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:50:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:50:05.838323 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de2b80-44a0-42b3-b840-59f722f6512f None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:05.838785 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de2b80-44a0-42b3-b840-59f722f6512f None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:05.838901 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de2b80-44a0-42b3-b840-59f722f6512f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:05.905620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-85de2b80-44a0-42b3-b840-59f722f6512f None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:50:05.906852 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-85de2b80-44a0-42b3-b840-59f722f6512f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:05.955800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:06.005897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:50:06.051885 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaaf7d9-eb9a-4834-9e16-410472adf3b7 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:50:06.053461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-8aaaf7d9-eb9a-4834-9e16-410472adf3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:06.161793 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaaf7d9-eb9a-4834-9e16-410472adf3b7 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:50:06.209889 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:06.235737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399041b3-1084-490a-a5d6-76a982f733a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:50:06.236416 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399041b3-1084-490a-a5d6-76a982f733a8 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:06.236704 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399041b3-1084-490a-a5d6-76a982f733a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:06.236982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399041b3-1084-490a-a5d6-76a982f733a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:06.238697 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-399041b3-1084-490a-a5d6-76a982f733a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:06.347809 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399041b3-1084-490a-a5d6-76a982f733a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:50:06.349278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399041b3-1084-490a-a5d6-76a982f733a8 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:50:06.368123 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 731/1470] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:50:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:50:16.004034 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=22 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:16.365456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=66 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:26.794339 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b2863-afcb-4837-9dc2-1d7fc6b0518e None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:26.794938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b2863-afcb-4837-9dc2-1d7fc6b0518e None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:26.794938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b2863-afcb-4837-9dc2-1d7fc6b0518e None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:26.796344 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 740/1471] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:50:26 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:50:26.801737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101da94-68a1-4ed5-bc35-99e757fd46d9 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:26.802193 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101da94-68a1-4ed5-bc35-99e757fd46d9 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:26.802337 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101da94-68a1-4ed5-bc35-99e757fd46d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:26.867345 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-4101da94-68a1-4ed5-bc35-99e757fd46d9 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:50:26.868634 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-4101da94-68a1-4ed5-bc35-99e757fd46d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:26.967562 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 732/1472] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:50:27.052676 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd487f-a9a8-4904-bd8b-f88729de1303 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:27.052971 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd487f-a9a8-4904-bd8b-f88729de1303 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:27.053252 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd487f-a9a8-4904-bd8b-f88729de1303 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:27.054624 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 741/1473] 10.222.0.119 () {54 vars in 967 bytes} [Thu Jul 14 15:50:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:50:27.059552 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cff9a-0914-459d-863d-47328ec95ac1 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:27.059960 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cff9a-0914-459d-863d-47328ec95ac1 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:27.060275 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cff9a-0914-459d-863d-47328ec95ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:27.134425 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-ce8cff9a-0914-459d-863d-47328ec95ac1 None None] MFA Rules not processed for user `40b236c66c184d3ca40c2069dc316664`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:50:27.135629 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-ce8cff9a-0914-459d-863d-47328ec95ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:27.156654 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:27.212107 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 733/1474] 10.222.0.119 () {58 vars in 1064 bytes} [Thu Jul 14 15:50:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:50:27.220187 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd487f-a9a8-4904-bd8b-f88729de1303 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:50:27.221765 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-7ecd487f-a9a8-4904-bd8b-f88729de1303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:27.326348 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd487f-a9a8-4904-bd8b-f88729de1303 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:50:27.401452 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633a0a1-82ed-4d7f-8439-b769a29b67e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b236c66c184d3ca40c2069dc316664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:50:27.402100 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633a0a1-82ed-4d7f-8439-b769a29b67e5 service glance] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:27.402384 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633a0a1-82ed-4d7f-8439-b769a29b67e5 service glance] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:27.402668 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633a0a1-82ed-4d7f-8439-b769a29b67e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:27.405138 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-d633a0a1-82ed-4d7f-8439-b769a29b67e5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:27.459372 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:27.515234 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d633a0a1-82ed-4d7f-8439-b769a29b67e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:50:27.516749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d633a0a1-82ed-4d7f-8439-b769a29b67e5 service glance] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:50:27.535738 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 742/1475] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:50:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:50:29.726140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2639f61-251b-4182-92ae-d6d6788bc1c7 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:29.726685 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2639f61-251b-4182-92ae-d6d6788bc1c7 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:29.726802 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2639f61-251b-4182-92ae-d6d6788bc1c7 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:29.728141 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 734/1476] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:50:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:50:29.733460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d2136-7768-4930-9418-863bb75d4150 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:29.734010 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d2136-7768-4930-9418-863bb75d4150 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:29.734306 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d2136-7768-4930-9418-863bb75d4150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:29.800064 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-c15d2136-7768-4930-9418-863bb75d4150 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:50:29.801238 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-c15d2136-7768-4930-9418-863bb75d4150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:29.901853 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 743/1477] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:50:29.925929 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2639f61-251b-4182-92ae-d6d6788bc1c7 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:50:29.927456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-d2639f61-251b-4182-92ae-d6d6788bc1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:30.053799 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2639f61-251b-4182-92ae-d6d6788bc1c7 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:50:30.102775 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:30.151204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf389a-d4b9-4cd1-abee-7d9df1059113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:50:30.152408 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf389a-d4b9-4cd1-abee-7d9df1059113 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:30.153382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf389a-d4b9-4cd1-abee-7d9df1059113 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:30.153842 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf389a-d4b9-4cd1-abee-7d9df1059113 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:30.155056 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf389a-d4b9-4cd1-abee-7d9df1059113 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:50:30.157186 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: WARNING py.warnings [None req-44cf389a-d4b9-4cd1-abee-7d9df1059113 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:50:30.157186 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: warnings.warn(msg) Jul 14 15:50:30.157186 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: Jul 14 15:50:30.158348 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf389a-d4b9-4cd1-abee-7d9df1059113 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:50:30.180830 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 735/1478] 10.222.0.119 () {56 vars in 1113 bytes} [Thu Jul 14 15:50:29 2022] GET /identity/v3/projects => generated 2562 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:50:32.268709 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0efbfa-266f-4e14-b978-48fe7faee67b None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:32.269224 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0efbfa-266f-4e14-b978-48fe7faee67b None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:32.269360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0efbfa-266f-4e14-b978-48fe7faee67b None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:32.270663 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 744/1479] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:50:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:50:32.276039 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b8760-6ab4-4569-819b-b0fddf980d87 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:32.276515 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b8760-6ab4-4569-819b-b0fddf980d87 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:32.276618 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b8760-6ab4-4569-819b-b0fddf980d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:32.344758 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-760b8760-6ab4-4569-819b-b0fddf980d87 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:50:32.345984 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-760b8760-6ab4-4569-819b-b0fddf980d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:32.445503 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 736/1480] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:50:32.491034 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0efbfa-266f-4e14-b978-48fe7faee67b None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:50:32.492584 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-2a0efbfa-266f-4e14-b978-48fe7faee67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:32.502851 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:32.771177 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0efbfa-266f-4e14-b978-48fe7faee67b None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:50:32.855245 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:32.887081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff85c6-906e-44e5-b0a4-b052a572d3b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:50:32.888458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff85c6-906e-44e5-b0a4-b052a572d3b8 service nova] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:32.888586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff85c6-906e-44e5-b0a4-b052a572d3b8 service nova] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:32.888865 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff85c6-906e-44e5-b0a4-b052a572d3b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:32.890497 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-a0ff85c6-906e-44e5-b0a4-b052a572d3b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:32.982644 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff85c6-906e-44e5-b0a4-b052a572d3b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:50:32.984314 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff85c6-906e-44e5-b0a4-b052a572d3b8 service nova] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:50:33.003105 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 745/1481] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:50:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:50:35.243831 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094b200-d0cc-4594-b1f6-0fc0ee850de8 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:35.244438 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094b200-d0cc-4594-b1f6-0fc0ee850de8 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:35.244438 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094b200-d0cc-4594-b1f6-0fc0ee850de8 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:35.245821 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 737/1482] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:50:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:50:35.251523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43041b8d-54ae-42ae-bcf8-b64e514463d2 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:35.251951 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43041b8d-54ae-42ae-bcf8-b64e514463d2 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:35.252108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43041b8d-54ae-42ae-bcf8-b64e514463d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:35.316627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-43041b8d-54ae-42ae-bcf8-b64e514463d2 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:50:35.317866 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-43041b8d-54ae-42ae-bcf8-b64e514463d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:35.363558 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:35.413334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 746/1483] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:50:35.450796 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094b200-d0cc-4594-b1f6-0fc0ee850de8 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:50:35.452360 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-8094b200-d0cc-4594-b1f6-0fc0ee850de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:35.475885 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:35.557459 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094b200-d0cc-4594-b1f6-0fc0ee850de8 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:50:35.632765 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd5794-ff4b-4ca1-a871-92bc396e1403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:50:35.633410 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd5794-ff4b-4ca1-a871-92bc396e1403 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:35.633696 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd5794-ff4b-4ca1-a871-92bc396e1403 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:35.633971 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd5794-ff4b-4ca1-a871-92bc396e1403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:35.635595 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-31cd5794-ff4b-4ca1-a871-92bc396e1403 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:35.709122 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:35.744886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd5794-ff4b-4ca1-a871-92bc396e1403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:50:35.746315 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd5794-ff4b-4ca1-a871-92bc396e1403 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:50:35.768232 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 738/1484] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:50:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:50:37.863574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dd50e-5314-4075-8687-5ef7e47754a3 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:37.864185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dd50e-5314-4075-8687-5ef7e47754a3 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:37.864185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dd50e-5314-4075-8687-5ef7e47754a3 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:37.865530 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 747/1485] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:50:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:50:37.870741 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634a715-3eae-43ad-aa55-cd1a83d620df None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:37.871151 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634a715-3eae-43ad-aa55-cd1a83d620df None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:37.871316 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634a715-3eae-43ad-aa55-cd1a83d620df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:37.939475 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-d634a715-3eae-43ad-aa55-cd1a83d620df None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:50:37.940699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-d634a715-3eae-43ad-aa55-cd1a83d620df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:38.034108 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 739/1486] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:50:38.072633 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2dd50e-5314-4075-8687-5ef7e47754a3 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:50:38.074151 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-6c2dd50e-5314-4075-8687-5ef7e47754a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:38.178007 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2dd50e-5314-4075-8687-5ef7e47754a3 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:50:38.248536 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:38.250280 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a6aa9-4978-4d54-aeed-691bc600dc88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:50:38.250926 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a6aa9-4978-4d54-aeed-691bc600dc88 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:38.251209 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a6aa9-4978-4d54-aeed-691bc600dc88 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:38.251484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a6aa9-4978-4d54-aeed-691bc600dc88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:38.253137 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-1d0a6aa9-4978-4d54-aeed-691bc600dc88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:38.358357 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a6aa9-4978-4d54-aeed-691bc600dc88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:50:38.359872 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a6aa9-4978-4d54-aeed-691bc600dc88 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:50:38.378405 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 748/1487] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:50:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:50:40.516326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0758dd3-23a9-4bd2-8344-8bfe3f07135d None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:40.516764 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0758dd3-23a9-4bd2-8344-8bfe3f07135d None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:40.516872 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0758dd3-23a9-4bd2-8344-8bfe3f07135d None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:40.518251 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 740/1488] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:50:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:50:40.523510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86722a-5374-4bd6-aeb3-e797d338dffc None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:40.523960 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86722a-5374-4bd6-aeb3-e797d338dffc None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:40.524082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86722a-5374-4bd6-aeb3-e797d338dffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:40.589886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-aa86722a-5374-4bd6-aeb3-e797d338dffc None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:50:40.592015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-aa86722a-5374-4bd6-aeb3-e797d338dffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:40.645037 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:40.690388 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 749/1489] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:50:40.733309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0758dd3-23a9-4bd2-8344-8bfe3f07135d None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:50:40.734836 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-a0758dd3-23a9-4bd2-8344-8bfe3f07135d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:40.770472 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:40.838057 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0758dd3-23a9-4bd2-8344-8bfe3f07135d None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:50:40.910593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d33b36-c2a5-4504-b185-d8864b422ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:50:40.911249 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d33b36-c2a5-4504-b185-d8864b422ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:40.911542 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d33b36-c2a5-4504-b185-d8864b422ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:40.911825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d33b36-c2a5-4504-b185-d8864b422ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:40.913540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-22d33b36-c2a5-4504-b185-d8864b422ba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:40.994147 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:41.023832 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d33b36-c2a5-4504-b185-d8864b422ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:50:41.025275 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d33b36-c2a5-4504-b185-d8864b422ba6 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:50:41.044498 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 741/1490] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:50:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:50:43.523227 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0447b-eae5-40ee-94ad-673b999875cb None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:43.523705 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0447b-eae5-40ee-94ad-673b999875cb None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:43.523804 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0447b-eae5-40ee-94ad-673b999875cb None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:43.525202 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 750/1491] 10.222.0.119 () {54 vars in 931 bytes} [Thu Jul 14 15:50:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:50:43.531015 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025df67-1042-4068-af92-d6a3cf410360 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:43.531466 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025df67-1042-4068-af92-d6a3cf410360 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:43.531612 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025df67-1042-4068-af92-d6a3cf410360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:43.597800 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-f025df67-1042-4068-af92-d6a3cf410360 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:50:43.599018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-f025df67-1042-4068-af92-d6a3cf410360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:43.708676 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 742/1492] 10.222.0.119 () {58 vars in 1028 bytes} [Thu Jul 14 15:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:50:43.749032 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0447b-eae5-40ee-94ad-673b999875cb None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:50:43.750557 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-e1d0447b-eae5-40ee-94ad-673b999875cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:43.853530 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0447b-eae5-40ee-94ad-673b999875cb None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:50:43.928042 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea5cee-b375-47c1-a934-8c05d5ae61d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:50:43.928716 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea5cee-b375-47c1-a934-8c05d5ae61d5 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:43.929009 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea5cee-b375-47c1-a934-8c05d5ae61d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:43.929289 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea5cee-b375-47c1-a934-8c05d5ae61d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:43.930928 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-38ea5cee-b375-47c1-a934-8c05d5ae61d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:43.940489 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:44.047344 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea5cee-b375-47c1-a934-8c05d5ae61d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:50:44.048812 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea5cee-b375-47c1-a934-8c05d5ae61d5 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:50:44.066487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 751/1493] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:50:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:50:53.706854 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=82 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:54.064218 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=50 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:20.519410 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d56b2-9457-4da7-b646-6b0dbfaf6215 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:52:20.519966 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d56b2-9457-4da7-b646-6b0dbfaf6215 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:52:20.519966 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d56b2-9457-4da7-b646-6b0dbfaf6215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:52:20.593876 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-b25d56b2-9457-4da7-b646-6b0dbfaf6215 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:52:20.595079 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b25d56b2-9457-4da7-b646-6b0dbfaf6215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:52:20.690482 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 743/1494] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:52:20.698389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed0d03-92c8-404d-bd15-b672f73cf404 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:52:20.698877 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed0d03-92c8-404d-bd15-b672f73cf404 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:52:20.698985 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed0d03-92c8-404d-bd15-b672f73cf404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:52:20.773461 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-dbed0d03-92c8-404d-bd15-b672f73cf404 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:52:20.774608 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-dbed0d03-92c8-404d-bd15-b672f73cf404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:52:20.868504 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 752/1495] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:52:20.873802 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d56b2-9457-4da7-b646-6b0dbfaf6215 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:52:20.875074 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b25d56b2-9457-4da7-b646-6b0dbfaf6215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:52:20.886451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d56b2-9457-4da7-b646-6b0dbfaf6215 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:52:20.948314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:20.983457 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc866f8-3729-45d0-8b20-9ffdfffd2323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:52:20.984136 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc866f8-3729-45d0-8b20-9ffdfffd2323 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:52:20.984430 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc866f8-3729-45d0-8b20-9ffdfffd2323 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:52:20.984711 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc866f8-3729-45d0-8b20-9ffdfffd2323 admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:52:20.985431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc866f8-3729-45d0-8b20-9ffdfffd2323 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:52:20.985741 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc866f8-3729-45d0-8b20-9ffdfffd2323 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:52:20.986748 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: WARNING py.warnings [None req-cdc866f8-3729-45d0-8b20-9ffdfffd2323 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:52:20.986748 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: warnings.warn(msg) Jul 14 15:52:20.986748 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: Jul 14 15:52:20.987638 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc866f8-3729-45d0-8b20-9ffdfffd2323 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:52:21.000262 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 744/1496] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:52:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:52:21.008395 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed0d03-92c8-404d-bd15-b672f73cf404 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:52:21.018103 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed0d03-92c8-404d-bd15-b672f73cf404 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:52:21.078338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:21.112073 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ab5d1-046e-4f56-a6b4-d328c80c9a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:52:21.112789 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ab5d1-046e-4f56-a6b4-d328c80c9a3a admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:52:21.113076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ab5d1-046e-4f56-a6b4-d328c80c9a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:52:21.113353 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ab5d1-046e-4f56-a6b4-d328c80c9a3a admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:52:21.114066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ab5d1-046e-4f56-a6b4-d328c80c9a3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:52:21.115836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: WARNING py.warnings [None req-9e0ab5d1-046e-4f56-a6b4-d328c80c9a3a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:52:21.115836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: warnings.warn(msg) Jul 14 15:52:21.115836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: Jul 14 15:52:21.117060 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ab5d1-046e-4f56-a6b4-d328c80c9a3a admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:52:21.236809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 753/1497] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:52:21 2022] POST /identity/v3/projects => generated 380 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:52:21.241014 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc866f8-3729-45d0-8b20-9ffdfffd2323 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:52:21.242547 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-cdc866f8-3729-45d0-8b20-9ffdfffd2323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:52:21.276488 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc866f8-3729-45d0-8b20-9ffdfffd2323 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:52:21.374126 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1be4e0-42e9-49c5-af42-df4bef884ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:52:21.374845 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1be4e0-42e9-49c5-af42-df4bef884ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:52:21.375136 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1be4e0-42e9-49c5-af42-df4bef884ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:52:21.375420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1be4e0-42e9-49c5-af42-df4bef884ee8 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:52:21.376132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1be4e0-42e9-49c5-af42-df4bef884ee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:52:21.377191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: WARNING py.warnings [None req-ad1be4e0-42e9-49c5-af42-df4bef884ee8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:52:21.377191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: warnings.warn(msg) Jul 14 15:52:21.377191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: Jul 14 15:52:21.378392 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1be4e0-42e9-49c5-af42-df4bef884ee8 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:52:21.492238 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 745/1498] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:52:21 2022] POST /identity/v3/users => generated 291 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:52:21.497021 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ab5d1-046e-4f56-a6b4-d328c80c9a3a admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:52:21.498559 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-9e0ab5d1-046e-4f56-a6b4-d328c80c9a3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:52:21.561976 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ab5d1-046e-4f56-a6b4-d328c80c9a3a admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:52:21.646093 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:21.656278 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247368e-d05b-4423-a045-81af47d8834e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:52:21.656949 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247368e-d05b-4423-a045-81af47d8834e admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:52:21.661771 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247368e-d05b-4423-a045-81af47d8834e admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:52:21.661771 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247368e-d05b-4423-a045-81af47d8834e admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:52:21.661771 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247368e-d05b-4423-a045-81af47d8834e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:52:21.661771 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: WARNING py.warnings [None req-0247368e-d05b-4423-a045-81af47d8834e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:52:21.661771 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: warnings.warn(msg) Jul 14 15:52:21.661771 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: Jul 14 15:52:21.661771 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247368e-d05b-4423-a045-81af47d8834e admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:52:21.672840 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 754/1499] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:52:21 2022] GET /identity/v3/roles => generated 1427 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:52:21.676931 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1be4e0-42e9-49c5-af42-df4bef884ee8 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:52:21.678468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-ad1be4e0-42e9-49c5-af42-df4bef884ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:52:21.690421 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1be4e0-42e9-49c5-af42-df4bef884ee8 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:52:21.715215 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:21.785425 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae24752-6789-4dc3-a86c-6c5a6dbe775c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:52:21.786098 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae24752-6789-4dc3-a86c-6c5a6dbe775c admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:52:21.786384 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae24752-6789-4dc3-a86c-6c5a6dbe775c admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:52:21.786662 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae24752-6789-4dc3-a86c-6c5a6dbe775c admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:52:21.787406 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae24752-6789-4dc3-a86c-6c5a6dbe775c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:52:21.788432 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: WARNING py.warnings [None req-aae24752-6789-4dc3-a86c-6c5a6dbe775c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:52:21.788432 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: warnings.warn(msg) Jul 14 15:52:21.788432 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: Jul 14 15:52:21.789308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae24752-6789-4dc3-a86c-6c5a6dbe775c admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:52:21.802317 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 746/1500] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:52:21 2022] GET /identity/v3/roles => generated 1427 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:52:21.806651 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247368e-d05b-4423-a045-81af47d8834e admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:52:21.808223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-0247368e-d05b-4423-a045-81af47d8834e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:52:21.843119 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247368e-d05b-4423-a045-81af47d8834e admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:52:21.938618 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33e36a-44cb-4b48-8843-34cfe9612d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:52:21.939592 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33e36a-44cb-4b48-8843-34cfe9612d65 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:52:21.939876 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33e36a-44cb-4b48-8843-34cfe9612d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:52:21.940184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33e36a-44cb-4b48-8843-34cfe9612d65 admin admin] PATH_INFO: `/v3/projects/2e3b193bbe524be7b0411323cd929fd8/users/35d022441cab4ff78c4bdce6a8f31277/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:52:21.962704 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff33e36a-44cb-4b48-8843-34cfe9612d65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e3b193bbe524be7b0411323cd929fd8, user_id=35d022441cab4ff78c4bdce6a8f31277, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:52:21.963735 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: WARNING py.warnings [None req-ff33e36a-44cb-4b48-8843-34cfe9612d65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:52:21.963735 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: warnings.warn(msg) Jul 14 15:52:21.963735 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: Jul 14 15:52:21.965740 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff33e36a-44cb-4b48-8843-34cfe9612d65 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:52:22.046024 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 755/1501] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:52:21 2022] PUT /identity/v3/projects/2e3b193bbe524be7b0411323cd929fd8/users/35d022441cab4ff78c4bdce6a8f31277/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:52:22.058629 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f65c63-0410-4cb7-a532-387239c78973 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:52:22.058929 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f65c63-0410-4cb7-a532-387239c78973 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:52:22.059219 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f65c63-0410-4cb7-a532-387239c78973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:52:22.117579 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-73f65c63-0410-4cb7-a532-387239c78973 None None] MFA Rules not processed for user `35d022441cab4ff78c4bdce6a8f31277`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:52:22.118780 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-73f65c63-0410-4cb7-a532-387239c78973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:52:22.196347 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 747/1502] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:52:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:52:22.209801 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce30464-916d-4d4b-b36a-e6ab5b27fbbf None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:52:22.210098 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce30464-916d-4d4b-b36a-e6ab5b27fbbf None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:52:22.210407 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce30464-916d-4d4b-b36a-e6ab5b27fbbf None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:52:22.211806 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 756/1503] 10.222.0.119 () {54 vars in 968 bytes} [Thu Jul 14 15:52:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:52:22.217402 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7193a2-5c82-4fb1-b36e-3c78f9d156fb None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:52:22.217695 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7193a2-5c82-4fb1-b36e-3c78f9d156fb None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:52:22.217978 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7193a2-5c82-4fb1-b36e-3c78f9d156fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:52:22.247896 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:22.292721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-0f7193a2-5c82-4fb1-b36e-3c78f9d156fb None None] MFA Rules not processed for user `d96e2cb043e64d04b3f7628a3419a064`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:52:22.294599 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-0f7193a2-5c82-4fb1-b36e-3c78f9d156fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:52:22.369814 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 748/1504] 10.222.0.119 () {58 vars in 1065 bytes} [Thu Jul 14 15:52:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:52:22.380496 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce30464-916d-4d4b-b36a-e6ab5b27fbbf None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:52:22.382042 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-6ce30464-916d-4d4b-b36a-e6ab5b27fbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:52:22.432560 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:22.487219 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce30464-916d-4d4b-b36a-e6ab5b27fbbf None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:52:22.561367 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7d5fb-716d-41cb-b5a4-097e180cf87a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:52:22.562123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7d5fb-716d-41cb-b5a4-097e180cf87a service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:52:22.562416 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7d5fb-716d-41cb-b5a4-097e180cf87a service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:52:22.562705 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7d5fb-716d-41cb-b5a4-097e180cf87a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:52:22.564410 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-c6a7d5fb-716d-41cb-b5a4-097e180cf87a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:52:22.664782 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7d5fb-716d-41cb-b5a4-097e180cf87a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:52:22.666220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7d5fb-716d-41cb-b5a4-097e180cf87a service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:52:22.670205 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:22.684204 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 757/1505] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:52:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:52:22.727042 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c324a4-b283-4503-917c-4c3db8d906b0 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:52:22.727476 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c324a4-b283-4503-917c-4c3db8d906b0 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:52:22.727585 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c324a4-b283-4503-917c-4c3db8d906b0 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:52:22.728931 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 749/1506] 10.222.0.119 () {52 vars in 834 bytes} [Thu Jul 14 15:52:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:52:22.732548 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7d5fb-716d-41cb-b5a4-097e180cf87a service cinder] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:52:22.733751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-c6a7d5fb-716d-41cb-b5a4-097e180cf87a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:52:22.832556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7d5fb-716d-41cb-b5a4-097e180cf87a service cinder] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:52:22.924042 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea66f33-b458-4e51-8717-3fa56582d1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:52:22.924960 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea66f33-b458-4e51-8717-3fa56582d1dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:52:22.925250 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea66f33-b458-4e51-8717-3fa56582d1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:52:22.925529 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea66f33-b458-4e51-8717-3fa56582d1dc admin admin] PATH_INFO: `/v3/users/35d022441cab4ff78c4bdce6a8f31277` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:52:22.938430 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea66f33-b458-4e51-8717-3fa56582d1dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=35d022441cab4ff78c4bdce6a8f31277)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:52:22.939464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: WARNING py.warnings [None req-1ea66f33-b458-4e51-8717-3fa56582d1dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:52:22.939464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: warnings.warn(msg) Jul 14 15:52:22.939464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: Jul 14 15:52:22.940716 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea66f33-b458-4e51-8717-3fa56582d1dc admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:52:22.951366 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:23.148046 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-1ea66f33-b458-4e51-8717-3fa56582d1dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35d022441cab4ff78c4bdce6a8f31277'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:52:23.148438 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-1ea66f33-b458-4e51-8717-3fa56582d1dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35d022441cab4ff78c4bdce6a8f31277'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:52:23.166305 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-1ea66f33-b458-4e51-8717-3fa56582d1dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35d022441cab4ff78c4bdce6a8f31277'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:52:23.178580 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-1ea66f33-b458-4e51-8717-3fa56582d1dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35d022441cab4ff78c4bdce6a8f31277'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:52:23.179132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-1ea66f33-b458-4e51-8717-3fa56582d1dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35d022441cab4ff78c4bdce6a8f31277'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:52:23.255495 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 758/1507] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:52:22 2022] DELETE /identity/v3/users/35d022441cab4ff78c4bdce6a8f31277 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:52:23.260069 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf69c1-d13f-4733-a642-5c9c7f4a7d8d None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:52:23.260386 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf69c1-d13f-4733-a642-5c9c7f4a7d8d None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:52:23.260672 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf69c1-d13f-4733-a642-5c9c7f4a7d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:52:23.320152 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-9fcf69c1-d13f-4733-a642-5c9c7f4a7d8d None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:52:23.321379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-9fcf69c1-d13f-4733-a642-5c9c7f4a7d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:52:23.406470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:23.561360 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 750/1508] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:52:23.570886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea66f33-b458-4e51-8717-3fa56582d1dc admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:52:23.572254 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-1ea66f33-b458-4e51-8717-3fa56582d1dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:52:23.682979 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea66f33-b458-4e51-8717-3fa56582d1dc admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:52:23.739635 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:23.763641 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d251a4-0dad-4fe1-ba1b-499939b6c403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:52:23.764336 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d251a4-0dad-4fe1-ba1b-499939b6c403 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:52:23.764627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d251a4-0dad-4fe1-ba1b-499939b6c403 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:52:23.764907 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d251a4-0dad-4fe1-ba1b-499939b6c403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:52:23.766579 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-55d251a4-0dad-4fe1-ba1b-499939b6c403 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:52:23.878469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d251a4-0dad-4fe1-ba1b-499939b6c403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:52:23.879989 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d251a4-0dad-4fe1-ba1b-499939b6c403 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:52:23.898912 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 759/1509] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:52:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:52:24.397803 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf69c1-d13f-4733-a642-5c9c7f4a7d8d None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:52:24.401813 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-9fcf69c1-d13f-4733-a642-5c9c7f4a7d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:52:24.414227 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf69c1-d13f-4733-a642-5c9c7f4a7d8d None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:52:24.537117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8a5e8-b7bf-485b-9940-3089f8c2ab9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:52:24.537981 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8a5e8-b7bf-485b-9940-3089f8c2ab9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:52:24.538265 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8a5e8-b7bf-485b-9940-3089f8c2ab9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:52:24.538538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8a5e8-b7bf-485b-9940-3089f8c2ab9f admin admin] PATH_INFO: `/v3/projects/2e3b193bbe524be7b0411323cd929fd8` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:52:24.549414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8a5e8-b7bf-485b-9940-3089f8c2ab9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e3b193bbe524be7b0411323cd929fd8)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:52:24.550437 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: WARNING py.warnings [None req-95f8a5e8-b7bf-485b-9940-3089f8c2ab9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:52:24.550437 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: warnings.warn(msg) Jul 14 15:52:24.550437 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: Jul 14 15:52:24.551619 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8a5e8-b7bf-485b-9940-3089f8c2ab9f admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:52:24.694684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-95f8a5e8-b7bf-485b-9940-3089f8c2ab9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e3b193bbe524be7b0411323cd929fd8', 'request_id': 'req-95f8a5e8-b7bf-485b-9940-3089f8c2ab9f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:52:24.708529 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-95f8a5e8-b7bf-485b-9940-3089f8c2ab9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e3b193bbe524be7b0411323cd929fd8', 'request_id': 'req-95f8a5e8-b7bf-485b-9940-3089f8c2ab9f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:52:24.775974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-95f8a5e8-b7bf-485b-9940-3089f8c2ab9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e3b193bbe524be7b0411323cd929fd8', 'request_id': 'req-95f8a5e8-b7bf-485b-9940-3089f8c2ab9f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:52:24.800061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-95f8a5e8-b7bf-485b-9940-3089f8c2ab9f admin admin] The token cache is being invalidate because project 2e3b193bbe524be7b0411323cd929fd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:52:24.800383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-95f8a5e8-b7bf-485b-9940-3089f8c2ab9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:52:24.800920 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-95f8a5e8-b7bf-485b-9940-3089f8c2ab9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:52:24.802292 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 751/1510] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:52:24 2022] DELETE /identity/v3/projects/2e3b193bbe524be7b0411323cd929fd8 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:52:33.896639 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=62 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:34.798016 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:10.569510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cf576-eb0b-4d8c-84f3-5d9389f74173 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:10.570088 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cf576-eb0b-4d8c-84f3-5d9389f74173 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:10.570088 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cf576-eb0b-4d8c-84f3-5d9389f74173 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:10.571481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 760/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:54:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:54:10.576328 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2670db-eacc-4943-b435-799e877a4dc7 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:10.576732 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2670db-eacc-4943-b435-799e877a4dc7 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:10.576892 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2670db-eacc-4943-b435-799e877a4dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:10.658932 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-4f2670db-eacc-4943-b435-799e877a4dc7 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:54:10.660176 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-4f2670db-eacc-4943-b435-799e877a4dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:10.761236 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 752/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:54:10.915983 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cf576-eb0b-4d8c-84f3-5d9389f74173 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:10.918149 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-722cf576-eb0b-4d8c-84f3-5d9389f74173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:11.035541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cf576-eb0b-4d8c-84f3-5d9389f74173 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:11.042995 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019e1ad-15e9-4108-b75c-8b5a1edcb2a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:11.043654 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019e1ad-15e9-4108-b75c-8b5a1edcb2a5 service nova] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:11.043943 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019e1ad-15e9-4108-b75c-8b5a1edcb2a5 service nova] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:11.044257 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019e1ad-15e9-4108-b75c-8b5a1edcb2a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:11.054148 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019e1ad-15e9-4108-b75c-8b5a1edcb2a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:11.057262 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019e1ad-15e9-4108-b75c-8b5a1edcb2a5 service nova] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:11.070556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 761/1513] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:54:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:54:11.906268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62459a1-85b0-45eb-a86b-d1bac68aa6a7 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:11.906836 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62459a1-85b0-45eb-a86b-d1bac68aa6a7 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:11.906836 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62459a1-85b0-45eb-a86b-d1bac68aa6a7 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:11.908211 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 753/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:54:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:54:11.913815 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871ddc9-b658-4cce-97b6-db1e8f6b19e9 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:11.914222 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871ddc9-b658-4cce-97b6-db1e8f6b19e9 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:11.914389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871ddc9-b658-4cce-97b6-db1e8f6b19e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:11.933977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-1871ddc9-b658-4cce-97b6-db1e8f6b19e9 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:54:11.935187 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-1871ddc9-b658-4cce-97b6-db1e8f6b19e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:11.943952 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 762/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:54:12.095511 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62459a1-85b0-45eb-a86b-d1bac68aa6a7 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:12.110392 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62459a1-85b0-45eb-a86b-d1bac68aa6a7 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:12.115809 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c96038-b61b-4ea4-a194-dfd7e892839a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:12.116478 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c96038-b61b-4ea4-a194-dfd7e892839a service nova] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:12.116766 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c96038-b61b-4ea4-a194-dfd7e892839a service nova] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:12.117047 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c96038-b61b-4ea4-a194-dfd7e892839a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:12.125237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c96038-b61b-4ea4-a194-dfd7e892839a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:12.126810 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c96038-b61b-4ea4-a194-dfd7e892839a service nova] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:12.136359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 754/1516] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:54:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:54:12.891491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e649f-a224-4dd2-b7e1-ff9c8e695f46 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:12.891784 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e649f-a224-4dd2-b7e1-ff9c8e695f46 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:12.892060 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e649f-a224-4dd2-b7e1-ff9c8e695f46 None None] PATH_INFO: `/v3` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:12.893472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 763/1517] 10.222.0.121 () {54 vars in 930 bytes} [Thu Jul 14 15:54:12 2022] GET /identity/v3 => generated 256 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:54:12.900167 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127b0d5-62f4-4ae9-b386-4b58fe9abe84 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:12.900547 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127b0d5-62f4-4ae9-b386-4b58fe9abe84 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:12.904782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127b0d5-62f4-4ae9-b386-4b58fe9abe84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:12.961584 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-d127b0d5-62f4-4ae9-b386-4b58fe9abe84 None None] MFA Rules not processed for user `716cbbfeede34885b0411e5b9b25df47`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:54:12.962879 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-d127b0d5-62f4-4ae9-b386-4b58fe9abe84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:12.981978 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:13.036739 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 755/1518] 10.222.0.121 () {58 vars in 1020 bytes} [Thu Jul 14 15:54:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:54:21.928695 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=56 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:23.033235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=23 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:23.387849 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f4f6a-3120-496f-b180-cb2168a82e7f None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:23.388437 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f4f6a-3120-496f-b180-cb2168a82e7f None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:23.388437 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f4f6a-3120-496f-b180-cb2168a82e7f None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:23.389787 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 764/1519] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:54:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:54:23.394824 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc50b6-01a8-4d23-8992-c3ecf2f5b36a None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:23.395122 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc50b6-01a8-4d23-8992-c3ecf2f5b36a None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:23.395915 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc50b6-01a8-4d23-8992-c3ecf2f5b36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:23.414493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-b4bc50b6-01a8-4d23-8992-c3ecf2f5b36a None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:54:23.415684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b4bc50b6-01a8-4d23-8992-c3ecf2f5b36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:23.424902 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 756/1520] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:54:23.570839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82555475-3451-4dd8-abe0-7c5885d789d2 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:23.571048 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82555475-3451-4dd8-abe0-7c5885d789d2 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:23.571327 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82555475-3451-4dd8-abe0-7c5885d789d2 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:23.573444 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 765/1521] 10.222.0.119 () {54 vars in 965 bytes} [Thu Jul 14 15:54:23 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:54:23.578389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82555475-3451-4dd8-abe0-7c5885d789d2 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:23.581145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df689e-6b6a-438e-a95c-b09edacd5a8b None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:23.581145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df689e-6b6a-438e-a95c-b09edacd5a8b None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:23.581145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df689e-6b6a-438e-a95c-b09edacd5a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:23.594045 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82555475-3451-4dd8-abe0-7c5885d789d2 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:23.598531 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-b9df689e-6b6a-438e-a95c-b09edacd5a8b None None] MFA Rules not processed for user `716cbbfeede34885b0411e5b9b25df47`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:54:23.599827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b9df689e-6b6a-438e-a95c-b09edacd5a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:23.600367 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bdce1-ce7c-4f0f-b357-726ee75f4f15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:23.601021 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bdce1-ce7c-4f0f-b357-726ee75f4f15 service nova] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:23.601309 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bdce1-ce7c-4f0f-b357-726ee75f4f15 service nova] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:23.601581 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bdce1-ce7c-4f0f-b357-726ee75f4f15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:23.608451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 757/1522] 10.222.0.119 () {58 vars in 1062 bytes} [Thu Jul 14 15:54:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:54:23.610517 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2bdce1-ce7c-4f0f-b357-726ee75f4f15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:23.612247 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2bdce1-ce7c-4f0f-b357-726ee75f4f15 service nova] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:23.616232 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df689e-6b6a-438e-a95c-b09edacd5a8b None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:23.623065 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 766/1523] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:54:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:54:23.625924 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df689e-6b6a-438e-a95c-b09edacd5a8b None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:23.631681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cec3b-ffab-430c-9cc2-15952f337361 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716cbbfeede34885b0411e5b9b25df47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:23.632355 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cec3b-ffab-430c-9cc2-15952f337361 service placement] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:23.632645 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cec3b-ffab-430c-9cc2-15952f337361 service placement] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:23.633025 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cec3b-ffab-430c-9cc2-15952f337361 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:23.641932 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85cec3b-ffab-430c-9cc2-15952f337361 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:23.643510 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85cec3b-ffab-430c-9cc2-15952f337361 service placement] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:23.653982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 758/1524] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:54:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:54:24.455579 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036e5f6-15c7-420f-bc0e-53ad7eaf48c1 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:24.456067 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036e5f6-15c7-420f-bc0e-53ad7eaf48c1 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:24.456314 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036e5f6-15c7-420f-bc0e-53ad7eaf48c1 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:24.457712 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:54:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:54:24.463440 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28bec8-e195-4cc5-86b5-6f5d630fa687 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:24.463880 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28bec8-e195-4cc5-86b5-6f5d630fa687 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:24.464091 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28bec8-e195-4cc5-86b5-6f5d630fa687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:24.482683 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-cf28bec8-e195-4cc5-86b5-6f5d630fa687 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:54:24.484637 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-cf28bec8-e195-4cc5-86b5-6f5d630fa687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:24.493131 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:54:24.649710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036e5f6-15c7-420f-bc0e-53ad7eaf48c1 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:24.664025 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036e5f6-15c7-420f-bc0e-53ad7eaf48c1 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:24.669592 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25173374-bada-4e43-acef-b0256a3e5077 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:24.670221 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25173374-bada-4e43-acef-b0256a3e5077 service nova] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:24.670508 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25173374-bada-4e43-acef-b0256a3e5077 service nova] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:24.670784 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25173374-bada-4e43-acef-b0256a3e5077 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:24.679578 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25173374-bada-4e43-acef-b0256a3e5077 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:24.681261 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25173374-bada-4e43-acef-b0256a3e5077 service nova] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:24.690635 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 768/1527] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:54:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:54:28.616370 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef217011-d441-4069-8109-4824d1470a49 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:28.616957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef217011-d441-4069-8109-4824d1470a49 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:28.616957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef217011-d441-4069-8109-4824d1470a49 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:28.618338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:54:28 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:54:28.623575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e5ceb-fdc5-4883-afab-c9c3b612ab1f None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:28.624019 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e5ceb-fdc5-4883-afab-c9c3b612ab1f None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:28.624148 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e5ceb-fdc5-4883-afab-c9c3b612ab1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:28.641829 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-8f2e5ceb-fdc5-4883-afab-c9c3b612ab1f None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:54:28.643009 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-8f2e5ceb-fdc5-4883-afab-c9c3b612ab1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:28.651289 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:54:28.726605 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef217011-d441-4069-8109-4824d1470a49 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:28.728353 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-ef217011-d441-4069-8109-4824d1470a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:28.804935 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef217011-d441-4069-8109-4824d1470a49 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:28.808431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a3202-dcff-46e0-8633-fa93aee2970d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:28.809068 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a3202-dcff-46e0-8633-fa93aee2970d service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:28.809351 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a3202-dcff-46e0-8633-fa93aee2970d service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:28.809629 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a3202-dcff-46e0-8633-fa93aee2970d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:28.819151 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a3202-dcff-46e0-8633-fa93aee2970d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:28.820695 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a3202-dcff-46e0-8633-fa93aee2970d service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:28.829895 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 761/1530] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:54:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:54:30.950019 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb186276-8572-4d98-84a6-ab3f57b2eb6d None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:30.950596 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb186276-8572-4d98-84a6-ab3f57b2eb6d None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:30.950709 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb186276-8572-4d98-84a6-ab3f57b2eb6d None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:30.951990 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 770/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:54:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:54:30.957482 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41655d10-2611-4302-a40e-4cd503f356b7 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:30.957990 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41655d10-2611-4302-a40e-4cd503f356b7 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:30.958130 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41655d10-2611-4302-a40e-4cd503f356b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:30.976376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-41655d10-2611-4302-a40e-4cd503f356b7 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:54:30.977570 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-41655d10-2611-4302-a40e-4cd503f356b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:30.985389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 762/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:54:31.023606 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb186276-8572-4d98-84a6-ab3f57b2eb6d None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:31.025661 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-eb186276-8572-4d98-84a6-ab3f57b2eb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:31.039494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb186276-8572-4d98-84a6-ab3f57b2eb6d None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:31.043166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4028a-d8b9-4773-b08c-47e2a6da9e96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:31.043804 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4028a-d8b9-4773-b08c-47e2a6da9e96 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:31.044092 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4028a-d8b9-4773-b08c-47e2a6da9e96 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:31.044401 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4028a-d8b9-4773-b08c-47e2a6da9e96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:31.054007 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4028a-d8b9-4773-b08c-47e2a6da9e96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:31.055438 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4028a-d8b9-4773-b08c-47e2a6da9e96 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:31.064933 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 771/1533] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:54:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:54:34.954671 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceef149-6178-49d7-83fb-0089ecdc415a None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:34.955238 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceef149-6178-49d7-83fb-0089ecdc415a None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:34.955238 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceef149-6178-49d7-83fb-0089ecdc415a None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:34.956895 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 763/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:54:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:54:34.962713 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beff1dc-46d7-4460-a516-52d5ddde4bd6 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:34.963133 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beff1dc-46d7-4460-a516-52d5ddde4bd6 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:34.963287 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beff1dc-46d7-4460-a516-52d5ddde4bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:34.982036 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-6beff1dc-46d7-4460-a516-52d5ddde4bd6 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:54:34.983273 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-6beff1dc-46d7-4460-a516-52d5ddde4bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:34.992354 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 772/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:54:35.311091 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceef149-6178-49d7-83fb-0089ecdc415a None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:35.312906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-4ceef149-6178-49d7-83fb-0089ecdc415a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:35.392171 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceef149-6178-49d7-83fb-0089ecdc415a None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:35.396332 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a031d83-d4d2-45a6-99a1-fa713c953d16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:35.396913 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a031d83-d4d2-45a6-99a1-fa713c953d16 service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:35.397199 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a031d83-d4d2-45a6-99a1-fa713c953d16 service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:35.397476 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a031d83-d4d2-45a6-99a1-fa713c953d16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:35.406472 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a031d83-d4d2-45a6-99a1-fa713c953d16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:35.407893 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a031d83-d4d2-45a6-99a1-fa713c953d16 service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:35.417940 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 764/1536] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:54:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:54:37.505709 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6484346-1bf0-4fd9-a3f6-26a8fa9b312a None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:37.506388 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6484346-1bf0-4fd9-a3f6-26a8fa9b312a None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:37.506388 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6484346-1bf0-4fd9-a3f6-26a8fa9b312a None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:37.507675 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 773/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:54:37 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:54:37.513629 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df18ba7-be49-45d1-b34a-361dcbd61454 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:37.514067 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df18ba7-be49-45d1-b34a-361dcbd61454 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:37.514180 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df18ba7-be49-45d1-b34a-361dcbd61454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:37.537400 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-9df18ba7-be49-45d1-b34a-361dcbd61454 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:54:37.538609 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-9df18ba7-be49-45d1-b34a-361dcbd61454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:37.546351 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 765/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:54:37.853411 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6484346-1bf0-4fd9-a3f6-26a8fa9b312a None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:37.855100 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f6484346-1bf0-4fd9-a3f6-26a8fa9b312a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:37.868613 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6484346-1bf0-4fd9-a3f6-26a8fa9b312a None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:37.872342 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682834a5-da35-4a95-b69e-c4157a4b7b1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:37.872940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682834a5-da35-4a95-b69e-c4157a4b7b1a service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:37.873219 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682834a5-da35-4a95-b69e-c4157a4b7b1a service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:37.873497 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682834a5-da35-4a95-b69e-c4157a4b7b1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:37.882598 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682834a5-da35-4a95-b69e-c4157a4b7b1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:37.885440 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682834a5-da35-4a95-b69e-c4157a4b7b1a service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:37.893673 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 774/1539] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:54:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:54:47.532172 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=91 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:47.889410 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=30 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:13.379635 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270f9a9-cead-4a62-99fc-0bca7f4332ce None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:13.381276 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270f9a9-cead-4a62-99fc-0bca7f4332ce None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:13.381830 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270f9a9-cead-4a62-99fc-0bca7f4332ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:13.406726 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-d270f9a9-cead-4a62-99fc-0bca7f4332ce None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:13.407941 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-d270f9a9-cead-4a62-99fc-0bca7f4332ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:13.424166 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 766/1540] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:13.441127 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eabaa9-5b7d-41a4-842c-74b815149bf1 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:13.442381 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eabaa9-5b7d-41a4-842c-74b815149bf1 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:13.442966 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eabaa9-5b7d-41a4-842c-74b815149bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:13.468279 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-08eabaa9-5b7d-41a4-842c-74b815149bf1 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:13.469914 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-08eabaa9-5b7d-41a4-842c-74b815149bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:13.483640 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 775/1541] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:13.485376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf706932-e034-48bf-b918-7aa3fb94df42 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:13.485676 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf706932-e034-48bf-b918-7aa3fb94df42 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:13.485960 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf706932-e034-48bf-b918-7aa3fb94df42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:13.488014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eabaa9-5b7d-41a4-842c-74b815149bf1 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:13.503363 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eabaa9-5b7d-41a4-842c-74b815149bf1 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:13.509368 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e281840-e028-40ca-aed3-0b6ecd38cf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:13.510458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e281840-e028-40ca-aed3-0b6ecd38cf85 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:13.510985 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e281840-e028-40ca-aed3-0b6ecd38cf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:13.511488 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e281840-e028-40ca-aed3-0b6ecd38cf85 admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:13.513405 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e281840-e028-40ca-aed3-0b6ecd38cf85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:56:13.513959 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e281840-e028-40ca-aed3-0b6ecd38cf85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:13.515397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: WARNING py.warnings [None req-8e281840-e028-40ca-aed3-0b6ecd38cf85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:56:13.515397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: warnings.warn(msg) Jul 14 15:56:13.515397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: Jul 14 15:56:13.516914 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e281840-e028-40ca-aed3-0b6ecd38cf85 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:13.541299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 776/1542] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:56:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:56:13.545278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-cf706932-e034-48bf-b918-7aa3fb94df42 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:13.546514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-cf706932-e034-48bf-b918-7aa3fb94df42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:13.551490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e281840-e028-40ca-aed3-0b6ecd38cf85 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:13.563021 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e281840-e028-40ca-aed3-0b6ecd38cf85 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:13.575182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0275bdc-7543-4650-a00b-252db1c4090c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:13.575876 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0275bdc-7543-4650-a00b-252db1c4090c admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:13.576189 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0275bdc-7543-4650-a00b-252db1c4090c admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:13.576528 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0275bdc-7543-4650-a00b-252db1c4090c admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:13.577240 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0275bdc-7543-4650-a00b-252db1c4090c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:13.579168 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0275bdc-7543-4650-a00b-252db1c4090c admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:13.601868 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 767/1543] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:13.613902 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082c4c6-b844-462b-803f-12fba3782fcf None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:13.614239 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082c4c6-b844-462b-803f-12fba3782fcf None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:13.614574 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082c4c6-b844-462b-803f-12fba3782fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:13.665303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-3082c4c6-b844-462b-803f-12fba3782fcf None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:13.666587 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-3082c4c6-b844-462b-803f-12fba3782fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:13.683727 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 768/1544] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:13.688932 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082c4c6-b844-462b-803f-12fba3782fcf None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:13.704920 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 777/1545] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:56:13 2022] POST /identity/v3/projects => generated 380 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:13.706189 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082c4c6-b844-462b-803f-12fba3782fcf None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:13.713926 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0310b7d-7b5b-4d5f-a5bc-495d0c6753ce None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:13.713926 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0310b7d-7b5b-4d5f-a5bc-495d0c6753ce None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:13.713926 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0310b7d-7b5b-4d5f-a5bc-495d0c6753ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:13.740389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-f0310b7d-7b5b-4d5f-a5bc-495d0c6753ce None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:13.740389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f0310b7d-7b5b-4d5f-a5bc-495d0c6753ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:13.861250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272dac2d-0b5d-4cb6-8afc-30b66cf71e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:13.862089 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dac2d-0b5d-4cb6-8afc-30b66cf71e8c admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:13.862377 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dac2d-0b5d-4cb6-8afc-30b66cf71e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:13.862780 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dac2d-0b5d-4cb6-8afc-30b66cf71e8c admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:13.863664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272dac2d-0b5d-4cb6-8afc-30b66cf71e8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:56:13.863989 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272dac2d-0b5d-4cb6-8afc-30b66cf71e8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:13.867199 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272dac2d-0b5d-4cb6-8afc-30b66cf71e8c admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:13.876570 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 778/1546] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:13.877655 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0310b7d-7b5b-4d5f-a5bc-495d0c6753ce None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:13.888238 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 769/1547] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:56:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:56:13.889842 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0310b7d-7b5b-4d5f-a5bc-495d0c6753ce None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:13.890368 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe55b1f-df95-448b-9f15-d8cf8e594780 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:13.891087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe55b1f-df95-448b-9f15-d8cf8e594780 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:13.891904 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe55b1f-df95-448b-9f15-d8cf8e594780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:13.899383 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9e30e-6702-4d48-987f-13c3a6a27f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:13.900490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9e30e-6702-4d48-987f-13c3a6a27f9e admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:13.901064 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9e30e-6702-4d48-987f-13c3a6a27f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:13.901584 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9e30e-6702-4d48-987f-13c3a6a27f9e admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:13.903091 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9e30e-6702-4d48-987f-13c3a6a27f9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:13.905326 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: WARNING py.warnings [None req-c7a9e30e-6702-4d48-987f-13c3a6a27f9e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:56:13.905326 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: warnings.warn(msg) Jul 14 15:56:13.905326 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: Jul 14 15:56:13.907860 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9e30e-6702-4d48-987f-13c3a6a27f9e admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:13.915294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-8fe55b1f-df95-448b-9f15-d8cf8e594780 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:13.916557 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-8fe55b1f-df95-448b-9f15-d8cf8e594780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:13.925176 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 770/1548] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:13.926548 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7f11a-c404-4161-9da8-5d77aa291973 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:13.927062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7f11a-c404-4161-9da8-5d77aa291973 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:13.929444 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7f11a-c404-4161-9da8-5d77aa291973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:13.950420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-eae7f11a-c404-4161-9da8-5d77aa291973 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:13.951633 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-eae7f11a-c404-4161-9da8-5d77aa291973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:13.960711 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 771/1549] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:13.962114 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0370b8-7ae6-45a7-aace-41906145d75d None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:13.962422 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0370b8-7ae6-45a7-aace-41906145d75d None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:13.962692 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0370b8-7ae6-45a7-aace-41906145d75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:13.982728 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-4e0370b8-7ae6-45a7-aace-41906145d75d None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:13.985559 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-4e0370b8-7ae6-45a7-aace-41906145d75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:13.993655 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 772/1550] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:13.994782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4c3b6-494e-4c88-a7b2-7200038403e3 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:13.995075 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4c3b6-494e-4c88-a7b2-7200038403e3 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:13.995389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4c3b6-494e-4c88-a7b2-7200038403e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:14.017866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-e9a4c3b6-494e-4c88-a7b2-7200038403e3 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:14.018381 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-e9a4c3b6-494e-4c88-a7b2-7200038403e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:14.027393 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 773/1551] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:14.029284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e4969-402c-45c1-b4aa-c2c08e771748 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:14.029584 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e4969-402c-45c1-b4aa-c2c08e771748 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:14.029867 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e4969-402c-45c1-b4aa-c2c08e771748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:14.047735 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-4a9e4969-402c-45c1-b4aa-c2c08e771748 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:14.049068 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-4a9e4969-402c-45c1-b4aa-c2c08e771748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:14.057756 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 774/1552] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:14.058504 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e4969-402c-45c1-b4aa-c2c08e771748 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:14.068444 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e4969-402c-45c1-b4aa-c2c08e771748 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:14.078832 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 779/1553] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:56:13 2022] POST /identity/v3/users => generated 291 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:14.078832 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a7a1e-49f0-4c8b-b7d6-810110b38f7e None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:14.078832 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a7a1e-49f0-4c8b-b7d6-810110b38f7e None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:14.078832 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a7a1e-49f0-4c8b-b7d6-810110b38f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:14.079234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514f1e1-1aef-4893-9143-749d3510a3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:14.079234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514f1e1-1aef-4893-9143-749d3510a3ed admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:14.079234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514f1e1-1aef-4893-9143-749d3510a3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:14.079234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514f1e1-1aef-4893-9143-749d3510a3ed admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:14.079552 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1514f1e1-1aef-4893-9143-749d3510a3ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:14.079552 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: WARNING py.warnings [None req-1514f1e1-1aef-4893-9143-749d3510a3ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:56:14.079552 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: warnings.warn(msg) Jul 14 15:56:14.079552 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: Jul 14 15:56:14.079552 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1514f1e1-1aef-4893-9143-749d3510a3ed admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:14.091191 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-175a7a1e-49f0-4c8b-b7d6-810110b38f7e None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:14.092416 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-175a7a1e-49f0-4c8b-b7d6-810110b38f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:14.100782 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 780/1554] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:14.102079 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fff9b1-ce12-45dd-aab9-baec05017f12 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:14.102366 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fff9b1-ce12-45dd-aab9-baec05017f12 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:14.102639 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fff9b1-ce12-45dd-aab9-baec05017f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:14.121668 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-88fff9b1-ce12-45dd-aab9-baec05017f12 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:14.128176 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-88fff9b1-ce12-45dd-aab9-baec05017f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:14.131580 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 781/1555] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:14.132908 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc66c10-e79e-41d1-be20-3fbda92d55eb None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:14.133196 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc66c10-e79e-41d1-be20-3fbda92d55eb None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:14.133474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc66c10-e79e-41d1-be20-3fbda92d55eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:14.150949 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-abc66c10-e79e-41d1-be20-3fbda92d55eb None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:14.152245 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-abc66c10-e79e-41d1-be20-3fbda92d55eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:14.160467 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 782/1556] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:14.161754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256889aa-3a60-4eee-a6a3-fa74b3424018 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:14.168402 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256889aa-3a60-4eee-a6a3-fa74b3424018 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:14.168402 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256889aa-3a60-4eee-a6a3-fa74b3424018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:14.180772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-256889aa-3a60-4eee-a6a3-fa74b3424018 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:14.181960 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-256889aa-3a60-4eee-a6a3-fa74b3424018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:14.189763 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 783/1557] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:14.190937 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa597317-400d-4afb-b1fe-cd73d4e8fc35 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:14.191225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa597317-400d-4afb-b1fe-cd73d4e8fc35 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:14.191504 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa597317-400d-4afb-b1fe-cd73d4e8fc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:14.205066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 775/1558] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:56:14 2022] POST /identity/v3/projects => generated 384 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:14.209548 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514f1e1-1aef-4893-9143-749d3510a3ed admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:14.209693 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-aa597317-400d-4afb-b1fe-cd73d4e8fc35 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:14.210909 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-aa597317-400d-4afb-b1fe-cd73d4e8fc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:14.269023 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514f1e1-1aef-4893-9143-749d3510a3ed admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:14.273815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d075258-2a10-4106-bb89-12705816c373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:14.273970 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 784/1559] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:14.274488 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d075258-2a10-4106-bb89-12705816c373 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:14.274780 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d075258-2a10-4106-bb89-12705816c373 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:14.274884 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa597317-400d-4afb-b1fe-cd73d4e8fc35 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:14.275060 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d075258-2a10-4106-bb89-12705816c373 admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:14.275790 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d075258-2a10-4106-bb89-12705816c373 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:56:14.276112 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d075258-2a10-4106-bb89-12705816c373 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:14.277779 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d075258-2a10-4106-bb89-12705816c373 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:14.284204 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa597317-400d-4afb-b1fe-cd73d4e8fc35 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:14.289168 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4cedb-1c46-4e68-9656-71beda386db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:14.289948 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4cedb-1c46-4e68-9656-71beda386db0 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:14.290286 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4cedb-1c46-4e68-9656-71beda386db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:14.290430 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 776/1560] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:56:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:56:14.290716 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4cedb-1c46-4e68-9656-71beda386db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:14.291513 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4cedb-1c46-4e68-9656-71beda386db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:14.291818 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a83458-db02-4b81-894d-176849e70b39 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:14.292116 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a83458-db02-4b81-894d-176849e70b39 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:14.292410 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a83458-db02-4b81-894d-176849e70b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:14.293986 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4cedb-1c46-4e68-9656-71beda386db0 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:14.296960 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:14.310193 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 785/1561] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:14 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:14.310193 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4cedb-1c46-4e68-9656-71beda386db0 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:14.312369 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-09a83458-db02-4b81-894d-176849e70b39 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:14.313687 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-09a83458-db02-4b81-894d-176849e70b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:14.321534 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4cedb-1c46-4e68-9656-71beda386db0 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:14.323607 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 777/1562] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:14.324495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a83458-db02-4b81-894d-176849e70b39 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:14.326344 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b724a13-c357-48e2-aa8d-1ad6a5071f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:14.327003 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b724a13-c357-48e2-aa8d-1ad6a5071f28 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:14.327294 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b724a13-c357-48e2-aa8d-1ad6a5071f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:14.327579 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b724a13-c357-48e2-aa8d-1ad6a5071f28 admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:14.328342 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b724a13-c357-48e2-aa8d-1ad6a5071f28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:56:14.328658 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b724a13-c357-48e2-aa8d-1ad6a5071f28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:14.330308 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b724a13-c357-48e2-aa8d-1ad6a5071f28 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:14.338021 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a83458-db02-4b81-894d-176849e70b39 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:14.342782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9381b-d398-427a-a88f-dc2bb610101f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:14.343468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9381b-d398-427a-a88f-dc2bb610101f admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:14.343607 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 786/1563] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:56:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:56:14.350818 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9381b-d398-427a-a88f-dc2bb610101f admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:14.350818 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9381b-d398-427a-a88f-dc2bb610101f admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:14.351024 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b724a13-c357-48e2-aa8d-1ad6a5071f28 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:14.351107 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9381b-d398-427a-a88f-dc2bb610101f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:56:14.351107 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9381b-d398-427a-a88f-dc2bb610101f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:14.351107 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9381b-d398-427a-a88f-dc2bb610101f admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:14.351107 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:14.356748 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b724a13-c357-48e2-aa8d-1ad6a5071f28 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:14.359950 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 778/1564] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:56:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:56:14.360682 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9381b-d398-427a-a88f-dc2bb610101f admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:14.365761 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e0d65-1c57-4bce-a889-e8acc37f50f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:14.372945 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e0d65-1c57-4bce-a889-e8acc37f50f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:14.372945 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e0d65-1c57-4bce-a889-e8acc37f50f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:14.372945 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e0d65-1c57-4bce-a889-e8acc37f50f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:14.372945 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e0d65-1c57-4bce-a889-e8acc37f50f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:56:14.372945 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e0d65-1c57-4bce-a889-e8acc37f50f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:14.373507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9381b-d398-427a-a88f-dc2bb610101f admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:14.373783 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e0d65-1c57-4bce-a889-e8acc37f50f2 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:14.376467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2dae2-57f4-4360-af61-4ec150561081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:14.377131 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2dae2-57f4-4360-af61-4ec150561081 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:14.377422 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2dae2-57f4-4360-af61-4ec150561081 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:14.377708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2dae2-57f4-4360-af61-4ec150561081 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:14.378396 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2dae2-57f4-4360-af61-4ec150561081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:14.380919 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2dae2-57f4-4360-af61-4ec150561081 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:14.386595 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 787/1565] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:56:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:56:14.387490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e0d65-1c57-4bce-a889-e8acc37f50f2 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:14.397275 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e0d65-1c57-4bce-a889-e8acc37f50f2 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:14.402073 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63caa6-5735-4399-b697-d6d03a4ab969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:14.402733 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63caa6-5735-4399-b697-d6d03a4ab969 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:14.403020 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63caa6-5735-4399-b697-d6d03a4ab969 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:14.403303 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63caa6-5735-4399-b697-d6d03a4ab969 admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:14.404035 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63caa6-5735-4399-b697-d6d03a4ab969 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:56:14.404376 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63caa6-5735-4399-b697-d6d03a4ab969 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:14.405974 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63caa6-5735-4399-b697-d6d03a4ab969 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:14.418869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 788/1566] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:56:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:56:14.419804 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63caa6-5735-4399-b697-d6d03a4ab969 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:14.429891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63caa6-5735-4399-b697-d6d03a4ab969 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:14.435493 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d33b1-6200-4171-9b5f-11f2c04da36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:14.436212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d33b1-6200-4171-9b5f-11f2c04da36b admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:14.436497 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d33b1-6200-4171-9b5f-11f2c04da36b admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:14.436773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d33b1-6200-4171-9b5f-11f2c04da36b admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:14.437457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d33b1-6200-4171-9b5f-11f2c04da36b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:14.439360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d33b1-6200-4171-9b5f-11f2c04da36b admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:14.500699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 779/1567] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:56:14 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:14.501540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2dae2-57f4-4360-af61-4ec150561081 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:14.511235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2dae2-57f4-4360-af61-4ec150561081 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:14.517427 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6024de-3ebd-4afe-9e56-d0a85ac63167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:14.518098 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6024de-3ebd-4afe-9e56-d0a85ac63167 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:14.518386 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6024de-3ebd-4afe-9e56-d0a85ac63167 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:14.518666 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6024de-3ebd-4afe-9e56-d0a85ac63167 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:14.519396 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6024de-3ebd-4afe-9e56-d0a85ac63167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:14.521139 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6024de-3ebd-4afe-9e56-d0a85ac63167 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:14.530581 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 789/1568] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:56:14 2022] POST /identity/v3/projects => generated 378 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:14.530581 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d33b1-6200-4171-9b5f-11f2c04da36b admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:14.533911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 780/1569] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:14 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:14.533911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6024de-3ebd-4afe-9e56-d0a85ac63167 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:14.544851 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6024de-3ebd-4afe-9e56-d0a85ac63167 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:14.596000 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d33b1-6200-4171-9b5f-11f2c04da36b admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:14.600507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82fb42a-66aa-49a0-b0a8-ca46703920c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:14.601277 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23759bfe-fea6-4c54-bb66-f147ec94cf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:14.601493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fb42a-66aa-49a0-b0a8-ca46703920c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:14.601910 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fb42a-66aa-49a0-b0a8-ca46703920c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:14.602029 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23759bfe-fea6-4c54-bb66-f147ec94cf0b admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:14.602217 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23759bfe-fea6-4c54-bb66-f147ec94cf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:14.602499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23759bfe-fea6-4c54-bb66-f147ec94cf0b admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:14.602719 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fb42a-66aa-49a0-b0a8-ca46703920c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:14.603237 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23759bfe-fea6-4c54-bb66-f147ec94cf0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:56:14.603431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82fb42a-66aa-49a0-b0a8-ca46703920c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:14.603541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23759bfe-fea6-4c54-bb66-f147ec94cf0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:14.605163 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23759bfe-fea6-4c54-bb66-f147ec94cf0b admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:14.605353 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82fb42a-66aa-49a0-b0a8-ca46703920c9 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:14.617475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 790/1570] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:56:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:56:14.618289 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23759bfe-fea6-4c54-bb66-f147ec94cf0b admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:14.629301 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23759bfe-fea6-4c54-bb66-f147ec94cf0b admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:14.634204 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4ad64-9ec4-4035-8e64-077aa82d5706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:14.634849 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4ad64-9ec4-4035-8e64-077aa82d5706 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:14.635142 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4ad64-9ec4-4035-8e64-077aa82d5706 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:14.635427 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4ad64-9ec4-4035-8e64-077aa82d5706 admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:14.636121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4ad64-9ec4-4035-8e64-077aa82d5706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:14.638046 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4ad64-9ec4-4035-8e64-077aa82d5706 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:14.672037 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 781/1571] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:56:14 2022] POST /identity/v3/projects => generated 380 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:14.672719 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82fb42a-66aa-49a0-b0a8-ca46703920c9 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:14.733572 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82fb42a-66aa-49a0-b0a8-ca46703920c9 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:14.738172 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f94139-8967-4e99-b052-6689fa636012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:14.738845 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f94139-8967-4e99-b052-6689fa636012 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:14.739131 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f94139-8967-4e99-b052-6689fa636012 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:14.739472 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f94139-8967-4e99-b052-6689fa636012 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:14.740703 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f94139-8967-4e99-b052-6689fa636012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:14.742587 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f94139-8967-4e99-b052-6689fa636012 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:14.768876 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 791/1572] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:56:14 2022] POST /identity/v3/projects => generated 376 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:14.774884 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4ad64-9ec4-4035-8e64-077aa82d5706 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:14.831987 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4ad64-9ec4-4035-8e64-077aa82d5706 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:14.837901 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e335a-fa1d-4e1b-a2c4-b4b3d5729fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:14.838564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e335a-fa1d-4e1b-a2c4-b4b3d5729fba admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:14.838849 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e335a-fa1d-4e1b-a2c4-b4b3d5729fba admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:14.839126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e335a-fa1d-4e1b-a2c4-b4b3d5729fba admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:14.839817 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e335a-fa1d-4e1b-a2c4-b4b3d5729fba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:14.841772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e335a-fa1d-4e1b-a2c4-b4b3d5729fba admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:14.852766 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:14.886743 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 782/1573] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:56:14 2022] POST /identity/v3/projects => generated 364 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:14.886743 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f94139-8967-4e99-b052-6689fa636012 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:14.925445 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:14.947240 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f94139-8967-4e99-b052-6689fa636012 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:14.951991 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ac0f2-8306-432c-afbf-aaf9baac658b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:14.952711 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ac0f2-8306-432c-afbf-aaf9baac658b admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:14.952999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ac0f2-8306-432c-afbf-aaf9baac658b admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:14.953278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ac0f2-8306-432c-afbf-aaf9baac658b admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:14.954008 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ac0f2-8306-432c-afbf-aaf9baac658b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:14.955591 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ac0f2-8306-432c-afbf-aaf9baac658b admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:14.957612 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 792/1574] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:56:14 2022] POST /identity/v3/projects => generated 406 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:14.958944 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e335a-fa1d-4e1b-a2c4-b4b3d5729fba admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:14.969881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 783/1575] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:14 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:14.969881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ac0f2-8306-432c-afbf-aaf9baac658b admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:14.978820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ac0f2-8306-432c-afbf-aaf9baac658b admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:15.029535 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e335a-fa1d-4e1b-a2c4-b4b3d5729fba admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:15.034266 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7efb0-901b-4134-9089-ddf359d9ba62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:15.035019 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7efb0-901b-4134-9089-ddf359d9ba62 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:15.035303 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7efb0-901b-4134-9089-ddf359d9ba62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:15.035578 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7efb0-901b-4134-9089-ddf359d9ba62 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:15.037069 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7efb0-901b-4134-9089-ddf359d9ba62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:15.039075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7efb0-901b-4134-9089-ddf359d9ba62 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:15.039878 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439cb7b-37d3-427e-8c5b-b7efc7d7473c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:15.040970 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439cb7b-37d3-427e-8c5b-b7efc7d7473c admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:15.041463 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439cb7b-37d3-427e-8c5b-b7efc7d7473c admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:15.042098 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439cb7b-37d3-427e-8c5b-b7efc7d7473c admin admin] PATH_INFO: `/v3/projects/337009c5341c4de4a64823371566766c/users/9d152595f433420f9cd0b7d45a4cb6da/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:15.060208 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f439cb7b-37d3-427e-8c5b-b7efc7d7473c admin admin] RBAC: Authorizing `identity:create_grant(project_id=337009c5341c4de4a64823371566766c, user_id=9d152595f433420f9cd0b7d45a4cb6da, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:15.065399 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: WARNING py.warnings [None req-f439cb7b-37d3-427e-8c5b-b7efc7d7473c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:56:15.065399 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: warnings.warn(msg) Jul 14 15:56:15.065399 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: Jul 14 15:56:15.065399 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f439cb7b-37d3-427e-8c5b-b7efc7d7473c admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:15.171904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 793/1576] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:56:14 2022] POST /identity/v3/users => generated 290 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:15.172688 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7efb0-901b-4134-9089-ddf359d9ba62 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:15.183125 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7efb0-901b-4134-9089-ddf359d9ba62 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:15.188363 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3942d4-6c35-4c53-bd27-26655a9a6463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:15.189121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3942d4-6c35-4c53-bd27-26655a9a6463 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:15.189426 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3942d4-6c35-4c53-bd27-26655a9a6463 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:15.189711 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3942d4-6c35-4c53-bd27-26655a9a6463 admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:15.190411 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3942d4-6c35-4c53-bd27-26655a9a6463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:15.194521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 784/1577] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:56:14 2022] PUT /identity/v3/projects/337009c5341c4de4a64823371566766c/users/9d152595f433420f9cd0b7d45a4cb6da/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:15.194697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3942d4-6c35-4c53-bd27-26655a9a6463 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:15.194806 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439cb7b-37d3-427e-8c5b-b7efc7d7473c admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:15.263624 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439cb7b-37d3-427e-8c5b-b7efc7d7473c admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:15.268382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af140b5-bb94-4ef8-93f8-e241c00f5547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:15.269078 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af140b5-bb94-4ef8-93f8-e241c00f5547 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:15.269366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af140b5-bb94-4ef8-93f8-e241c00f5547 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:15.269650 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af140b5-bb94-4ef8-93f8-e241c00f5547 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:15.270348 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af140b5-bb94-4ef8-93f8-e241c00f5547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:15.272906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af140b5-bb94-4ef8-93f8-e241c00f5547 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:15.304550 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 794/1578] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:56:15 2022] POST /identity/v3/projects => generated 394 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:15.305586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3942d4-6c35-4c53-bd27-26655a9a6463 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:15.369830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3942d4-6c35-4c53-bd27-26655a9a6463 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:15.374629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be796fa9-8dd7-491c-bf6f-4a7b72d919aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:15.375386 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be796fa9-8dd7-491c-bf6f-4a7b72d919aa admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:15.375692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be796fa9-8dd7-491c-bf6f-4a7b72d919aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:15.375969 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be796fa9-8dd7-491c-bf6f-4a7b72d919aa admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:15.376697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be796fa9-8dd7-491c-bf6f-4a7b72d919aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:15.378627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be796fa9-8dd7-491c-bf6f-4a7b72d919aa admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:15.389757 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 785/1579] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:56:15 2022] POST /identity/v3/users => generated 291 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:15.390684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af140b5-bb94-4ef8-93f8-e241c00f5547 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:15.401619 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af140b5-bb94-4ef8-93f8-e241c00f5547 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:15.406331 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da9b4e-a5a1-45be-9611-0a7b5b5323f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:15.406983 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da9b4e-a5a1-45be-9611-0a7b5b5323f5 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:15.407271 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da9b4e-a5a1-45be-9611-0a7b5b5323f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:15.407553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da9b4e-a5a1-45be-9611-0a7b5b5323f5 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:15.408307 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da9b4e-a5a1-45be-9611-0a7b5b5323f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:15.410205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da9b4e-a5a1-45be-9611-0a7b5b5323f5 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:15.482782 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 795/1580] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:56:15 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:15.483515 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be796fa9-8dd7-491c-bf6f-4a7b72d919aa admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:15.493468 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be796fa9-8dd7-491c-bf6f-4a7b72d919aa admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:15.497999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae28a68-a6f8-445f-92fd-96cd5daea3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:15.498646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae28a68-a6f8-445f-92fd-96cd5daea3db admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:15.498930 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae28a68-a6f8-445f-92fd-96cd5daea3db admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:15.499212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae28a68-a6f8-445f-92fd-96cd5daea3db admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:15.499888 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae28a68-a6f8-445f-92fd-96cd5daea3db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:15.501901 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae28a68-a6f8-445f-92fd-96cd5daea3db admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:15.506075 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 786/1581] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:56:15 2022] POST /identity/v3/users => generated 283 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:15.512203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da9b4e-a5a1-45be-9611-0a7b5b5323f5 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:15.519372 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da9b4e-a5a1-45be-9611-0a7b5b5323f5 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:15.524612 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f9073-7528-4731-96f3-8405c49979f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:15.525277 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f9073-7528-4731-96f3-8405c49979f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:15.525563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f9073-7528-4731-96f3-8405c49979f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:15.525864 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f9073-7528-4731-96f3-8405c49979f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:15.526587 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f9073-7528-4731-96f3-8405c49979f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:15.528196 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f9073-7528-4731-96f3-8405c49979f0 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:15.538897 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 787/1582] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:15 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:15.539681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f9073-7528-4731-96f3-8405c49979f0 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:15.549412 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f9073-7528-4731-96f3-8405c49979f0 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:15.554669 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6f85d-1938-4e0a-b1e8-1729dada1f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:15.555307 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6f85d-1938-4e0a-b1e8-1729dada1f38 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:15.555594 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6f85d-1938-4e0a-b1e8-1729dada1f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:15.555890 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6f85d-1938-4e0a-b1e8-1729dada1f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:15.556621 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6f85d-1938-4e0a-b1e8-1729dada1f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:15.558249 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6f85d-1938-4e0a-b1e8-1729dada1f38 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:15.568471 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 788/1583] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:15 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:15.569660 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40623a-bb43-40c1-ad3f-205174c9bab8 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:15.569948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40623a-bb43-40c1-ad3f-205174c9bab8 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:15.570228 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40623a-bb43-40c1-ad3f-205174c9bab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:15.575474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 796/1584] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:56:15 2022] POST /identity/v3/users => generated 304 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:15.575474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae28a68-a6f8-445f-92fd-96cd5daea3db admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:15.580953 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:15.587466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae28a68-a6f8-445f-92fd-96cd5daea3db admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:15.589525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-7d40623a-bb43-40c1-ad3f-205174c9bab8 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:15.590735 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-7d40623a-bb43-40c1-ad3f-205174c9bab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:15.592433 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b169d-ae6e-41fb-b0cb-e1d0fc930c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:15.593102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b169d-ae6e-41fb-b0cb-e1d0fc930c64 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:15.593440 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b169d-ae6e-41fb-b0cb-e1d0fc930c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:15.593662 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b169d-ae6e-41fb-b0cb-e1d0fc930c64 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:15.594351 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b169d-ae6e-41fb-b0cb-e1d0fc930c64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:15.596374 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b169d-ae6e-41fb-b0cb-e1d0fc930c64 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:15.599101 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 789/1585] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:15.599909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40623a-bb43-40c1-ad3f-205174c9bab8 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:15.612804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40623a-bb43-40c1-ad3f-205174c9bab8 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:15.618481 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366d543-3c0b-4382-90c2-a4630e8d794d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:15.619178 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366d543-3c0b-4382-90c2-a4630e8d794d admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:15.619468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366d543-3c0b-4382-90c2-a4630e8d794d admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:15.619752 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366d543-3c0b-4382-90c2-a4630e8d794d admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:15.620522 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366d543-3c0b-4382-90c2-a4630e8d794d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:15.622179 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366d543-3c0b-4382-90c2-a4630e8d794d admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:15.632832 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 790/1586] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:15 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:15.633603 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366d543-3c0b-4382-90c2-a4630e8d794d admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:15.643251 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366d543-3c0b-4382-90c2-a4630e8d794d admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:15.647870 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082ee60-a4f2-451e-8e5c-7a9551b71c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:15.648525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082ee60-a4f2-451e-8e5c-7a9551b71c5f admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:15.648813 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082ee60-a4f2-451e-8e5c-7a9551b71c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:15.649089 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082ee60-a4f2-451e-8e5c-7a9551b71c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:15.649818 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082ee60-a4f2-451e-8e5c-7a9551b71c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:15.651349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082ee60-a4f2-451e-8e5c-7a9551b71c5f admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:15.661047 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 791/1587] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:15 2022] GET /identity/v3/roles => generated 1427 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:15.662448 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082ee60-a4f2-451e-8e5c-7a9551b71c5f admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:15.672007 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082ee60-a4f2-451e-8e5c-7a9551b71c5f admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:15.676754 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52038a27-f9b5-4d02-868d-c58f69e575fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:15.678041 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52038a27-f9b5-4d02-868d-c58f69e575fd admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:15.678353 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52038a27-f9b5-4d02-868d-c58f69e575fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:15.678631 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52038a27-f9b5-4d02-868d-c58f69e575fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:15.679336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52038a27-f9b5-4d02-868d-c58f69e575fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:15.681004 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52038a27-f9b5-4d02-868d-c58f69e575fd admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:15.691159 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 792/1588] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:15 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:15.691899 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52038a27-f9b5-4d02-868d-c58f69e575fd admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:15.701886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52038a27-f9b5-4d02-868d-c58f69e575fd admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:15.706423 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3fdaa-cca1-45e1-b3bb-8ec2564a7a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:15.707575 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3fdaa-cca1-45e1-b3bb-8ec2564a7a23 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:15.707864 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3fdaa-cca1-45e1-b3bb-8ec2564a7a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:15.708177 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3fdaa-cca1-45e1-b3bb-8ec2564a7a23 admin admin] PATH_INFO: `/v3/projects/4941c3a4d1be445b972c8684bc8b18d0/users/b0d02887422a43e4bb69566a2d64e890/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:15.722884 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3fdaa-cca1-45e1-b3bb-8ec2564a7a23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4941c3a4d1be445b972c8684bc8b18d0, user_id=b0d02887422a43e4bb69566a2d64e890, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:15.725723 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3fdaa-cca1-45e1-b3bb-8ec2564a7a23 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:15.752213 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 797/1589] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:56:15 2022] POST /identity/v3/users => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:15.752213 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b169d-ae6e-41fb-b0cb-e1d0fc930c64 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:15.761443 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b169d-ae6e-41fb-b0cb-e1d0fc930c64 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:15.766024 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15601560-3094-464f-a0ef-9ac7a5349dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:15.766676 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15601560-3094-464f-a0ef-9ac7a5349dfe admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:15.766966 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15601560-3094-464f-a0ef-9ac7a5349dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:15.767247 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15601560-3094-464f-a0ef-9ac7a5349dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:15.767963 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15601560-3094-464f-a0ef-9ac7a5349dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:15.769591 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15601560-3094-464f-a0ef-9ac7a5349dfe admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:15.780002 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 798/1590] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:15 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:15.780883 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15601560-3094-464f-a0ef-9ac7a5349dfe admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:15.785714 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=86,keystone:INSERT=14 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:15.790934 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15601560-3094-464f-a0ef-9ac7a5349dfe admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:15.791261 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 793/1591] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:56:15 2022] PUT /identity/v3/projects/4941c3a4d1be445b972c8684bc8b18d0/users/b0d02887422a43e4bb69566a2d64e890/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:15.792198 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3fdaa-cca1-45e1-b3bb-8ec2564a7a23 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:15.849303 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df21c38-cc58-4537-acaf-46659957b94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:15.850093 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df21c38-cc58-4537-acaf-46659957b94b admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:15.850455 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df21c38-cc58-4537-acaf-46659957b94b admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:15.850813 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df21c38-cc58-4537-acaf-46659957b94b admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:15.851623 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df21c38-cc58-4537-acaf-46659957b94b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:15.852167 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3fdaa-cca1-45e1-b3bb-8ec2564a7a23 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:15.853272 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df21c38-cc58-4537-acaf-46659957b94b admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:15.856143 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb172c-06b3-4234-8159-a65281457210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:15.856812 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb172c-06b3-4234-8159-a65281457210 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:15.857081 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb172c-06b3-4234-8159-a65281457210 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:15.857355 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb172c-06b3-4234-8159-a65281457210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:15.863673 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 799/1592] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:15 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:15.864939 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df21c38-cc58-4537-acaf-46659957b94b admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:15.867389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb172c-06b3-4234-8159-a65281457210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:15.869005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb172c-06b3-4234-8159-a65281457210 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:15.874376 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df21c38-cc58-4537-acaf-46659957b94b admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:15.878632 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 794/1593] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:15.881650 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb15734-db36-49eb-95f6-353e0b03110c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:15.881781 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb172c-06b3-4234-8159-a65281457210 service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:15.881881 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb15734-db36-49eb-95f6-353e0b03110c admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:15.881881 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb15734-db36-49eb-95f6-353e0b03110c admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:15.881881 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb15734-db36-49eb-95f6-353e0b03110c admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:15.881881 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb15734-db36-49eb-95f6-353e0b03110c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:15.883348 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb15734-db36-49eb-95f6-353e0b03110c admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:15.889213 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb172c-06b3-4234-8159-a65281457210 service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:15.894286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f93239-644c-4a42-bd70-590fbfecf973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:15.894450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 800/1594] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:15 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:15.894959 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f93239-644c-4a42-bd70-590fbfecf973 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:15.895520 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb15734-db36-49eb-95f6-353e0b03110c admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:15.897495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f93239-644c-4a42-bd70-590fbfecf973 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:15.897495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f93239-644c-4a42-bd70-590fbfecf973 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:15.897495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f93239-644c-4a42-bd70-590fbfecf973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:15.898135 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f93239-644c-4a42-bd70-590fbfecf973 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:15.908609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb15734-db36-49eb-95f6-353e0b03110c admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:15.913633 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 795/1595] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:15 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:15.914509 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f93239-644c-4a42-bd70-590fbfecf973 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:15.919804 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285985a-eeb8-4ea6-bbb6-d8ba22690de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:15.920596 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285985a-eeb8-4ea6-bbb6-d8ba22690de6 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:15.920967 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285985a-eeb8-4ea6-bbb6-d8ba22690de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:15.921256 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285985a-eeb8-4ea6-bbb6-d8ba22690de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:15.922005 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285985a-eeb8-4ea6-bbb6-d8ba22690de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:15.923751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285985a-eeb8-4ea6-bbb6-d8ba22690de6 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:15.924539 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f93239-644c-4a42-bd70-590fbfecf973 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:15.932474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cecc091-48a5-4c73-a7e0-030b43684fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:15.934670 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecc091-48a5-4c73-a7e0-030b43684fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:15.934670 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecc091-48a5-4c73-a7e0-030b43684fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:15.934670 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecc091-48a5-4c73-a7e0-030b43684fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:15.934670 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cecc091-48a5-4c73-a7e0-030b43684fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:15.935850 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 801/1596] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:15 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:15.936347 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cecc091-48a5-4c73-a7e0-030b43684fa2 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:15.936756 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285985a-eeb8-4ea6-bbb6-d8ba22690de6 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:15.947045 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285985a-eeb8-4ea6-bbb6-d8ba22690de6 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:15.947961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 796/1597] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:15 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:15.949223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d58f3-2490-4629-8587-e704a314958f None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:15.949510 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d58f3-2490-4629-8587-e704a314958f None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:15.949787 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d58f3-2490-4629-8587-e704a314958f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:15.954323 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaed01d-b1d7-47ab-b401-1c7e353aba89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:15.955206 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaed01d-b1d7-47ab-b401-1c7e353aba89 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:15.955491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaed01d-b1d7-47ab-b401-1c7e353aba89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:15.955771 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaed01d-b1d7-47ab-b401-1c7e353aba89 admin admin] PATH_INFO: `/v3/projects/550bd9d36a324331a157f3cd2de42ca3/users/6bbbf243c1334013ac235aa5b0853621/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:15.967534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-5f3d58f3-2490-4629-8587-e704a314958f None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:15.968763 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-5f3d58f3-2490-4629-8587-e704a314958f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:15.971706 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaed01d-b1d7-47ab-b401-1c7e353aba89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=550bd9d36a324331a157f3cd2de42ca3, user_id=6bbbf243c1334013ac235aa5b0853621, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:15.973588 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaed01d-b1d7-47ab-b401-1c7e353aba89 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:15.977168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 797/1598] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:15.977751 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d58f3-2490-4629-8587-e704a314958f None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:15.987025 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d58f3-2490-4629-8587-e704a314958f None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:15.992495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7c5e7-c458-410b-8475-6d2adbbc9571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:15.993152 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7c5e7-c458-410b-8475-6d2adbbc9571 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:15.993433 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7c5e7-c458-410b-8475-6d2adbbc9571 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:15.993708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7c5e7-c458-410b-8475-6d2adbbc9571 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:15.994481 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7c5e7-c458-410b-8475-6d2adbbc9571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:15.996055 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7c5e7-c458-410b-8475-6d2adbbc9571 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:16.011846 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 798/1599] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:15 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:16.011846 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7c5e7-c458-410b-8475-6d2adbbc9571 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:16.016553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7c5e7-c458-410b-8475-6d2adbbc9571 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:16.021712 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85a4af-f3e0-4413-aaa3-312dabcd9445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:16.022601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85a4af-f3e0-4413-aaa3-312dabcd9445 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:16.022914 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85a4af-f3e0-4413-aaa3-312dabcd9445 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:16.023195 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85a4af-f3e0-4413-aaa3-312dabcd9445 admin admin] PATH_INFO: `/v3/projects/7acceadaad2c4031b0ea6ca9dd67a86c/users/cee59e48e13848e0bd4d0679227c7a7f/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:16.039033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb85a4af-f3e0-4413-aaa3-312dabcd9445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7acceadaad2c4031b0ea6ca9dd67a86c, user_id=cee59e48e13848e0bd4d0679227c7a7f, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:16.041753 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb85a4af-f3e0-4413-aaa3-312dabcd9445 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:16.151298 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 802/1600] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:56:15 2022] PUT /identity/v3/projects/550bd9d36a324331a157f3cd2de42ca3/users/6bbbf243c1334013ac235aa5b0853621/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:16.152249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaed01d-b1d7-47ab-b401-1c7e353aba89 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:16.202943 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 799/1601] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:56:16 2022] PUT /identity/v3/projects/7acceadaad2c4031b0ea6ca9dd67a86c/users/cee59e48e13848e0bd4d0679227c7a7f/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:16.203762 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85a4af-f3e0-4413-aaa3-312dabcd9445 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:16.226470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaed01d-b1d7-47ab-b401-1c7e353aba89 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:16.247622 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:16.267836 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85a4af-f3e0-4413-aaa3-312dabcd9445 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:16.273246 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d32f6-484f-456d-b1ca-ab71217516b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:16.274143 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d32f6-484f-456d-b1ca-ab71217516b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:16.274438 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d32f6-484f-456d-b1ca-ab71217516b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:16.274734 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d32f6-484f-456d-b1ca-ab71217516b7 admin admin] PATH_INFO: `/v3/projects/ba5dbb0fc596455884bdb838fd029d08/users/5c41302493844c599fc3d9f8ea9e86c5/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:16.283950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749262d2-4db4-4514-ae25-6eb88889ae40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:16.284874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749262d2-4db4-4514-ae25-6eb88889ae40 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:16.285154 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749262d2-4db4-4514-ae25-6eb88889ae40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:16.285425 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749262d2-4db4-4514-ae25-6eb88889ae40 admin admin] PATH_INFO: `/v3/projects/7335838eb58d4485a4cb7676cca8ebf5/users/83bab4a7051c4c5a9f85e45af977e6f9/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:16.288004 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:16.289512 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d32f6-484f-456d-b1ca-ab71217516b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba5dbb0fc596455884bdb838fd029d08, user_id=5c41302493844c599fc3d9f8ea9e86c5, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:16.296906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d32f6-484f-456d-b1ca-ab71217516b7 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:16.303923 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749262d2-4db4-4514-ae25-6eb88889ae40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7335838eb58d4485a4cb7676cca8ebf5, user_id=83bab4a7051c4c5a9f85e45af977e6f9, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:16.305334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749262d2-4db4-4514-ae25-6eb88889ae40 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:16.470658 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 800/1602] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:56:16 2022] PUT /identity/v3/projects/ba5dbb0fc596455884bdb838fd029d08/users/5c41302493844c599fc3d9f8ea9e86c5/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:16.471632 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d32f6-484f-456d-b1ca-ab71217516b7 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:16.532958 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d32f6-484f-456d-b1ca-ab71217516b7 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:16.533543 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 803/1603] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:56:16 2022] PUT /identity/v3/projects/7335838eb58d4485a4cb7676cca8ebf5/users/83bab4a7051c4c5a9f85e45af977e6f9/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:16.535016 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749262d2-4db4-4514-ae25-6eb88889ae40 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:16.595665 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749262d2-4db4-4514-ae25-6eb88889ae40 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:16.597924 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e50c9f-306a-4b24-a5ce-2ddf00388472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:16.598851 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e50c9f-306a-4b24-a5ce-2ddf00388472 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:16.599334 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e50c9f-306a-4b24-a5ce-2ddf00388472 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:16.599801 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e50c9f-306a-4b24-a5ce-2ddf00388472 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:16.600195 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e8bc2-2433-4ada-86e2-be89f5c8b863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:16.600850 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e8bc2-2433-4ada-86e2-be89f5c8b863 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:16.601137 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e8bc2-2433-4ada-86e2-be89f5c8b863 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:16.601423 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e8bc2-2433-4ada-86e2-be89f5c8b863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:16.601572 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e50c9f-306a-4b24-a5ce-2ddf00388472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:16.603032 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e50c9f-306a-4b24-a5ce-2ddf00388472 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:16.612443 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e8bc2-2433-4ada-86e2-be89f5c8b863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:16.615290 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e8bc2-2433-4ada-86e2-be89f5c8b863 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:16.618939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 801/1604] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:16 2022] GET /identity/v3/roles => generated 1427 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:16.618939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e50c9f-306a-4b24-a5ce-2ddf00388472 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:16.627284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e50c9f-306a-4b24-a5ce-2ddf00388472 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:16.627821 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 804/1605] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:16.629449 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb0b6c-ea65-4100-b3f5-2d1e67115848 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:16.630898 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb0b6c-ea65-4100-b3f5-2d1e67115848 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:16.630898 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb0b6c-ea65-4100-b3f5-2d1e67115848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:16.633620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8c50d-4c9b-4e48-8afe-fa585473061b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:16.634598 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8c50d-4c9b-4e48-8afe-fa585473061b admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:16.634893 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8c50d-4c9b-4e48-8afe-fa585473061b admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:16.635175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8c50d-4c9b-4e48-8afe-fa585473061b admin admin] PATH_INFO: `/v3/projects/adf05bdcafef43ec985634723e839b0f/users/196d2c2f3560489d924e726e8c7b62dc/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:16.651305 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-e4cb0b6c-ea65-4100-b3f5-2d1e67115848 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:16.652630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-e4cb0b6c-ea65-4100-b3f5-2d1e67115848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:16.663382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8c50d-4c9b-4e48-8afe-fa585473061b admin admin] RBAC: Authorizing `identity:create_grant(project_id=adf05bdcafef43ec985634723e839b0f, user_id=196d2c2f3560489d924e726e8c7b62dc, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:16.665095 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 805/1606] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:16.666082 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8c50d-4c9b-4e48-8afe-fa585473061b admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:16.666573 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec9a02-5c3d-4074-98d9-4db370228824 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:16.666996 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec9a02-5c3d-4074-98d9-4db370228824 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:16.667381 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec9a02-5c3d-4074-98d9-4db370228824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:16.698148 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-d5ec9a02-5c3d-4074-98d9-4db370228824 None None] MFA Rules not processed for user `cee59e48e13848e0bd4d0679227c7a7f`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:16.699828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-d5ec9a02-5c3d-4074-98d9-4db370228824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:16.769470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 806/1607] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:16.770866 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8546dc2-74eb-4a58-8adc-50601883da82 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:16.771303 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8546dc2-74eb-4a58-8adc-50601883da82 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:16.771648 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8546dc2-74eb-4a58-8adc-50601883da82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:16.795979 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 802/1608] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:56:16 2022] PUT /identity/v3/projects/adf05bdcafef43ec985634723e839b0f/users/196d2c2f3560489d924e726e8c7b62dc/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:16.795979 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f85b6-3887-46a4-9c01-37ed961e8e26 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:16.795979 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f85b6-3887-46a4-9c01-37ed961e8e26 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:16.795979 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f85b6-3887-46a4-9c01-37ed961e8e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:16.804763 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-b8546dc2-74eb-4a58-8adc-50601883da82 None None] MFA Rules not processed for user `5c41302493844c599fc3d9f8ea9e86c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:16.806357 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-b8546dc2-74eb-4a58-8adc-50601883da82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:16.824553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-7a8f85b6-3887-46a4-9c01-37ed961e8e26 None None] MFA Rules not processed for user `83bab4a7051c4c5a9f85e45af977e6f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:16.824553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-7a8f85b6-3887-46a4-9c01-37ed961e8e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:16.859019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:16.884069 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 807/1609] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:16.888198 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8546dc2-74eb-4a58-8adc-50601883da82 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:16.898177 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 803/1610] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:16.906037 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f85b6-3887-46a4-9c01-37ed961e8e26 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:16.906181 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:16.966960 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f85b6-3887-46a4-9c01-37ed961e8e26 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:16.970909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44eaf7-a995-49f9-90ac-e0cb0187c530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:16.971717 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44eaf7-a995-49f9-90ac-e0cb0187c530 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:16.972071 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44eaf7-a995-49f9-90ac-e0cb0187c530 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:16.972472 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44eaf7-a995-49f9-90ac-e0cb0187c530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:16.980697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8546dc2-74eb-4a58-8adc-50601883da82 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:16.983492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44eaf7-a995-49f9-90ac-e0cb0187c530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:16.985284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44eaf7-a995-49f9-90ac-e0cb0187c530 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:16.986121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea01000-7b3a-4add-a1af-5427b9fb2a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:16.987269 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea01000-7b3a-4add-a1af-5427b9fb2a7c admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:16.987502 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea01000-7b3a-4add-a1af-5427b9fb2a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:16.987792 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea01000-7b3a-4add-a1af-5427b9fb2a7c admin admin] PATH_INFO: `/v3/projects/2604fe90997b48439ed17360fa15f24a/users/fe6f58bedd87454bad46b0c48697eec9/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:16.997603 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 804/1611] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:16.998570 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44eaf7-a995-49f9-90ac-e0cb0187c530 service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:17.005584 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea01000-7b3a-4add-a1af-5427b9fb2a7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2604fe90997b48439ed17360fa15f24a, user_id=fe6f58bedd87454bad46b0c48697eec9, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:17.008568 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea01000-7b3a-4add-a1af-5427b9fb2a7c admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:17.008773 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44eaf7-a995-49f9-90ac-e0cb0187c530 service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:17.014871 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e15fa-96ca-4a2b-99b3-7a5739ec6c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:17.015533 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e15fa-96ca-4a2b-99b3-7a5739ec6c42 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:17.015818 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e15fa-96ca-4a2b-99b3-7a5739ec6c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:17.016109 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e15fa-96ca-4a2b-99b3-7a5739ec6c42 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:17.016809 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e15fa-96ca-4a2b-99b3-7a5739ec6c42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:17.018829 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e15fa-96ca-4a2b-99b3-7a5739ec6c42 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:17.124614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 808/1612] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:56:16 2022] PUT /identity/v3/projects/2604fe90997b48439ed17360fa15f24a/users/fe6f58bedd87454bad46b0c48697eec9/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:17.126043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9158fd-7103-4348-9b59-ff34286e4bfc None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:17.127876 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9158fd-7103-4348-9b59-ff34286e4bfc None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:17.127876 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9158fd-7103-4348-9b59-ff34286e4bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:17.134447 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 805/1613] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:56:16 2022] POST /identity/v3/projects => generated 382 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:17.134447 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e15fa-96ca-4a2b-99b3-7a5739ec6c42 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:17.157667 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-4c9158fd-7103-4348-9b59-ff34286e4bfc None None] MFA Rules not processed for user `196d2c2f3560489d924e726e8c7b62dc`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:17.161428 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-4c9158fd-7103-4348-9b59-ff34286e4bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:17.213550 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e15fa-96ca-4a2b-99b3-7a5739ec6c42 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:17.219052 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b12f6f-f853-437e-87a9-6ad19e0da054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:17.219786 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b12f6f-f853-437e-87a9-6ad19e0da054 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:17.220546 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b12f6f-f853-437e-87a9-6ad19e0da054 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:17.221151 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b12f6f-f853-437e-87a9-6ad19e0da054 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:17.221552 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b12f6f-f853-437e-87a9-6ad19e0da054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:17.224714 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b12f6f-f853-437e-87a9-6ad19e0da054 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:17.239914 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 809/1614] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:17 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:17.243464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50204839-a630-427b-aa12-07ee2b1b9a5e None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:17.244992 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50204839-a630-427b-aa12-07ee2b1b9a5e None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:17.245523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50204839-a630-427b-aa12-07ee2b1b9a5e None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:17.247189 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 810/1615] 10.222.0.119 () {54 vars in 966 bytes} [Thu Jul 14 15:56:17 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:56:17.248669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca2ad9-4f36-49bd-97de-e98c8240abea None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:17.248965 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca2ad9-4f36-49bd-97de-e98c8240abea None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:17.249299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca2ad9-4f36-49bd-97de-e98c8240abea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:17.268329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-f4ca2ad9-4f36-49bd-97de-e98c8240abea None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:17.269556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f4ca2ad9-4f36-49bd-97de-e98c8240abea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:17.279748 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 811/1616] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:17.279748 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca2ad9-4f36-49bd-97de-e98c8240abea None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:17.291697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca2ad9-4f36-49bd-97de-e98c8240abea None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:17.299453 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14a0f7-6729-444f-a603-aaaf4f8c219f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:17.300237 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14a0f7-6729-444f-a603-aaaf4f8c219f admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:17.300529 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14a0f7-6729-444f-a603-aaaf4f8c219f admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:17.300813 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14a0f7-6729-444f-a603-aaaf4f8c219f admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:17.301557 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14a0f7-6729-444f-a603-aaaf4f8c219f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:17.304736 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14a0f7-6729-444f-a603-aaaf4f8c219f admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:17.332648 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 806/1617] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:56:17 2022] POST /identity/v3/projects => generated 364 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:17.334175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b12f6f-f853-437e-87a9-6ad19e0da054 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:17.382440 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:17.403065 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b12f6f-f853-437e-87a9-6ad19e0da054 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:17.407677 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcdc49e-c6a8-40a0-a2dc-0e5e7a0b47a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:17.408375 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdc49e-c6a8-40a0-a2dc-0e5e7a0b47a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:17.408663 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdc49e-c6a8-40a0-a2dc-0e5e7a0b47a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:17.408940 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdc49e-c6a8-40a0-a2dc-0e5e7a0b47a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:17.409630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcdc49e-c6a8-40a0-a2dc-0e5e7a0b47a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:17.412069 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcdc49e-c6a8-40a0-a2dc-0e5e7a0b47a0 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:17.452706 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 812/1618] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:56:17 2022] POST /identity/v3/users => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:17.452706 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220113d1-675b-495b-bff3-7ff4dd2a3a1f None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:17.452706 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220113d1-675b-495b-bff3-7ff4dd2a3a1f None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:17.452706 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220113d1-675b-495b-bff3-7ff4dd2a3a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:17.489905 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-220113d1-675b-495b-bff3-7ff4dd2a3a1f None None] MFA Rules not processed for user `a1e4c833a4684561ab52eda5734a7766`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:17.491285 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-220113d1-675b-495b-bff3-7ff4dd2a3a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:17.565527 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 807/1619] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:56:17 2022] POST /identity/v3/projects => generated 404 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:17.565527 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcdc49e-c6a8-40a0-a2dc-0e5e7a0b47a0 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:17.570238 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 813/1620] 10.222.0.119 () {58 vars in 1063 bytes} [Thu Jul 14 15:56:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:17.571253 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220113d1-675b-495b-bff3-7ff4dd2a3a1f None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:17.582296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220113d1-675b-495b-bff3-7ff4dd2a3a1f None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:17.585951 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:17.651795 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29c496-93e4-4445-8ee9-ae7626e6a588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:17.652534 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29c496-93e4-4445-8ee9-ae7626e6a588 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:17.652781 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29c496-93e4-4445-8ee9-ae7626e6a588 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:17.653222 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29c496-93e4-4445-8ee9-ae7626e6a588 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:17.653955 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29c496-93e4-4445-8ee9-ae7626e6a588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:17.655872 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29c496-93e4-4445-8ee9-ae7626e6a588 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:17.660705 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcdc49e-c6a8-40a0-a2dc-0e5e7a0b47a0 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:17.664967 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b8f42-dd05-4261-99d3-4eb59cbc424a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:17.665713 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b8f42-dd05-4261-99d3-4eb59cbc424a service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:17.666075 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b8f42-dd05-4261-99d3-4eb59cbc424a service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:17.666371 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b8f42-dd05-4261-99d3-4eb59cbc424a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:17.675805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b8f42-dd05-4261-99d3-4eb59cbc424a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:17.677543 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b8f42-dd05-4261-99d3-4eb59cbc424a service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:17.687612 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 808/1621] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:17.688450 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b8f42-dd05-4261-99d3-4eb59cbc424a service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:17.701589 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b8f42-dd05-4261-99d3-4eb59cbc424a service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:17.706051 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d09a78-a290-41bf-8161-a4b78efc03e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:17.706980 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d09a78-a290-41bf-8161-a4b78efc03e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:17.707274 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d09a78-a290-41bf-8161-a4b78efc03e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:17.707554 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d09a78-a290-41bf-8161-a4b78efc03e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:17.708384 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d09a78-a290-41bf-8161-a4b78efc03e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:17.710794 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d09a78-a290-41bf-8161-a4b78efc03e2 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:17.723350 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 809/1622] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:17 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:17.723350 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d09a78-a290-41bf-8161-a4b78efc03e2 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:17.740872 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d09a78-a290-41bf-8161-a4b78efc03e2 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:17.745893 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226a04e-7a81-42c8-87aa-7d7325afa89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:17.746576 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226a04e-7a81-42c8-87aa-7d7325afa89f admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:17.746861 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226a04e-7a81-42c8-87aa-7d7325afa89f admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:17.747138 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226a04e-7a81-42c8-87aa-7d7325afa89f admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:17.747829 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226a04e-7a81-42c8-87aa-7d7325afa89f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:17.750140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226a04e-7a81-42c8-87aa-7d7325afa89f admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:17.760091 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 814/1623] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:56:17 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:17.762716 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29c496-93e4-4445-8ee9-ae7626e6a588 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:17.870657 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 810/1624] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:56:17 2022] POST /identity/v3/users => generated 309 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:17.871605 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226a04e-7a81-42c8-87aa-7d7325afa89f admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:17.892262 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226a04e-7a81-42c8-87aa-7d7325afa89f admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:17.897460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29c496-93e4-4445-8ee9-ae7626e6a588 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:17.904497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb78bd5-014c-4673-936d-dd8e497d2e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:17.905446 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb78bd5-014c-4673-936d-dd8e497d2e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:17.905733 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb78bd5-014c-4673-936d-dd8e497d2e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:17.906712 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb78bd5-014c-4673-936d-dd8e497d2e48 admin admin] PATH_INFO: `/v3/projects/e93e3e5401674b6a9a13aa4c62923719/users/2cbf5e3046b04b5a81a38414745f941d/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:17.910082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba9e07-104b-47c5-8c10-4fb99b9aa385 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:17.910846 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba9e07-104b-47c5-8c10-4fb99b9aa385 service nova] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:17.911165 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba9e07-104b-47c5-8c10-4fb99b9aa385 service nova] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:17.911479 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba9e07-104b-47c5-8c10-4fb99b9aa385 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:17.939453 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb78bd5-014c-4673-936d-dd8e497d2e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e93e3e5401674b6a9a13aa4c62923719, user_id=2cbf5e3046b04b5a81a38414745f941d, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:17.942172 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb78bd5-014c-4673-936d-dd8e497d2e48 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:18.023335 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba9e07-104b-47c5-8c10-4fb99b9aa385 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:18.030842 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 811/1625] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:56:17 2022] PUT /identity/v3/projects/e93e3e5401674b6a9a13aa4c62923719/users/2cbf5e3046b04b5a81a38414745f941d/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:18.031700 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb78bd5-014c-4673-936d-dd8e497d2e48 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:18.033373 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba9e07-104b-47c5-8c10-4fb99b9aa385 service nova] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:18.045314 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 815/1626] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:18.046627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba9e07-104b-47c5-8c10-4fb99b9aa385 service nova] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:18.061847 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba9e07-104b-47c5-8c10-4fb99b9aa385 service nova] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:18.118184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb78bd5-014c-4673-936d-dd8e497d2e48 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:18.127467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07775c9b-da08-4326-a0e5-e3f626d41a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:18.128859 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07775c9b-da08-4326-a0e5-e3f626d41a9f admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:18.129653 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07775c9b-da08-4326-a0e5-e3f626d41a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:18.130946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07775c9b-da08-4326-a0e5-e3f626d41a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:18.132210 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07775c9b-da08-4326-a0e5-e3f626d41a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:18.134621 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07775c9b-da08-4326-a0e5-e3f626d41a9f admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:18.151501 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 812/1627] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:18 2022] GET /identity/v3/roles => generated 1427 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:18.153350 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07775c9b-da08-4326-a0e5-e3f626d41a9f admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:18.166742 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07775c9b-da08-4326-a0e5-e3f626d41a9f admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:18.173548 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99ce7c-1f21-4b91-8ec4-e3f927dc3f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:18.174495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99ce7c-1f21-4b91-8ec4-e3f927dc3f05 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:18.174956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99ce7c-1f21-4b91-8ec4-e3f927dc3f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:18.175388 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99ce7c-1f21-4b91-8ec4-e3f927dc3f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:18.176336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99ce7c-1f21-4b91-8ec4-e3f927dc3f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:18.178423 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99ce7c-1f21-4b91-8ec4-e3f927dc3f05 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:18.197625 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 813/1628] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:18 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:18.199182 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99ce7c-1f21-4b91-8ec4-e3f927dc3f05 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:18.213145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99ce7c-1f21-4b91-8ec4-e3f927dc3f05 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:18.222303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0e6b6-51dc-4394-a6f4-b6ab977e1a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:18.222303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0e6b6-51dc-4394-a6f4-b6ab977e1a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:18.222303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0e6b6-51dc-4394-a6f4-b6ab977e1a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:18.222303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0e6b6-51dc-4394-a6f4-b6ab977e1a22 admin admin] PATH_INFO: `/v3/projects/9801ac1c33cc41229344d01d8a72951a/users/7c16e4b4dc484770bc9fe9fd9914740a/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:18.234815 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45689b-5b2e-4a81-803b-fc662d976010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:18.235503 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45689b-5b2e-4a81-803b-fc662d976010 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:18.235816 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45689b-5b2e-4a81-803b-fc662d976010 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:18.236077 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45689b-5b2e-4a81-803b-fc662d976010 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:18.236826 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45689b-5b2e-4a81-803b-fc662d976010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:18.240926 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45689b-5b2e-4a81-803b-fc662d976010 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:18.243254 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0e6b6-51dc-4394-a6f4-b6ab977e1a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9801ac1c33cc41229344d01d8a72951a, user_id=7c16e4b4dc484770bc9fe9fd9914740a, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:18.247124 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0e6b6-51dc-4394-a6f4-b6ab977e1a22 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:18.275575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 816/1629] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:18 2022] GET /identity/v3/roles => generated 1427 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:18.275575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45689b-5b2e-4a81-803b-fc662d976010 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:18.280915 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:18.285856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45689b-5b2e-4a81-803b-fc662d976010 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:18.293743 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6ce45-858e-45f6-80f0-d54cd0408f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:18.293743 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6ce45-858e-45f6-80f0-d54cd0408f48 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:18.299329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6ce45-858e-45f6-80f0-d54cd0408f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:18.299721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6ce45-858e-45f6-80f0-d54cd0408f48 admin admin] PATH_INFO: `/v3/projects/e93e3e5401674b6a9a13aa4c62923719/users/2cbf5e3046b04b5a81a38414745f941d/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:18.305339 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6ce45-858e-45f6-80f0-d54cd0408f48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e93e3e5401674b6a9a13aa4c62923719, user_id=2cbf5e3046b04b5a81a38414745f941d, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:18.312911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6ce45-858e-45f6-80f0-d54cd0408f48 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:18.353477 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 817/1630] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:56:18 2022] PUT /identity/v3/projects/e93e3e5401674b6a9a13aa4c62923719/users/2cbf5e3046b04b5a81a38414745f941d/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:18.358095 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6ce45-858e-45f6-80f0-d54cd0408f48 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:18.387706 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 814/1631] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:56:18 2022] PUT /identity/v3/projects/9801ac1c33cc41229344d01d8a72951a/users/7c16e4b4dc484770bc9fe9fd9914740a/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:18.389336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9252464-ab04-4233-81d6-8782093e18d0 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:18.389812 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9252464-ab04-4233-81d6-8782093e18d0 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:18.390997 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9252464-ab04-4233-81d6-8782093e18d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:18.409039 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:18.453958 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-a9252464-ab04-4233-81d6-8782093e18d0 None None] MFA Rules not processed for user `2cbf5e3046b04b5a81a38414745f941d`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:18.455220 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-a9252464-ab04-4233-81d6-8782093e18d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:18.462656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6ce45-858e-45f6-80f0-d54cd0408f48 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:18.622259 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 815/1632] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:18.622259 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9252464-ab04-4233-81d6-8782093e18d0 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:18.649776 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87661d73-4ae3-458a-9f33-51bf698b2e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:18.652533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87661d73-4ae3-458a-9f33-51bf698b2e40 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:18.653424 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87661d73-4ae3-458a-9f33-51bf698b2e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:18.654156 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87661d73-4ae3-458a-9f33-51bf698b2e40 admin admin] PATH_INFO: `/v3/projects/97b678c5f0784d43af4e5f5a336d50c9/users/7c7bfba3ae3a470780313e0dc801252e/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:18.689257 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87661d73-4ae3-458a-9f33-51bf698b2e40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b678c5f0784d43af4e5f5a336d50c9, user_id=7c7bfba3ae3a470780313e0dc801252e, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:18.700160 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87661d73-4ae3-458a-9f33-51bf698b2e40 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:18.763360 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9252464-ab04-4233-81d6-8782093e18d0 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:18.779209 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0160d12-d1dd-4850-b614-71ddbe6e8ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:18.779600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0160d12-d1dd-4850-b614-71ddbe6e8ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:18.779887 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0160d12-d1dd-4850-b614-71ddbe6e8ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:18.780227 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0160d12-d1dd-4850-b614-71ddbe6e8ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:18.781744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0160d12-d1dd-4850-b614-71ddbe6e8ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:18.785850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0160d12-d1dd-4850-b614-71ddbe6e8ce9 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:18.807998 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 816/1633] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:18 2022] GET /identity/v3/roles => generated 1427 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:18.807998 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0160d12-d1dd-4850-b614-71ddbe6e8ce9 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:18.829891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 818/1634] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:56:18 2022] PUT /identity/v3/projects/97b678c5f0784d43af4e5f5a336d50c9/users/7c7bfba3ae3a470780313e0dc801252e/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:18.835966 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfe251-7af0-4db1-9fc4-3c2424e9c580 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:18.835966 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfe251-7af0-4db1-9fc4-3c2424e9c580 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:18.835966 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfe251-7af0-4db1-9fc4-3c2424e9c580 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:18.839885 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 819/1635] 10.222.0.119 () {54 vars in 966 bytes} [Thu Jul 14 15:56:18 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:56:18.840830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfe251-7af0-4db1-9fc4-3c2424e9c580 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:18.921904 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0160d12-d1dd-4850-b614-71ddbe6e8ce9 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:18.945197 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:18.968682 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfe251-7af0-4db1-9fc4-3c2424e9c580 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:18.975023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc4b96-4be0-4f33-b82f-f0515dd14a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:18.976034 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc4b96-4be0-4f33-b82f-f0515dd14a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:18.976419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc4b96-4be0-4f33-b82f-f0515dd14a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:18.976771 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc4b96-4be0-4f33-b82f-f0515dd14a74 admin admin] PATH_INFO: `/v3/projects/9801ac1c33cc41229344d01d8a72951a/users/7c16e4b4dc484770bc9fe9fd9914740a/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:18.980511 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc4b96-4be0-4f33-b82f-f0515dd14a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9801ac1c33cc41229344d01d8a72951a, user_id=7c16e4b4dc484770bc9fe9fd9914740a, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:18.983321 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc4b96-4be0-4f33-b82f-f0515dd14a74 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:19.005964 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 820/1636] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:56:18 2022] PUT /identity/v3/projects/9801ac1c33cc41229344d01d8a72951a/users/7c16e4b4dc484770bc9fe9fd9914740a/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:19.007056 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc4b96-4be0-4f33-b82f-f0515dd14a74 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:19.026011 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19410748-b20a-4e6a-9881-98e695effa94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:19.026694 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19410748-b20a-4e6a-9881-98e695effa94 service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:19.027363 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19410748-b20a-4e6a-9881-98e695effa94 service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:19.321806 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19410748-b20a-4e6a-9881-98e695effa94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:19.360639 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc4b96-4be0-4f33-b82f-f0515dd14a74 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:19.360639 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194d4ce-3c2a-4d8e-a8b5-4da502d42a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:19.360639 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194d4ce-3c2a-4d8e-a8b5-4da502d42a29 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:19.360639 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194d4ce-3c2a-4d8e-a8b5-4da502d42a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:19.360993 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194d4ce-3c2a-4d8e-a8b5-4da502d42a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:19.360993 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194d4ce-3c2a-4d8e-a8b5-4da502d42a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:19.360993 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194d4ce-3c2a-4d8e-a8b5-4da502d42a29 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:19.361239 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19410748-b20a-4e6a-9881-98e695effa94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:19.361239 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19410748-b20a-4e6a-9881-98e695effa94 service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:19.361239 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 817/1637] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:19.361239 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3379e-7872-4e36-a8aa-5ebf1b3c8692 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:19.361239 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3379e-7872-4e36-a8aa-5ebf1b3c8692 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:19.361239 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3379e-7872-4e36-a8aa-5ebf1b3c8692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:19.361528 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 821/1638] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:19 2022] GET /identity/v3/roles => generated 1427 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:19.361528 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa101a10-c577-4986-93fd-31969c460c8b None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:19.361528 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa101a10-c577-4986-93fd-31969c460c8b None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:19.361528 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa101a10-c577-4986-93fd-31969c460c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:19.361778 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-e9e3379e-7872-4e36-a8aa-5ebf1b3c8692 None None] MFA Rules not processed for user `a1e4c833a4684561ab52eda5734a7766`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:19.361778 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-e9e3379e-7872-4e36-a8aa-5ebf1b3c8692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:19.361929 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-aa101a10-c577-4986-93fd-31969c460c8b None None] MFA Rules not processed for user `7c16e4b4dc484770bc9fe9fd9914740a`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:19.361929 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-aa101a10-c577-4986-93fd-31969c460c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:19.434523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 818/1639] 10.222.0.119 () {58 vars in 1063 bytes} [Thu Jul 14 15:56:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:19.436525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3379e-7872-4e36-a8aa-5ebf1b3c8692 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:19.450723 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3379e-7872-4e36-a8aa-5ebf1b3c8692 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:19.455653 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f245914-701c-4e60-a48a-d3aba49e0215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:19.457188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f245914-701c-4e60-a48a-d3aba49e0215 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:19.457480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f245914-701c-4e60-a48a-d3aba49e0215 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:19.457766 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f245914-701c-4e60-a48a-d3aba49e0215 admin admin] PATH_INFO: `/v3/projects/97b678c5f0784d43af4e5f5a336d50c9/users/7c7bfba3ae3a470780313e0dc801252e/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:19.460026 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f245914-701c-4e60-a48a-d3aba49e0215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b678c5f0784d43af4e5f5a336d50c9, user_id=7c7bfba3ae3a470780313e0dc801252e, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:19.462778 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f245914-701c-4e60-a48a-d3aba49e0215 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:19.463871 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 822/1640] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:19.467206 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a2d28-4165-41d9-8828-c4d6bf0c95b8 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:19.468310 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a2d28-4165-41d9-8828-c4d6bf0c95b8 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:19.468582 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a2d28-4165-41d9-8828-c4d6bf0c95b8 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:19.469950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 823/1641] 10.222.0.119 () {54 vars in 917 bytes} [Thu Jul 14 15:56:19 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:56:19.476481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fc5b1-d692-487c-93ef-d0b0cf3a7966 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:19.476821 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fc5b1-d692-487c-93ef-d0b0cf3a7966 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:19.477157 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fc5b1-d692-487c-93ef-d0b0cf3a7966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:19.483812 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 819/1642] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:56:19 2022] PUT /identity/v3/projects/97b678c5f0784d43af4e5f5a336d50c9/users/7c7bfba3ae3a470780313e0dc801252e/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:19.483812 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f245914-701c-4e60-a48a-d3aba49e0215 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:19.500702 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-7e5fc5b1-d692-487c-93ef-d0b0cf3a7966 None None] MFA Rules not processed for user `a1e4c833a4684561ab52eda5734a7766`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:19.502161 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-7e5fc5b1-d692-487c-93ef-d0b0cf3a7966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:19.565004 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f245914-701c-4e60-a48a-d3aba49e0215 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:19.570209 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661297be-727c-4382-a36b-f531daaa4dac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:19.571025 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661297be-727c-4382-a36b-f531daaa4dac service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:19.571378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661297be-727c-4382-a36b-f531daaa4dac service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:19.571604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661297be-727c-4382-a36b-f531daaa4dac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:19.583031 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 824/1643] 10.222.0.119 () {58 vars in 1014 bytes} [Thu Jul 14 15:56:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:19.585313 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5f947-e79f-4a8b-8a0a-4ecc2106b128 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:19.585841 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5f947-e79f-4a8b-8a0a-4ecc2106b128 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:19.586329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5f947-e79f-4a8b-8a0a-4ecc2106b128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:19.648987 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-8fc5f947-e79f-4a8b-8a0a-4ecc2106b128 None None] MFA Rules not processed for user `7c7bfba3ae3a470780313e0dc801252e`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:19.648987 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-8fc5f947-e79f-4a8b-8a0a-4ecc2106b128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:19.711890 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661297be-727c-4382-a36b-f531daaa4dac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:19.714034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661297be-727c-4382-a36b-f531daaa4dac service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:19.728854 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 825/1644] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:19 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:19.729974 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5f947-e79f-4a8b-8a0a-4ecc2106b128 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:19.734515 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 820/1645] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:19 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:19.752690 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5f947-e79f-4a8b-8a0a-4ecc2106b128 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:19.759038 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352be43-83ec-40b6-8651-6c6b3f86569e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:19.760398 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352be43-83ec-40b6-8651-6c6b3f86569e service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:19.760797 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352be43-83ec-40b6-8651-6c6b3f86569e service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:19.761180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352be43-83ec-40b6-8651-6c6b3f86569e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:19.781067 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352be43-83ec-40b6-8651-6c6b3f86569e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:19.782696 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352be43-83ec-40b6-8651-6c6b3f86569e service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:19.790530 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:19.803856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 826/1646] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:19.956313 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661297be-727c-4382-a36b-f531daaa4dac service cinder] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:19.974464 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661297be-727c-4382-a36b-f531daaa4dac service cinder] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:19.988051 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b256045-c1b0-4662-9027-eb39ff2ac50b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:19.988760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b256045-c1b0-4662-9027-eb39ff2ac50b service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:19.989056 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b256045-c1b0-4662-9027-eb39ff2ac50b service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:19.989355 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b256045-c1b0-4662-9027-eb39ff2ac50b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:20.022082 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b256045-c1b0-4662-9027-eb39ff2ac50b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:20.026559 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b256045-c1b0-4662-9027-eb39ff2ac50b service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:20.043417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ad4fb-ce35-431c-a0a0-32b9443eddbe None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:20.043898 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ad4fb-ce35-431c-a0a0-32b9443eddbe None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:20.044299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ad4fb-ce35-431c-a0a0-32b9443eddbe None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:20.046724 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 827/1647] 10.222.0.119 () {54 vars in 917 bytes} [Thu Jul 14 15:56:20 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:56:20.048419 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 821/1648] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:19 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:20.090911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d01806-e7ca-4867-8869-3a55b26fa8f1 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:20.090911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d01806-e7ca-4867-8869-3a55b26fa8f1 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:20.090911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d01806-e7ca-4867-8869-3a55b26fa8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:20.112992 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-10d01806-e7ca-4867-8869-3a55b26fa8f1 None None] MFA Rules not processed for user `a1e4c833a4684561ab52eda5734a7766`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:20.118792 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-10d01806-e7ca-4867-8869-3a55b26fa8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:20.134416 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 828/1649] 10.222.0.119 () {58 vars in 1014 bytes} [Thu Jul 14 15:56:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:20.389337 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b256045-c1b0-4662-9027-eb39ff2ac50b service cinder] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:20.401524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b256045-c1b0-4662-9027-eb39ff2ac50b service cinder] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:20.406551 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f03a13-6a63-449d-af99-84f5b1d64f6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:20.407333 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f03a13-6a63-449d-af99-84f5b1d64f6d service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:20.407748 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f03a13-6a63-449d-af99-84f5b1d64f6d service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:20.408149 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f03a13-6a63-449d-af99-84f5b1d64f6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:20.422664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f03a13-6a63-449d-af99-84f5b1d64f6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:20.425375 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f03a13-6a63-449d-af99-84f5b1d64f6d service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:20.462720 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 822/1650] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:20.590580 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d01806-e7ca-4867-8869-3a55b26fa8f1 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:20.604438 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d01806-e7ca-4867-8869-3a55b26fa8f1 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:20.611621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14893c19-b944-4eeb-911e-c115e2a918bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:20.613079 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14893c19-b944-4eeb-911e-c115e2a918bd service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:20.613569 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14893c19-b944-4eeb-911e-c115e2a918bd service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:20.613981 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14893c19-b944-4eeb-911e-c115e2a918bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:20.708541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14893c19-b944-4eeb-911e-c115e2a918bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:20.711105 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14893c19-b944-4eeb-911e-c115e2a918bd service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:20.746039 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 829/1651] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:20.846168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:20.951734 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f03a13-6a63-449d-af99-84f5b1d64f6d service cinder] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:21.110664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f03a13-6a63-449d-af99-84f5b1d64f6d service cinder] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:21.118081 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83acbf-141a-49ef-ac82-3ab8020032b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:21.120026 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83acbf-141a-49ef-ac82-3ab8020032b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:21.120517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83acbf-141a-49ef-ac82-3ab8020032b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:21.121117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83acbf-141a-49ef-ac82-3ab8020032b3 admin admin] PATH_INFO: `/v3/users/83bab4a7051c4c5a9f85e45af977e6f9` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:21.122575 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83acbf-141a-49ef-ac82-3ab8020032b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83bab4a7051c4c5a9f85e45af977e6f9)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:21.123939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: WARNING py.warnings [None req-9c83acbf-141a-49ef-ac82-3ab8020032b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:56:21.123939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: warnings.warn(msg) Jul 14 15:56:21.123939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: Jul 14 15:56:21.125500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83acbf-141a-49ef-ac82-3ab8020032b3 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:21.193086 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14893c19-b944-4eeb-911e-c115e2a918bd service cinder] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:21.293742 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:21.357468 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14893c19-b944-4eeb-911e-c115e2a918bd service cinder] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:21.365841 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecea2de-83f4-44ff-a2f5-55d5cad08287 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cbf5e3046b04b5a81a38414745f941d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e93e3e5401674b6a9a13aa4c62923719', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:21.366809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecea2de-83f4-44ff-a2f5-55d5cad08287 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:21.367367 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecea2de-83f4-44ff-a2f5-55d5cad08287 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:21.372831 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecea2de-83f4-44ff-a2f5-55d5cad08287 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:21.373860 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecea2de-83f4-44ff-a2f5-55d5cad08287 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:56:21.374352 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecea2de-83f4-44ff-a2f5-55d5cad08287 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:21.376528 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecea2de-83f4-44ff-a2f5-55d5cad08287 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:21.433825 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 830/1652] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:56:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:56:21.433825 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecea2de-83f4-44ff-a2f5-55d5cad08287 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:21.469170 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecea2de-83f4-44ff-a2f5-55d5cad08287 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:21.475496 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a6238-e153-4ef5-bae9-20d26af3ecf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:21.479731 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a6238-e153-4ef5-bae9-20d26af3ecf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:21.481240 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a6238-e153-4ef5-bae9-20d26af3ecf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:21.483712 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a6238-e153-4ef5-bae9-20d26af3ecf4 admin admin] PATH_INFO: `/v3/users/196d2c2f3560489d924e726e8c7b62dc` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:21.485564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a6238-e153-4ef5-bae9-20d26af3ecf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=196d2c2f3560489d924e726e8c7b62dc)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:21.489718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a6238-e153-4ef5-bae9-20d26af3ecf4 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:21.505639 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-9c83acbf-141a-49ef-ac82-3ab8020032b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83bab4a7051c4c5a9f85e45af977e6f9'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:21.564984 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-9c83acbf-141a-49ef-ac82-3ab8020032b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83bab4a7051c4c5a9f85e45af977e6f9'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:21.588379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-9c83acbf-141a-49ef-ac82-3ab8020032b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83bab4a7051c4c5a9f85e45af977e6f9'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:21.589280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-9c83acbf-141a-49ef-ac82-3ab8020032b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83bab4a7051c4c5a9f85e45af977e6f9'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:21.655470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-9c83acbf-141a-49ef-ac82-3ab8020032b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83bab4a7051c4c5a9f85e45af977e6f9'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:21.665785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 823/1653] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:56:20 2022] DELETE /identity/v3/users/83bab4a7051c4c5a9f85e45af977e6f9 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:21.666763 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83acbf-141a-49ef-ac82-3ab8020032b3 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:21.668241 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-9c83acbf-141a-49ef-ac82-3ab8020032b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:21.722321 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-631a6238-e153-4ef5-bae9-20d26af3ecf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '196d2c2f3560489d924e726e8c7b62dc'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:21.726796 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-631a6238-e153-4ef5-bae9-20d26af3ecf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '196d2c2f3560489d924e726e8c7b62dc'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:21.775160 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-631a6238-e153-4ef5-bae9-20d26af3ecf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '196d2c2f3560489d924e726e8c7b62dc'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:21.792807 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83acbf-141a-49ef-ac82-3ab8020032b3 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:21.793745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-631a6238-e153-4ef5-bae9-20d26af3ecf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '196d2c2f3560489d924e726e8c7b62dc'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:21.794897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-631a6238-e153-4ef5-bae9-20d26af3ecf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '196d2c2f3560489d924e726e8c7b62dc'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:21.798923 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bb89d-ca8f-4586-8390-d23c1cc914f5 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cbf5e3046b04b5a81a38414745f941d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e93e3e5401674b6a9a13aa4c62923719', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:21.799794 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bb89d-ca8f-4586-8390-d23c1cc914f5 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:21.801142 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bb89d-ca8f-4586-8390-d23c1cc914f5 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:21.801602 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bb89d-ca8f-4586-8390-d23c1cc914f5 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:21.804179 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bb89d-ca8f-4586-8390-d23c1cc914f5 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:21.806355 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bb89d-ca8f-4586-8390-d23c1cc914f5 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:21.999388 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 831/1654] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:56:21 2022] DELETE /identity/v3/users/196d2c2f3560489d924e726e8c7b62dc => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:21.999388 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304130a-df25-47b4-9e13-ea0e85d10dca None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:21.999388 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304130a-df25-47b4-9e13-ea0e85d10dca None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:22.000637 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304130a-df25-47b4-9e13-ea0e85d10dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:22.016917 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 824/1655] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:56:21 2022] POST /identity/v3/projects => generated 356 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:22.022738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affd2cf-fedb-46fc-911a-a9a31653a09c None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:22.023391 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affd2cf-fedb-46fc-911a-a9a31653a09c None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:22.029632 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affd2cf-fedb-46fc-911a-a9a31653a09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:22.067202 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-d304130a-df25-47b4-9e13-ea0e85d10dca None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:22.070306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-3affd2cf-fedb-46fc-911a-a9a31653a09c None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:22.071766 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-3affd2cf-fedb-46fc-911a-a9a31653a09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:22.071969 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-d304130a-df25-47b4-9e13-ea0e85d10dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:22.230279 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 825/1656] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:22.231221 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3affd2cf-fedb-46fc-911a-a9a31653a09c None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:22.233120 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-3affd2cf-fedb-46fc-911a-a9a31653a09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:22.258624 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 832/1657] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:22.291438 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304130a-df25-47b4-9e13-ea0e85d10dca None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:22.292902 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-d304130a-df25-47b4-9e13-ea0e85d10dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:22.306188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:22.389047 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3affd2cf-fedb-46fc-911a-a9a31653a09c None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:22.400016 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3772e01-b372-4ef1-8cac-0ca6ec1d9321 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cbf5e3046b04b5a81a38414745f941d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e93e3e5401674b6a9a13aa4c62923719', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:22.400812 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3772e01-b372-4ef1-8cac-0ca6ec1d9321 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:22.401108 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3772e01-b372-4ef1-8cac-0ca6ec1d9321 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:22.402936 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3772e01-b372-4ef1-8cac-0ca6ec1d9321 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:22.403826 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3772e01-b372-4ef1-8cac-0ca6ec1d9321 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:56:22.404061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3772e01-b372-4ef1-8cac-0ca6ec1d9321 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:22.407270 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3772e01-b372-4ef1-8cac-0ca6ec1d9321 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:22.422572 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 826/1658] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:56:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:56:22.423471 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3772e01-b372-4ef1-8cac-0ca6ec1d9321 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:22.429035 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-a3772e01-b372-4ef1-8cac-0ca6ec1d9321 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:22.460194 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304130a-df25-47b4-9e13-ea0e85d10dca None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:22.471092 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82868823-69de-406b-beeb-1c01d15ac3c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:22.472161 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82868823-69de-406b-beeb-1c01d15ac3c1 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:22.473046 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82868823-69de-406b-beeb-1c01d15ac3c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:22.474819 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82868823-69de-406b-beeb-1c01d15ac3c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:22.514915 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82868823-69de-406b-beeb-1c01d15ac3c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:22.529515 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82868823-69de-406b-beeb-1c01d15ac3c1 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:22.551789 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3772e01-b372-4ef1-8cac-0ca6ec1d9321 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:22.561827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e8fdd-0f50-4a8e-a12a-368cf661844b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:22.562651 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e8fdd-0f50-4a8e-a12a-368cf661844b service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:22.563059 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e8fdd-0f50-4a8e-a12a-368cf661844b service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:22.563428 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e8fdd-0f50-4a8e-a12a-368cf661844b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:22.565938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 833/1659] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:56:22.567106 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82868823-69de-406b-beeb-1c01d15ac3c1 service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:22.592503 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82868823-69de-406b-beeb-1c01d15ac3c1 service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:22.593971 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e8fdd-0f50-4a8e-a12a-368cf661844b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:22.595172 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e8fdd-0f50-4a8e-a12a-368cf661844b service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:22.603748 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503a478-b00f-403a-b28e-3e63d6a76262 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cbf5e3046b04b5a81a38414745f941d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e93e3e5401674b6a9a13aa4c62923719', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:22.605042 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503a478-b00f-403a-b28e-3e63d6a76262 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:22.605504 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503a478-b00f-403a-b28e-3e63d6a76262 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:22.606298 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503a478-b00f-403a-b28e-3e63d6a76262 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] PATH_INFO: `/v3/projects/0ea8d4d6b4c04214b21e1ffb8d6bd1f8` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:22.607590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 827/1660] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:22.608057 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503a478-b00f-403a-b28e-3e63d6a76262 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0ea8d4d6b4c04214b21e1ffb8d6bd1f8)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:22.609294 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: WARNING py.warnings [None req-9503a478-b00f-403a-b28e-3e63d6a76262 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:56:22.609294 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: warnings.warn(msg) Jul 14 15:56:22.609294 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: Jul 14 15:56:22.610695 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503a478-b00f-403a-b28e-3e63d6a76262 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:22.622302 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:22.891846 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9503a478-b00f-403a-b28e-3e63d6a76262 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ea8d4d6b4c04214b21e1ffb8d6bd1f8', 'request_id': 'req-9503a478-b00f-403a-b28e-3e63d6a76262'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:22.921372 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9503a478-b00f-403a-b28e-3e63d6a76262 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ea8d4d6b4c04214b21e1ffb8d6bd1f8', 'request_id': 'req-9503a478-b00f-403a-b28e-3e63d6a76262'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:22.938831 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9503a478-b00f-403a-b28e-3e63d6a76262 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ea8d4d6b4c04214b21e1ffb8d6bd1f8', 'request_id': 'req-9503a478-b00f-403a-b28e-3e63d6a76262'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:23.042702 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9503a478-b00f-403a-b28e-3e63d6a76262 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] The token cache is being invalidate because project 0ea8d4d6b4c04214b21e1ffb8d6bd1f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:56:23.043008 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9503a478-b00f-403a-b28e-3e63d6a76262 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:23.044275 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9503a478-b00f-403a-b28e-3e63d6a76262 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:23.052864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 834/1661] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:56:22 2022] DELETE /identity/v3/projects/0ea8d4d6b4c04214b21e1ffb8d6bd1f8 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:23.276496 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:23.788017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:24.301322 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e8fdd-0f50-4a8e-a12a-368cf661844b service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:24.303189 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-6d8e8fdd-0f50-4a8e-a12a-368cf661844b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:24.325651 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e8fdd-0f50-4a8e-a12a-368cf661844b service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:24.442540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e2ec4-8ac1-48ba-9513-45771dfeb0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:24.445974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e2ec4-8ac1-48ba-9513-45771dfeb0b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:24.447822 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e2ec4-8ac1-48ba-9513-45771dfeb0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:24.447822 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e2ec4-8ac1-48ba-9513-45771dfeb0b3 admin admin] PATH_INFO: `/v3/users/cee59e48e13848e0bd4d0679227c7a7f` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:24.448684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e2ec4-8ac1-48ba-9513-45771dfeb0b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cee59e48e13848e0bd4d0679227c7a7f)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:24.452682 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e2ec4-8ac1-48ba-9513-45771dfeb0b3 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:24.626758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503a478-b00f-403a-b28e-3e63d6a76262 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:24.628386 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-9503a478-b00f-403a-b28e-3e63d6a76262 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:24.652997 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503a478-b00f-403a-b28e-3e63d6a76262 tempest-VolumeQuotaClassesTest-1582237257 tempest-VolumeQuotaClassesTest-1582237257-project-admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:24.667665 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f7433-b914-4763-8c32-f880a2bf1d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:24.668595 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f7433-b914-4763-8c32-f880a2bf1d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:24.668921 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f7433-b914-4763-8c32-f880a2bf1d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:24.671505 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f7433-b914-4763-8c32-f880a2bf1d3a admin admin] PATH_INFO: `/v3/projects/7335838eb58d4485a4cb7676cca8ebf5` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:24.674579 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f7433-b914-4763-8c32-f880a2bf1d3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7335838eb58d4485a4cb7676cca8ebf5)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:24.679457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f7433-b914-4763-8c32-f880a2bf1d3a admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:24.782238 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c80e2ec4-8ac1-48ba-9513-45771dfeb0b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cee59e48e13848e0bd4d0679227c7a7f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:24.828765 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c80e2ec4-8ac1-48ba-9513-45771dfeb0b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cee59e48e13848e0bd4d0679227c7a7f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:24.849987 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c80e2ec4-8ac1-48ba-9513-45771dfeb0b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cee59e48e13848e0bd4d0679227c7a7f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:24.852894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c80e2ec4-8ac1-48ba-9513-45771dfeb0b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cee59e48e13848e0bd4d0679227c7a7f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:24.913690 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-037f7433-b914-4763-8c32-f880a2bf1d3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7335838eb58d4485a4cb7676cca8ebf5', 'request_id': 'req-037f7433-b914-4763-8c32-f880a2bf1d3a'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:24.933000 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-037f7433-b914-4763-8c32-f880a2bf1d3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7335838eb58d4485a4cb7676cca8ebf5', 'request_id': 'req-037f7433-b914-4763-8c32-f880a2bf1d3a'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:24.948268 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-037f7433-b914-4763-8c32-f880a2bf1d3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7335838eb58d4485a4cb7676cca8ebf5', 'request_id': 'req-037f7433-b914-4763-8c32-f880a2bf1d3a'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:25.000893 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c80e2ec4-8ac1-48ba-9513-45771dfeb0b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cee59e48e13848e0bd4d0679227c7a7f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:25.012468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 828/1662] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:56:24 2022] DELETE /identity/v3/users/cee59e48e13848e0bd4d0679227c7a7f => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:25.016707 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e2ec4-8ac1-48ba-9513-45771dfeb0b3 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:25.019659 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-c80e2ec4-8ac1-48ba-9513-45771dfeb0b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:25.089861 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-037f7433-b914-4763-8c32-f880a2bf1d3a admin admin] The token cache is being invalidate because project 7335838eb58d4485a4cb7676cca8ebf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:56:25.090224 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-037f7433-b914-4763-8c32-f880a2bf1d3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:25.096036 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-037f7433-b914-4763-8c32-f880a2bf1d3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:25.096036 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 835/1663] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:56:24 2022] DELETE /identity/v3/projects/7335838eb58d4485a4cb7676cca8ebf5 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:56:25.101350 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24962a2-8494-4029-9610-b129b6292d6e None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:25.101694 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24962a2-8494-4029-9610-b129b6292d6e None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:25.104736 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24962a2-8494-4029-9610-b129b6292d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:25.161225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-d24962a2-8494-4029-9610-b129b6292d6e None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:25.163257 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-d24962a2-8494-4029-9610-b129b6292d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:25.175458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 836/1664] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:25.178232 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cab103-b805-4576-9deb-4cd393edc77e None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:25.185908 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e2ec4-8ac1-48ba-9513-45771dfeb0b3 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:25.186232 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cab103-b805-4576-9deb-4cd393edc77e None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:25.186232 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cab103-b805-4576-9deb-4cd393edc77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:25.193302 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37e4d3-114b-41d4-a157-39d6a388e5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:25.194376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37e4d3-114b-41d4-a157-39d6a388e5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:25.194661 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37e4d3-114b-41d4-a157-39d6a388e5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:25.194957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37e4d3-114b-41d4-a157-39d6a388e5a6 admin admin] PATH_INFO: `/v3/projects/adf05bdcafef43ec985634723e839b0f` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:25.196282 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37e4d3-114b-41d4-a157-39d6a388e5a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adf05bdcafef43ec985634723e839b0f)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:25.198990 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37e4d3-114b-41d4-a157-39d6a388e5a6 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:25.205123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-66cab103-b805-4576-9deb-4cd393edc77e None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:25.206913 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-66cab103-b805-4576-9deb-4cd393edc77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:25.216772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 837/1665] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:25.217546 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cab103-b805-4576-9deb-4cd393edc77e None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:25.219092 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-66cab103-b805-4576-9deb-4cd393edc77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:25.294631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cab103-b805-4576-9deb-4cd393edc77e None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:25.301101 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596b822-f76e-463b-9b4c-956b95a6bc81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:25.324580 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596b822-f76e-463b-9b4c-956b95a6bc81 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:25.330980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596b822-f76e-463b-9b4c-956b95a6bc81 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:25.332795 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596b822-f76e-463b-9b4c-956b95a6bc81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:25.375158 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596b822-f76e-463b-9b4c-956b95a6bc81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:25.377348 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596b822-f76e-463b-9b4c-956b95a6bc81 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:25.387387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-2f37e4d3-114b-41d4-a157-39d6a388e5a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adf05bdcafef43ec985634723e839b0f', 'request_id': 'req-2f37e4d3-114b-41d4-a157-39d6a388e5a6'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:25.409401 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-2f37e4d3-114b-41d4-a157-39d6a388e5a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adf05bdcafef43ec985634723e839b0f', 'request_id': 'req-2f37e4d3-114b-41d4-a157-39d6a388e5a6'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:25.410366 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 838/1666] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:25.418350 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f26f1-6634-421a-8027-3edbff2450a5 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:25.419806 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f26f1-6634-421a-8027-3edbff2450a5 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:25.420137 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f26f1-6634-421a-8027-3edbff2450a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:25.488816 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-871f26f1-6634-421a-8027-3edbff2450a5 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:25.494984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-871f26f1-6634-421a-8027-3edbff2450a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:25.522341 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-2f37e4d3-114b-41d4-a157-39d6a388e5a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adf05bdcafef43ec985634723e839b0f', 'request_id': 'req-2f37e4d3-114b-41d4-a157-39d6a388e5a6'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:25.558125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-2f37e4d3-114b-41d4-a157-39d6a388e5a6 admin admin] The token cache is being invalidate because project adf05bdcafef43ec985634723e839b0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:56:25.558421 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-2f37e4d3-114b-41d4-a157-39d6a388e5a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:25.572067 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-2f37e4d3-114b-41d4-a157-39d6a388e5a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:25.578812 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 829/1667] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:56:25 2022] DELETE /identity/v3/projects/adf05bdcafef43ec985634723e839b0f => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:25.580065 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37e4d3-114b-41d4-a157-39d6a388e5a6 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:25.585734 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-2f37e4d3-114b-41d4-a157-39d6a388e5a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:25.618818 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 839/1668] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:25.622647 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f26f1-6634-421a-8027-3edbff2450a5 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:25.639001 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f26f1-6634-421a-8027-3edbff2450a5 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:25.657159 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b846d4f-6c56-4996-83fc-c37fbf4fa3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:25.658144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b846d4f-6c56-4996-83fc-c37fbf4fa3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:25.658598 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b846d4f-6c56-4996-83fc-c37fbf4fa3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:25.659026 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b846d4f-6c56-4996-83fc-c37fbf4fa3a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:25.659929 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b846d4f-6c56-4996-83fc-c37fbf4fa3a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:56:25.660450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b846d4f-6c56-4996-83fc-c37fbf4fa3a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:25.662818 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b846d4f-6c56-4996-83fc-c37fbf4fa3a6 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:25.704487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 840/1669] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:56:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:56:25.705302 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b846d4f-6c56-4996-83fc-c37fbf4fa3a6 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:25.722324 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:25.736541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b846d4f-6c56-4996-83fc-c37fbf4fa3a6 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:25.744552 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcf3bd-8f31-46d8-bb05-ef63fb1edd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:25.747034 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcf3bd-8f31-46d8-bb05-ef63fb1edd94 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:25.747327 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcf3bd-8f31-46d8-bb05-ef63fb1edd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:25.747612 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcf3bd-8f31-46d8-bb05-ef63fb1edd94 admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:25.748355 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbcf3bd-8f31-46d8-bb05-ef63fb1edd94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:25.752170 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbcf3bd-8f31-46d8-bb05-ef63fb1edd94 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:25.770874 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37e4d3-114b-41d4-a157-39d6a388e5a6 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:25.783512 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18ce96-d108-4ae2-9c30-1350958128c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:25.783512 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18ce96-d108-4ae2-9c30-1350958128c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:25.783512 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18ce96-d108-4ae2-9c30-1350958128c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:25.783512 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18ce96-d108-4ae2-9c30-1350958128c0 admin admin] PATH_INFO: `/v3/users/7c7bfba3ae3a470780313e0dc801252e` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:25.784610 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18ce96-d108-4ae2-9c30-1350958128c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c7bfba3ae3a470780313e0dc801252e)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:25.792005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18ce96-d108-4ae2-9c30-1350958128c0 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:25.903115 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 841/1670] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:56:25 2022] POST /identity/v3/projects => generated 374 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:25.904244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcf3bd-8f31-46d8-bb05-ef63fb1edd94 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:25.909572 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-cbbcf3bd-8f31-46d8-bb05-ef63fb1edd94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:26.002956 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcf3bd-8f31-46d8-bb05-ef63fb1edd94 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:26.009800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc65ca1-7185-464b-915d-77a06c2bee62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:26.012429 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc65ca1-7185-464b-915d-77a06c2bee62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:26.012722 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc65ca1-7185-464b-915d-77a06c2bee62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:26.013087 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc65ca1-7185-464b-915d-77a06c2bee62 admin admin] PATH_INFO: `/v3/users/5c41302493844c599fc3d9f8ea9e86c5` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:26.016364 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc65ca1-7185-464b-915d-77a06c2bee62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c41302493844c599fc3d9f8ea9e86c5)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:26.024457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc65ca1-7185-464b-915d-77a06c2bee62 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:26.096203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-8d18ce96-d108-4ae2-9c30-1350958128c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c7bfba3ae3a470780313e0dc801252e'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:26.122852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-8d18ce96-d108-4ae2-9c30-1350958128c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c7bfba3ae3a470780313e0dc801252e'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:26.161286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-8d18ce96-d108-4ae2-9c30-1350958128c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c7bfba3ae3a470780313e0dc801252e'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:26.163652 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-8d18ce96-d108-4ae2-9c30-1350958128c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c7bfba3ae3a470780313e0dc801252e'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:26.282092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-8d18ce96-d108-4ae2-9c30-1350958128c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c7bfba3ae3a470780313e0dc801252e'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:26.286548 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-4dc65ca1-7185-464b-915d-77a06c2bee62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c41302493844c599fc3d9f8ea9e86c5'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:26.288003 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-4dc65ca1-7185-464b-915d-77a06c2bee62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c41302493844c599fc3d9f8ea9e86c5'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:26.297112 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 830/1671] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:56:25 2022] DELETE /identity/v3/users/7c7bfba3ae3a470780313e0dc801252e => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:26.298277 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18ce96-d108-4ae2-9c30-1350958128c0 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:26.299911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-8d18ce96-d108-4ae2-9c30-1350958128c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:26.323396 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-4dc65ca1-7185-464b-915d-77a06c2bee62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c41302493844c599fc3d9f8ea9e86c5'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:26.344019 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-4dc65ca1-7185-464b-915d-77a06c2bee62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c41302493844c599fc3d9f8ea9e86c5'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:26.345851 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-4dc65ca1-7185-464b-915d-77a06c2bee62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c41302493844c599fc3d9f8ea9e86c5'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:26.411133 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18ce96-d108-4ae2-9c30-1350958128c0 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:26.432289 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e14b80-cab5-4ca8-99a1-ed37381a8537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:26.434054 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e14b80-cab5-4ca8-99a1-ed37381a8537 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:26.434054 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e14b80-cab5-4ca8-99a1-ed37381a8537 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:26.436959 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e14b80-cab5-4ca8-99a1-ed37381a8537 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:26.438075 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e14b80-cab5-4ca8-99a1-ed37381a8537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:26.441084 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e14b80-cab5-4ca8-99a1-ed37381a8537 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:26.466787 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 842/1672] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:56:25 2022] DELETE /identity/v3/users/5c41302493844c599fc3d9f8ea9e86c5 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:26.472146 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b9fbf-c7fb-4533-a818-ebbeb9e386d3 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:26.472521 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b9fbf-c7fb-4533-a818-ebbeb9e386d3 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:26.473045 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b9fbf-c7fb-4533-a818-ebbeb9e386d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:26.517608 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-9f4b9fbf-c7fb-4533-a818-ebbeb9e386d3 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:26.526641 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-9f4b9fbf-c7fb-4533-a818-ebbeb9e386d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:26.542271 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 831/1673] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:56:26 2022] POST /identity/v3/users => generated 288 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:26.545217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e14b80-cab5-4ca8-99a1-ed37381a8537 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:26.562076 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-07e14b80-cab5-4ca8-99a1-ed37381a8537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:26.590626 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e14b80-cab5-4ca8-99a1-ed37381a8537 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:26.613968 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:26.754348 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf7e0f-d1d8-49b4-b8d1-73b5b785d3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:26.754348 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf7e0f-d1d8-49b4-b8d1-73b5b785d3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:26.754348 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf7e0f-d1d8-49b4-b8d1-73b5b785d3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:26.754592 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf7e0f-d1d8-49b4-b8d1-73b5b785d3d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:26.756300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf7e0f-d1d8-49b4-b8d1-73b5b785d3d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:26.763482 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf7e0f-d1d8-49b4-b8d1-73b5b785d3d5 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:26.793207 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 832/1674] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:26 2022] GET /identity/v3/roles => generated 1427 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:26.793207 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf7e0f-d1d8-49b4-b8d1-73b5b785d3d5 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:26.811809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 843/1675] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:26.837555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b9fbf-c7fb-4533-a818-ebbeb9e386d3 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:26.839055 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-9f4b9fbf-c7fb-4533-a818-ebbeb9e386d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:26.852594 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf7e0f-d1d8-49b4-b8d1-73b5b785d3d5 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:26.872839 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bff404-e57e-4c28-850f-2b1fac114a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:26.873659 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bff404-e57e-4c28-850f-2b1fac114a9e admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:26.873949 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bff404-e57e-4c28-850f-2b1fac114a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:26.874219 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bff404-e57e-4c28-850f-2b1fac114a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:26.876803 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bff404-e57e-4c28-850f-2b1fac114a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:26.879353 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bff404-e57e-4c28-850f-2b1fac114a9e admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:26.934596 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 833/1676] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:26 2022] GET /identity/v3/roles => generated 1427 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:26.946644 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bff404-e57e-4c28-850f-2b1fac114a9e admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:26.974562 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bff404-e57e-4c28-850f-2b1fac114a9e admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:26.998081 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179b449-ca9d-40a3-ad4d-e49acecb9d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:26.999379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179b449-ca9d-40a3-ad4d-e49acecb9d7c admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:26.999663 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179b449-ca9d-40a3-ad4d-e49acecb9d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:26.999938 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179b449-ca9d-40a3-ad4d-e49acecb9d7c admin admin] PATH_INFO: `/v3/projects/64dd9277c418451d9318a595d7f23970/users/f2ccc50dbc904e679d7de3bc9f211e16/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:27.037836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b9fbf-c7fb-4533-a818-ebbeb9e386d3 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:27.058103 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dfcf4-eb34-4a3c-a5c5-863aa8051bb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:27.059992 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dfcf4-eb34-4a3c-a5c5-863aa8051bb6 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:27.060846 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179b449-ca9d-40a3-ad4d-e49acecb9d7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=64dd9277c418451d9318a595d7f23970, user_id=f2ccc50dbc904e679d7de3bc9f211e16, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:27.063524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179b449-ca9d-40a3-ad4d-e49acecb9d7c admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:27.069632 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dfcf4-eb34-4a3c-a5c5-863aa8051bb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:27.069922 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dfcf4-eb34-4a3c-a5c5-863aa8051bb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:27.109653 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dfcf4-eb34-4a3c-a5c5-863aa8051bb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:27.111385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dfcf4-eb34-4a3c-a5c5-863aa8051bb6 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:27.140220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 844/1677] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:27.185173 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 834/1678] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:56:26 2022] PUT /identity/v3/projects/64dd9277c418451d9318a595d7f23970/users/f2ccc50dbc904e679d7de3bc9f211e16/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:27.196569 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce2b06-1979-4ece-aeb7-8e6eb9f4ddaf None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:27.196865 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce2b06-1979-4ece-aeb7-8e6eb9f4ddaf None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:27.197642 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce2b06-1979-4ece-aeb7-8e6eb9f4ddaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:27.253338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-0cce2b06-1979-4ece-aeb7-8e6eb9f4ddaf None None] MFA Rules not processed for user `f2ccc50dbc904e679d7de3bc9f211e16`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:27.254577 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-0cce2b06-1979-4ece-aeb7-8e6eb9f4ddaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:27.413149 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 845/1679] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:27.422343 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179b449-ca9d-40a3-ad4d-e49acecb9d7c admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:27.579185 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179b449-ca9d-40a3-ad4d-e49acecb9d7c admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:27.585992 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb94487-afa7-44a4-a4fa-3b29cf4338af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:27.586995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb94487-afa7-44a4-a4fa-3b29cf4338af admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:27.586995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb94487-afa7-44a4-a4fa-3b29cf4338af admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:27.587221 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb94487-afa7-44a4-a4fa-3b29cf4338af admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:27.588070 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb94487-afa7-44a4-a4fa-3b29cf4338af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:27.590192 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb94487-afa7-44a4-a4fa-3b29cf4338af admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:27.714229 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 835/1680] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:56:27 2022] POST /identity/v3/projects => generated 372 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:27.715079 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce2b06-1979-4ece-aeb7-8e6eb9f4ddaf None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:27.730145 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce2b06-1979-4ece-aeb7-8e6eb9f4ddaf None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:27.814659 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68add1-50c0-4ff3-9990-ce3024508281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:27.815370 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68add1-50c0-4ff3-9990-ce3024508281 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:27.815663 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68add1-50c0-4ff3-9990-ce3024508281 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:27.815944 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68add1-50c0-4ff3-9990-ce3024508281 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:27.822489 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68add1-50c0-4ff3-9990-ce3024508281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:27.827205 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68add1-50c0-4ff3-9990-ce3024508281 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:27.933292 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb94487-afa7-44a4-a4fa-3b29cf4338af admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:27.935286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-cdb94487-afa7-44a4-a4fa-3b29cf4338af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:27.967579 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 846/1681] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:56:27 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:27.972780 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68add1-50c0-4ff3-9990-ce3024508281 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:27.997494 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb94487-afa7-44a4-a4fa-3b29cf4338af admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:28.007964 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68add1-50c0-4ff3-9990-ce3024508281 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:28.012186 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498a56d-396a-40bf-850e-b672ac8ce269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:28.023948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498a56d-396a-40bf-850e-b672ac8ce269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:28.025291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498a56d-396a-40bf-850e-b672ac8ce269 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:28.028214 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498a56d-396a-40bf-850e-b672ac8ce269 admin admin] PATH_INFO: `/v3/projects/97b678c5f0784d43af4e5f5a336d50c9` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:28.032032 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498a56d-396a-40bf-850e-b672ac8ce269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97b678c5f0784d43af4e5f5a336d50c9)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:28.033093 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca0432-1693-4594-b195-0f83503cac08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:28.038112 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498a56d-396a-40bf-850e-b672ac8ce269 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:28.038268 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca0432-1693-4594-b195-0f83503cac08 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:28.038690 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca0432-1693-4594-b195-0f83503cac08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:28.039063 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca0432-1693-4594-b195-0f83503cac08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:28.039957 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca0432-1693-4594-b195-0f83503cac08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:28.047362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca0432-1693-4594-b195-0f83503cac08 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:28.065172 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:28.081600 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 847/1682] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:27 2022] GET /identity/v3/roles => generated 1427 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:28.088506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca0432-1693-4594-b195-0f83503cac08 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:28.100701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca0432-1693-4594-b195-0f83503cac08 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:28.112363 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee102a8-f094-4a65-b980-fe2b1a652a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:28.112363 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee102a8-f094-4a65-b980-fe2b1a652a6b admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:28.112363 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee102a8-f094-4a65-b980-fe2b1a652a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:28.112363 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee102a8-f094-4a65-b980-fe2b1a652a6b admin admin] PATH_INFO: `/v3/projects/ac736efe42fa4b4ab15898f4bb4e6504/users/e6088a5ea71d4014845e1419a68bf7ec/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:28.131261 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee102a8-f094-4a65-b980-fe2b1a652a6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac736efe42fa4b4ab15898f4bb4e6504, user_id=e6088a5ea71d4014845e1419a68bf7ec, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:28.135912 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee102a8-f094-4a65-b980-fe2b1a652a6b admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:28.284484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 848/1683] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:56:28 2022] PUT /identity/v3/projects/ac736efe42fa4b4ab15898f4bb4e6504/users/e6088a5ea71d4014845e1419a68bf7ec/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:28.286482 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee102a8-f094-4a65-b980-fe2b1a652a6b admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:28.296295 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-7ee102a8-f094-4a65-b980-fe2b1a652a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:28.320957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-2498a56d-396a-40bf-850e-b672ac8ce269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97b678c5f0784d43af4e5f5a336d50c9', 'request_id': 'req-2498a56d-396a-40bf-850e-b672ac8ce269'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:28.329028 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-2498a56d-396a-40bf-850e-b672ac8ce269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97b678c5f0784d43af4e5f5a336d50c9', 'request_id': 'req-2498a56d-396a-40bf-850e-b672ac8ce269'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:28.448496 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-2498a56d-396a-40bf-850e-b672ac8ce269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97b678c5f0784d43af4e5f5a336d50c9', 'request_id': 'req-2498a56d-396a-40bf-850e-b672ac8ce269'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:28.475499 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-2498a56d-396a-40bf-850e-b672ac8ce269 admin admin] The token cache is being invalidate because project 97b678c5f0784d43af4e5f5a336d50c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:56:28.475794 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-2498a56d-396a-40bf-850e-b672ac8ce269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:28.485109 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee102a8-f094-4a65-b980-fe2b1a652a6b admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:28.492663 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-2498a56d-396a-40bf-850e-b672ac8ce269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:28.496261 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 836/1684] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:56:27 2022] DELETE /identity/v3/projects/97b678c5f0784d43af4e5f5a336d50c9 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:56:28.497131 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498a56d-396a-40bf-850e-b672ac8ce269 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:28.502148 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-2498a56d-396a-40bf-850e-b672ac8ce269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:28.591593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:28.659702 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498a56d-396a-40bf-850e-b672ac8ce269 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:28.683198 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979d3d0-bab9-4ab9-bcc4-a369308e2ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:28.684227 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979d3d0-bab9-4ab9-bcc4-a369308e2ecb admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:28.689089 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979d3d0-bab9-4ab9-bcc4-a369308e2ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:28.689555 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979d3d0-bab9-4ab9-bcc4-a369308e2ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:28.692277 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979d3d0-bab9-4ab9-bcc4-a369308e2ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:28.700155 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979d3d0-bab9-4ab9-bcc4-a369308e2ecb admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:28.703197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde2780-c6ca-4953-889e-0c3b48e5767c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:28.704629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde2780-c6ca-4953-889e-0c3b48e5767c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:28.705010 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde2780-c6ca-4953-889e-0c3b48e5767c admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:28.705765 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde2780-c6ca-4953-889e-0c3b48e5767c admin admin] PATH_INFO: `/v3/projects/7acceadaad2c4031b0ea6ca9dd67a86c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:28.707120 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde2780-c6ca-4953-889e-0c3b48e5767c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7acceadaad2c4031b0ea6ca9dd67a86c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:28.710916 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde2780-c6ca-4953-889e-0c3b48e5767c admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:28.724378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 837/1685] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:28 2022] GET /identity/v3/roles => generated 1427 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:28.725954 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f172a-89ec-4ef7-af8d-35f9385fd0fc None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:28.726377 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f172a-89ec-4ef7-af8d-35f9385fd0fc None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:28.726856 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f172a-89ec-4ef7-af8d-35f9385fd0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:28.783566 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-a10f172a-89ec-4ef7-af8d-35f9385fd0fc None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:28.784854 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-a10f172a-89ec-4ef7-af8d-35f9385fd0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:28.814509 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 838/1686] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:28.815616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f172a-89ec-4ef7-af8d-35f9385fd0fc None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:28.845732 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f172a-89ec-4ef7-af8d-35f9385fd0fc None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:28.862303 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-8dde2780-c6ca-4953-889e-0c3b48e5767c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7acceadaad2c4031b0ea6ca9dd67a86c', 'request_id': 'req-8dde2780-c6ca-4953-889e-0c3b48e5767c'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:28.894401 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-8dde2780-c6ca-4953-889e-0c3b48e5767c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7acceadaad2c4031b0ea6ca9dd67a86c', 'request_id': 'req-8dde2780-c6ca-4953-889e-0c3b48e5767c'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:28.921599 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-8dde2780-c6ca-4953-889e-0c3b48e5767c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7acceadaad2c4031b0ea6ca9dd67a86c', 'request_id': 'req-8dde2780-c6ca-4953-889e-0c3b48e5767c'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:28.964554 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72e9da-7462-42f6-a4c4-223ccbd7ff04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:28.965760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72e9da-7462-42f6-a4c4-223ccbd7ff04 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:28.966851 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72e9da-7462-42f6-a4c4-223ccbd7ff04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:28.967447 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72e9da-7462-42f6-a4c4-223ccbd7ff04 admin admin] PATH_INFO: `/v3/projects/ac736efe42fa4b4ab15898f4bb4e6504/users/e6088a5ea71d4014845e1419a68bf7ec/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:28.970057 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72e9da-7462-42f6-a4c4-223ccbd7ff04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac736efe42fa4b4ab15898f4bb4e6504, user_id=e6088a5ea71d4014845e1419a68bf7ec, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:28.972965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72e9da-7462-42f6-a4c4-223ccbd7ff04 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:28.988203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 839/1687] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:56:28 2022] PUT /identity/v3/projects/ac736efe42fa4b4ab15898f4bb4e6504/users/e6088a5ea71d4014845e1419a68bf7ec/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:28.990481 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ffb0b-3e76-4d62-ba8e-7532e1e195e6 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:28.990864 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ffb0b-3e76-4d62-ba8e-7532e1e195e6 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:28.991203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ffb0b-3e76-4d62-ba8e-7532e1e195e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:29.039870 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-939ffb0b-3e76-4d62-ba8e-7532e1e195e6 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:29.041378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-939ffb0b-3e76-4d62-ba8e-7532e1e195e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:29.102303 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-8dde2780-c6ca-4953-889e-0c3b48e5767c admin admin] The token cache is being invalidate because project 7acceadaad2c4031b0ea6ca9dd67a86c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:56:29.102847 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-8dde2780-c6ca-4953-889e-0c3b48e5767c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:29.104587 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-8dde2780-c6ca-4953-889e-0c3b48e5767c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:29.107291 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 849/1688] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:56:28 2022] DELETE /identity/v3/projects/7acceadaad2c4031b0ea6ca9dd67a86c => generated 0 bytes in 822 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:29.111036 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7b29c-7c52-468a-ae79-ab46b9e396a8 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:29.114876 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7b29c-7c52-468a-ae79-ab46b9e396a8 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:29.115324 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7b29c-7c52-468a-ae79-ab46b9e396a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:29.122051 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 840/1689] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:29.123678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ffb0b-3e76-4d62-ba8e-7532e1e195e6 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:29.126772 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-939ffb0b-3e76-4d62-ba8e-7532e1e195e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:29.146197 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ffb0b-3e76-4d62-ba8e-7532e1e195e6 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:29.157787 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb6e1e-b115-47c2-bc5b-0c10f165c317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:29.158974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb6e1e-b115-47c2-bc5b-0c10f165c317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:29.159562 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb6e1e-b115-47c2-bc5b-0c10f165c317 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:29.159983 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb6e1e-b115-47c2-bc5b-0c10f165c317 admin admin] PATH_INFO: `/v3/users/2cbf5e3046b04b5a81a38414745f941d` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:29.164495 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-b3d7b29c-7c52-468a-ae79-ab46b9e396a8 None None] MFA Rules not processed for user `e6088a5ea71d4014845e1419a68bf7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:29.165900 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-b3d7b29c-7c52-468a-ae79-ab46b9e396a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:29.174484 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb6e1e-b115-47c2-bc5b-0c10f165c317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cbf5e3046b04b5a81a38414745f941d)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:29.184302 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb6e1e-b115-47c2-bc5b-0c10f165c317 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:29.283051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 850/1690] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:29.284150 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7b29c-7c52-468a-ae79-ab46b9e396a8 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:29.299865 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7b29c-7c52-468a-ae79-ab46b9e396a8 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:29.305550 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d14fe-f7f2-4c81-a03f-8277907963fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:29.306247 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d14fe-f7f2-4c81-a03f-8277907963fa admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:29.306536 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d14fe-f7f2-4c81-a03f-8277907963fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:29.306817 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d14fe-f7f2-4c81-a03f-8277907963fa admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:29.307568 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d14fe-f7f2-4c81-a03f-8277907963fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:56:29.307886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d14fe-f7f2-4c81-a03f-8277907963fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:29.309879 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d14fe-f7f2-4c81-a03f-8277907963fa admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:29.331699 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 851/1691] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:56:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:56:29.333068 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d14fe-f7f2-4c81-a03f-8277907963fa admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:29.336498 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-590d14fe-f7f2-4c81-a03f-8277907963fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:29.353957 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d14fe-f7f2-4c81-a03f-8277907963fa admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:29.361582 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd967f-59af-406c-9bb3-7568c3773181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:29.362598 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd967f-59af-406c-9bb3-7568c3773181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:29.362987 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd967f-59af-406c-9bb3-7568c3773181 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:29.363312 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd967f-59af-406c-9bb3-7568c3773181 admin admin] PATH_INFO: `/v3/projects/ba5dbb0fc596455884bdb838fd029d08` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:29.365166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd967f-59af-406c-9bb3-7568c3773181 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba5dbb0fc596455884bdb838fd029d08)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:29.373823 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd967f-59af-406c-9bb3-7568c3773181 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:29.445253 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-9acb6e1e-b115-47c2-bc5b-0c10f165c317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cbf5e3046b04b5a81a38414745f941d'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:29.462317 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-9acb6e1e-b115-47c2-bc5b-0c10f165c317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cbf5e3046b04b5a81a38414745f941d'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:29.472023 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-9acb6e1e-b115-47c2-bc5b-0c10f165c317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cbf5e3046b04b5a81a38414745f941d'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:29.473005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-9acb6e1e-b115-47c2-bc5b-0c10f165c317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cbf5e3046b04b5a81a38414745f941d'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:29.568156 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-50cd967f-59af-406c-9bb3-7568c3773181 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba5dbb0fc596455884bdb838fd029d08', 'request_id': 'req-50cd967f-59af-406c-9bb3-7568c3773181'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:29.577838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-9acb6e1e-b115-47c2-bc5b-0c10f165c317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cbf5e3046b04b5a81a38414745f941d'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:29.581408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-50cd967f-59af-406c-9bb3-7568c3773181 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba5dbb0fc596455884bdb838fd029d08', 'request_id': 'req-50cd967f-59af-406c-9bb3-7568c3773181'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:29.594666 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 841/1692] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:56:29 2022] DELETE /identity/v3/users/2cbf5e3046b04b5a81a38414745f941d => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:29.596564 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb6e1e-b115-47c2-bc5b-0c10f165c317 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:29.601673 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-9acb6e1e-b115-47c2-bc5b-0c10f165c317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:29.603196 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-50cd967f-59af-406c-9bb3-7568c3773181 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba5dbb0fc596455884bdb838fd029d08', 'request_id': 'req-50cd967f-59af-406c-9bb3-7568c3773181'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:29.728222 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb6e1e-b115-47c2-bc5b-0c10f165c317 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:29.730017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-50cd967f-59af-406c-9bb3-7568c3773181 admin admin] The token cache is being invalidate because project ba5dbb0fc596455884bdb838fd029d08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:56:29.730473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-50cd967f-59af-406c-9bb3-7568c3773181 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:29.731570 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-50cd967f-59af-406c-9bb3-7568c3773181 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:29.735140 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 852/1693] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:56:29 2022] DELETE /identity/v3/projects/ba5dbb0fc596455884bdb838fd029d08 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:29.738637 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd967f-59af-406c-9bb3-7568c3773181 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:29.740942 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-50cd967f-59af-406c-9bb3-7568c3773181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:29.751106 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6af95-d282-41fd-bc74-ad778f447724 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:29.765585 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6af95-d282-41fd-bc74-ad778f447724 service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:29.767094 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6af95-d282-41fd-bc74-ad778f447724 service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:29.768194 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6af95-d282-41fd-bc74-ad778f447724 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:29.773598 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-2bd6af95-d282-41fd-bc74-ad778f447724 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:29.887098 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd967f-59af-406c-9bb3-7568c3773181 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:29.916448 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6af95-d282-41fd-bc74-ad778f447724 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:29.922336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6af95-d282-41fd-bc74-ad778f447724 service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:29.956137 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 842/1694] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:29.957544 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6af95-d282-41fd-bc74-ad778f447724 service cinder] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:29.962814 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-2bd6af95-d282-41fd-bc74-ad778f447724 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:30.027240 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7a46c-67f7-4165-aad5-c8100ad919ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:30.027981 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7a46c-67f7-4165-aad5-c8100ad919ed admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:30.028333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7a46c-67f7-4165-aad5-c8100ad919ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:30.029496 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7a46c-67f7-4165-aad5-c8100ad919ed admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:30.030379 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b7a46c-67f7-4165-aad5-c8100ad919ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:30.033907 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b7a46c-67f7-4165-aad5-c8100ad919ed admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:30.108994 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6af95-d282-41fd-bc74-ad778f447724 service cinder] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:30.120324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77a91b-2c72-46c6-9839-65fd8d1358f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:30.121244 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77a91b-2c72-46c6-9839-65fd8d1358f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:30.121535 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77a91b-2c72-46c6-9839-65fd8d1358f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:30.121815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77a91b-2c72-46c6-9839-65fd8d1358f5 admin admin] PATH_INFO: `/v3/users/7c16e4b4dc484770bc9fe9fd9914740a` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:30.124485 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77a91b-2c72-46c6-9839-65fd8d1358f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c16e4b4dc484770bc9fe9fd9914740a)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:30.125073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77a91b-2c72-46c6-9839-65fd8d1358f5 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:30.155101 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 853/1695] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:56:29 2022] POST /identity/v3/projects => generated 354 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:30.159272 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7a46c-67f7-4165-aad5-c8100ad919ed admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:30.281876 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7a46c-67f7-4165-aad5-c8100ad919ed admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:30.290485 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884deeb-fb14-48dc-86aa-e13ca62d6942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:30.291184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884deeb-fb14-48dc-86aa-e13ca62d6942 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:30.291508 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884deeb-fb14-48dc-86aa-e13ca62d6942 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:30.291990 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884deeb-fb14-48dc-86aa-e13ca62d6942 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:30.294972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:30.295570 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884deeb-fb14-48dc-86aa-e13ca62d6942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:30.297703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884deeb-fb14-48dc-86aa-e13ca62d6942 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:30.386757 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-6a77a91b-2c72-46c6-9839-65fd8d1358f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c16e4b4dc484770bc9fe9fd9914740a'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:30.420215 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-6a77a91b-2c72-46c6-9839-65fd8d1358f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c16e4b4dc484770bc9fe9fd9914740a'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:30.438229 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-6a77a91b-2c72-46c6-9839-65fd8d1358f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c16e4b4dc484770bc9fe9fd9914740a'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:30.440066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-6a77a91b-2c72-46c6-9839-65fd8d1358f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c16e4b4dc484770bc9fe9fd9914740a'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:30.451314 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 854/1696] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:56:30 2022] POST /identity/v3/users => generated 278 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:30.461257 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884deeb-fb14-48dc-86aa-e13ca62d6942 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:30.466207 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-b884deeb-fb14-48dc-86aa-e13ca62d6942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:30.543220 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-6a77a91b-2c72-46c6-9839-65fd8d1358f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c16e4b4dc484770bc9fe9fd9914740a'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:30.554031 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 843/1697] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:56:29 2022] DELETE /identity/v3/users/7c16e4b4dc484770bc9fe9fd9914740a => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:30.556930 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77a91b-2c72-46c6-9839-65fd8d1358f5 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:30.557656 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-6a77a91b-2c72-46c6-9839-65fd8d1358f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:30.650011 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884deeb-fb14-48dc-86aa-e13ca62d6942 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:30.783601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:30.821999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77a91b-2c72-46c6-9839-65fd8d1358f5 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:30.849040 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a7f56-29cf-4346-8b0a-450ac1ec71d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:30.850073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a7f56-29cf-4346-8b0a-450ac1ec71d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:30.850498 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a7f56-29cf-4346-8b0a-450ac1ec71d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:30.850911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a7f56-29cf-4346-8b0a-450ac1ec71d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:30.853411 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a7f56-29cf-4346-8b0a-450ac1ec71d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:30.861114 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a7f56-29cf-4346-8b0a-450ac1ec71d0 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:30.883029 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ff56d-df2a-4c9f-8063-c2b882552063 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:30.883786 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ff56d-df2a-4c9f-8063-c2b882552063 service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:30.884063 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ff56d-df2a-4c9f-8063-c2b882552063 service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:30.884400 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ff56d-df2a-4c9f-8063-c2b882552063 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:30.895964 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-519ff56d-df2a-4c9f-8063-c2b882552063 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:30.904791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 844/1698] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:30 2022] GET /identity/v3/roles => generated 1427 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:30.917909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca89df9-779e-4d9f-9e86-bfc1a0875a04 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:30.918694 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca89df9-779e-4d9f-9e86-bfc1a0875a04 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:30.919119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca89df9-779e-4d9f-9e86-bfc1a0875a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:31.024882 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-1ca89df9-779e-4d9f-9e86-bfc1a0875a04 None None] MFA Rules not processed for user `9d152595f433420f9cd0b7d45a4cb6da`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:31.030640 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-1ca89df9-779e-4d9f-9e86-bfc1a0875a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:31.128511 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ff56d-df2a-4c9f-8063-c2b882552063 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:31.130001 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ff56d-df2a-4c9f-8063-c2b882552063 service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:31.195577 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 855/1699] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 741 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:31.196569 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ff56d-df2a-4c9f-8063-c2b882552063 service cinder] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:31.244090 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ff56d-df2a-4c9f-8063-c2b882552063 service cinder] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:31.260368 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398b7df-bfed-4aa8-bb0c-5ce28e6d57c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:31.261382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398b7df-bfed-4aa8-bb0c-5ce28e6d57c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:31.263549 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398b7df-bfed-4aa8-bb0c-5ce28e6d57c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:31.264071 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398b7df-bfed-4aa8-bb0c-5ce28e6d57c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:31.265405 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398b7df-bfed-4aa8-bb0c-5ce28e6d57c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:31.267157 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398b7df-bfed-4aa8-bb0c-5ce28e6d57c8 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:31.311598 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 845/1700] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:31.317528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b1362-ee6a-4abf-a80d-395d0e5ae843 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:31.318562 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b1362-ee6a-4abf-a80d-395d0e5ae843 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:31.318864 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b1362-ee6a-4abf-a80d-395d0e5ae843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:31.322085 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 856/1701] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:31 2022] GET /identity/v3/roles => generated 1427 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:31.326116 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73359f33-4ce4-4eff-8e6b-30ae1f789bfd None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:31.326416 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73359f33-4ce4-4eff-8e6b-30ae1f789bfd None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:31.326732 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73359f33-4ce4-4eff-8e6b-30ae1f789bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:31.370561 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-219b1362-ee6a-4abf-a80d-395d0e5ae843 None None] MFA Rules not processed for user `b0d02887422a43e4bb69566a2d64e890`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:31.373239 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-73359f33-4ce4-4eff-8e6b-30ae1f789bfd None None] MFA Rules not processed for user `9d152595f433420f9cd0b7d45a4cb6da`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:31.374730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-219b1362-ee6a-4abf-a80d-395d0e5ae843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:31.375495 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-73359f33-4ce4-4eff-8e6b-30ae1f789bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:31.396795 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 857/1702] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:31.396795 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73359f33-4ce4-4eff-8e6b-30ae1f789bfd None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:31.426133 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73359f33-4ce4-4eff-8e6b-30ae1f789bfd None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:31.437984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe54a4-55d0-4635-a7dd-aa16fa36238d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:31.439343 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe54a4-55d0-4635-a7dd-aa16fa36238d admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:31.439628 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe54a4-55d0-4635-a7dd-aa16fa36238d admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:31.439911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe54a4-55d0-4635-a7dd-aa16fa36238d admin admin] PATH_INFO: `/v3/projects/45455e98cd5d488182b5b9a3cae68906/users/0de3513e4b4b4ca8b509dadfcc278858/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:31.478809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe54a4-55d0-4635-a7dd-aa16fa36238d admin admin] RBAC: Authorizing `identity:create_grant(project_id=45455e98cd5d488182b5b9a3cae68906, user_id=0de3513e4b4b4ca8b509dadfcc278858, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:31.490233 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe54a4-55d0-4635-a7dd-aa16fa36238d admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:31.558982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 846/1703] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:31.560048 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b1362-ee6a-4abf-a80d-395d0e5ae843 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:31.563054 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-219b1362-ee6a-4abf-a80d-395d0e5ae843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:31.658466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 858/1704] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:56:31 2022] PUT /identity/v3/projects/45455e98cd5d488182b5b9a3cae68906/users/0de3513e4b4b4ca8b509dadfcc278858/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:31.658466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adeb58-5730-4dde-8cc9-e4dc3134512b None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:31.658466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adeb58-5730-4dde-8cc9-e4dc3134512b None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:31.658466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adeb58-5730-4dde-8cc9-e4dc3134512b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:31.680011 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:31.703511 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b1362-ee6a-4abf-a80d-395d0e5ae843 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:31.762497 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-55adeb58-5730-4dde-8cc9-e4dc3134512b None None] MFA Rules not processed for user `fe6f58bedd87454bad46b0c48697eec9`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:31.763743 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-55adeb58-5730-4dde-8cc9-e4dc3134512b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:31.792665 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884f9ff-b16a-48ad-b023-5406823a8de7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:31.793342 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884f9ff-b16a-48ad-b023-5406823a8de7 service nova] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:31.794242 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884f9ff-b16a-48ad-b023-5406823a8de7 service nova] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:31.794242 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884f9ff-b16a-48ad-b023-5406823a8de7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:31.957999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884f9ff-b16a-48ad-b023-5406823a8de7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:31.960493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884f9ff-b16a-48ad-b023-5406823a8de7 service nova] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:32.003731 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 859/1705] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:32.003731 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adeb58-5730-4dde-8cc9-e4dc3134512b None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:32.003731 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-55adeb58-5730-4dde-8cc9-e4dc3134512b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:32.004676 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 847/1706] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:32.004676 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739330b-e640-4e5f-8dc2-82c4b2784306 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:32.004676 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739330b-e640-4e5f-8dc2-82c4b2784306 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:32.004676 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739330b-e640-4e5f-8dc2-82c4b2784306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:32.040386 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adeb58-5730-4dde-8cc9-e4dc3134512b None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:32.053326 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21dae18-752e-4893-be92-aec2da8a7bb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:32.055397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dae18-752e-4893-be92-aec2da8a7bb3 service nova] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:32.055397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dae18-752e-4893-be92-aec2da8a7bb3 service nova] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:32.070614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dae18-752e-4893-be92-aec2da8a7bb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:32.096534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-2739330b-e640-4e5f-8dc2-82c4b2784306 None None] MFA Rules not processed for user `0de3513e4b4b4ca8b509dadfcc278858`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:32.097856 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-2739330b-e640-4e5f-8dc2-82c4b2784306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:32.111492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:32.256190 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21dae18-752e-4893-be92-aec2da8a7bb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:32.258128 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21dae18-752e-4893-be92-aec2da8a7bb3 service nova] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:32.282248 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 860/1707] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:32.283243 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21dae18-752e-4893-be92-aec2da8a7bb3 service nova] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:32.294361 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-e21dae18-752e-4893-be92-aec2da8a7bb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:32.315894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 848/1708] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:31 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:32.317823 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef9dd1-e652-4dac-b5e1-ee25a4835654 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:32.318459 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef9dd1-e652-4dac-b5e1-ee25a4835654 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:32.318869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef9dd1-e652-4dac-b5e1-ee25a4835654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:32.365673 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-60ef9dd1-e652-4dac-b5e1-ee25a4835654 None None] MFA Rules not processed for user `fe6f58bedd87454bad46b0c48697eec9`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:32.378758 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-60ef9dd1-e652-4dac-b5e1-ee25a4835654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:32.410467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 849/1709] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:32.412553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef9dd1-e652-4dac-b5e1-ee25a4835654 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:32.420361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-60ef9dd1-e652-4dac-b5e1-ee25a4835654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:32.517859 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21dae18-752e-4893-be92-aec2da8a7bb3 service nova] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:32.532033 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683621b-5940-434a-a057-aa1c60fbd59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:32.532958 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683621b-5940-434a-a057-aa1c60fbd59e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:32.533273 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683621b-5940-434a-a057-aa1c60fbd59e admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:32.533558 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683621b-5940-434a-a057-aa1c60fbd59e admin admin] PATH_INFO: `/v3/projects/e93e3e5401674b6a9a13aa4c62923719` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:32.537607 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683621b-5940-434a-a057-aa1c60fbd59e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e93e3e5401674b6a9a13aa4c62923719)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:32.539560 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683621b-5940-434a-a057-aa1c60fbd59e admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:32.629478 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef9dd1-e652-4dac-b5e1-ee25a4835654 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:32.636726 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf392fa6-6b3f-469b-b60a-ad7d8fb0cbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:32.638026 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf392fa6-6b3f-469b-b60a-ad7d8fb0cbd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:32.640245 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf392fa6-6b3f-469b-b60a-ad7d8fb0cbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:32.640245 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf392fa6-6b3f-469b-b60a-ad7d8fb0cbd1 admin admin] PATH_INFO: `/v3/projects/9801ac1c33cc41229344d01d8a72951a` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:32.640245 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf392fa6-6b3f-469b-b60a-ad7d8fb0cbd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9801ac1c33cc41229344d01d8a72951a)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:32.642794 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf392fa6-6b3f-469b-b60a-ad7d8fb0cbd1 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:32.717951 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:32.780546 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7683621b-5940-434a-a057-aa1c60fbd59e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e93e3e5401674b6a9a13aa4c62923719', 'request_id': 'req-7683621b-5940-434a-a057-aa1c60fbd59e'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:32.809015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7683621b-5940-434a-a057-aa1c60fbd59e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e93e3e5401674b6a9a13aa4c62923719', 'request_id': 'req-7683621b-5940-434a-a057-aa1c60fbd59e'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:32.819800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7683621b-5940-434a-a057-aa1c60fbd59e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e93e3e5401674b6a9a13aa4c62923719', 'request_id': 'req-7683621b-5940-434a-a057-aa1c60fbd59e'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:32.843578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-cf392fa6-6b3f-469b-b60a-ad7d8fb0cbd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9801ac1c33cc41229344d01d8a72951a', 'request_id': 'req-cf392fa6-6b3f-469b-b60a-ad7d8fb0cbd1'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:32.851581 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-cf392fa6-6b3f-469b-b60a-ad7d8fb0cbd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9801ac1c33cc41229344d01d8a72951a', 'request_id': 'req-cf392fa6-6b3f-469b-b60a-ad7d8fb0cbd1'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:32.970521 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7683621b-5940-434a-a057-aa1c60fbd59e admin admin] The token cache is being invalidate because project e93e3e5401674b6a9a13aa4c62923719 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:56:32.970521 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7683621b-5940-434a-a057-aa1c60fbd59e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:32.970521 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7683621b-5940-434a-a057-aa1c60fbd59e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:32.970895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 861/1710] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:56:32 2022] DELETE /identity/v3/projects/e93e3e5401674b6a9a13aa4c62923719 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:32.976877 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683621b-5940-434a-a057-aa1c60fbd59e admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:32.980935 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-7683621b-5940-434a-a057-aa1c60fbd59e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:33.120308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-cf392fa6-6b3f-469b-b60a-ad7d8fb0cbd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9801ac1c33cc41229344d01d8a72951a', 'request_id': 'req-cf392fa6-6b3f-469b-b60a-ad7d8fb0cbd1'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:33.131013 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683621b-5940-434a-a057-aa1c60fbd59e admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:33.137485 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-cf392fa6-6b3f-469b-b60a-ad7d8fb0cbd1 admin admin] The token cache is being invalidate because project 9801ac1c33cc41229344d01d8a72951a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:56:33.139069 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-cf392fa6-6b3f-469b-b60a-ad7d8fb0cbd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:33.140545 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-cf392fa6-6b3f-469b-b60a-ad7d8fb0cbd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:56:33.146523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 850/1711] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:56:32 2022] DELETE /identity/v3/projects/9801ac1c33cc41229344d01d8a72951a => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:33.149044 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf392fa6-6b3f-469b-b60a-ad7d8fb0cbd1 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:33.154364 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-cf392fa6-6b3f-469b-b60a-ad7d8fb0cbd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:33.330274 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b3712-de3d-4308-8fe2-5b64b4300784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:33.331109 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b3712-de3d-4308-8fe2-5b64b4300784 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:33.332024 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b3712-de3d-4308-8fe2-5b64b4300784 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:33.332462 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b3712-de3d-4308-8fe2-5b64b4300784 admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:33.334082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b3712-de3d-4308-8fe2-5b64b4300784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:33.338915 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b3712-de3d-4308-8fe2-5b64b4300784 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:33.387262 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf392fa6-6b3f-469b-b60a-ad7d8fb0cbd1 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:33.393865 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a164786-b65d-4e5e-a130-a657cd20a153 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:33.394613 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a164786-b65d-4e5e-a130-a657cd20a153 service nova] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:33.394901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a164786-b65d-4e5e-a130-a657cd20a153 service nova] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:33.395275 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a164786-b65d-4e5e-a130-a657cd20a153 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:33.398127 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-0a164786-b65d-4e5e-a130-a657cd20a153 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:33.494010 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 862/1712] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:56:32 2022] POST /identity/v3/projects => generated 358 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:33.494010 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44969a-7d71-4509-a746-311a5a00216c None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:33.494010 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44969a-7d71-4509-a746-311a5a00216c None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:33.494332 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44969a-7d71-4509-a746-311a5a00216c None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:33.497473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 863/1713] 10.222.0.119 () {54 vars in 917 bytes} [Thu Jul 14 15:56:33 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:56:33.498907 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c6bcb-b564-4bc7-beba-cd692d2231f5 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:33.501994 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c6bcb-b564-4bc7-beba-cd692d2231f5 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:33.502407 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c6bcb-b564-4bc7-beba-cd692d2231f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:33.566372 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-160c6bcb-b564-4bc7-beba-cd692d2231f5 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:33.568851 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-160c6bcb-b564-4bc7-beba-cd692d2231f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:33.660539 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a164786-b65d-4e5e-a130-a657cd20a153 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:33.667383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a164786-b65d-4e5e-a130-a657cd20a153 service nova] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:33.690848 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 851/1714] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:33 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:33.694289 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ed953-1459-4d8e-ba97-08f1f62b7977 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:33.694590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ed953-1459-4d8e-ba97-08f1f62b7977 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:33.694880 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ed953-1459-4d8e-ba97-08f1f62b7977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:33.731941 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-fa9ed953-1459-4d8e-ba97-08f1f62b7977 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:33.733233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-fa9ed953-1459-4d8e-ba97-08f1f62b7977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:33.769779 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 864/1715] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:33.771162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c6bcb-b564-4bc7-beba-cd692d2231f5 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:33.772999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-160c6bcb-b564-4bc7-beba-cd692d2231f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:33.786133 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c6bcb-b564-4bc7-beba-cd692d2231f5 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:33.800152 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efead9f9-df17-48f8-a991-a8ee7351ef82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:33.801174 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efead9f9-df17-48f8-a991-a8ee7351ef82 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:33.801817 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efead9f9-df17-48f8-a991-a8ee7351ef82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:33.803194 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efead9f9-df17-48f8-a991-a8ee7351ef82 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:33.804185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efead9f9-df17-48f8-a991-a8ee7351ef82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:33.806401 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efead9f9-df17-48f8-a991-a8ee7351ef82 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:33.902793 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 852/1716] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:33.902793 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed6cab-14b4-41b1-833e-e60dbe19c58d None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:33.902793 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed6cab-14b4-41b1-833e-e60dbe19c58d None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:33.902793 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed6cab-14b4-41b1-833e-e60dbe19c58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:33.914922 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 865/1717] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:56:33 2022] POST /identity/v3/users => generated 286 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:33.921720 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2d8d7-4300-430e-b8e0-3517278da3b9 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:33.922286 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2d8d7-4300-430e-b8e0-3517278da3b9 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:33.923027 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2d8d7-4300-430e-b8e0-3517278da3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:33.962714 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-22c2d8d7-4300-430e-b8e0-3517278da3b9 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:33.965439 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-22c2d8d7-4300-430e-b8e0-3517278da3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:33.997652 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-ebed6cab-14b4-41b1-833e-e60dbe19c58d None None] MFA Rules not processed for user `70559c2ce32043dd9a902837ab444622`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:33.998901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-ebed6cab-14b4-41b1-833e-e60dbe19c58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:34.009336 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 866/1718] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:34.013870 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490694c-4ec2-4137-a9a1-a6ca9d23d852 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:34.013870 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490694c-4ec2-4137-a9a1-a6ca9d23d852 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:34.013870 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490694c-4ec2-4137-a9a1-a6ca9d23d852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:34.040121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-3490694c-4ec2-4137-a9a1-a6ca9d23d852 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:34.041364 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-3490694c-4ec2-4137-a9a1-a6ca9d23d852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:34.057491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 867/1719] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:34.057491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490694c-4ec2-4137-a9a1-a6ca9d23d852 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:34.070585 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490694c-4ec2-4137-a9a1-a6ca9d23d852 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:34.078635 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebd959-8306-45ee-8096-c59291d27ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:34.079355 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebd959-8306-45ee-8096-c59291d27ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:34.079812 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebd959-8306-45ee-8096-c59291d27ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:34.080302 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebd959-8306-45ee-8096-c59291d27ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:34.081730 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebd959-8306-45ee-8096-c59291d27ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:34.084975 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebd959-8306-45ee-8096-c59291d27ff3 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:34.104486 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 868/1720] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:34 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:34.106826 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b64d2a-46bb-4b68-a679-110112305725 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:34.107464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b64d2a-46bb-4b68-a679-110112305725 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:34.108470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b64d2a-46bb-4b68-a679-110112305725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:34.130062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 853/1721] 10.222.0.119 () {58 vars in 1014 bytes} [Thu Jul 14 15:56:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:34.137285 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed6cab-14b4-41b1-833e-e60dbe19c58d None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:34.146886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-47b64d2a-46bb-4b68-a679-110112305725 None None] MFA Rules not processed for user `6bbbf243c1334013ac235aa5b0853621`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:34.151287 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-47b64d2a-46bb-4b68-a679-110112305725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:34.186019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed6cab-14b4-41b1-833e-e60dbe19c58d None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:34.197280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733c075-73be-43eb-9397-87ebc44f54f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:34.198157 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733c075-73be-43eb-9397-87ebc44f54f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:34.198570 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733c075-73be-43eb-9397-87ebc44f54f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:34.198857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733c075-73be-43eb-9397-87ebc44f54f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:34.199674 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733c075-73be-43eb-9397-87ebc44f54f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:56:34.200636 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733c075-73be-43eb-9397-87ebc44f54f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:34.202924 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733c075-73be-43eb-9397-87ebc44f54f5 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:34.228978 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 854/1722] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:56:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:56:34.229703 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733c075-73be-43eb-9397-87ebc44f54f5 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:34.256844 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733c075-73be-43eb-9397-87ebc44f54f5 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:34.256844 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e84b46-8bd2-4b5e-994d-f627e129f8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:34.258086 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e84b46-8bd2-4b5e-994d-f627e129f8ac admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:34.258506 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e84b46-8bd2-4b5e-994d-f627e129f8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:34.259313 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e84b46-8bd2-4b5e-994d-f627e129f8ac admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:34.260467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e84b46-8bd2-4b5e-994d-f627e129f8ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:56:34.261157 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e84b46-8bd2-4b5e-994d-f627e129f8ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:34.263426 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e84b46-8bd2-4b5e-994d-f627e129f8ac admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:34.282752 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 869/1723] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:34.283491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b64d2a-46bb-4b68-a679-110112305725 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:34.297419 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:34.309013 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 855/1724] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:56:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:56:34.311359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e84b46-8bd2-4b5e-994d-f627e129f8ac admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:34.315127 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b64d2a-46bb-4b68-a679-110112305725 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:34.329179 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86411c-97d2-4ebd-8d25-7cc5aa56c7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:34.331312 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86411c-97d2-4ebd-8d25-7cc5aa56c7f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:34.334561 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86411c-97d2-4ebd-8d25-7cc5aa56c7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:34.334999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86411c-97d2-4ebd-8d25-7cc5aa56c7f4 admin admin] PATH_INFO: `/v3/projects/dd773f59921d4e6e9c2a95e6b08dd85e/users/9a46e57644d0404f9c228f5d270225b8/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:34.343238 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e84b46-8bd2-4b5e-994d-f627e129f8ac admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:34.352442 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567f01e-836a-4f13-bbfe-41287cf37e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:34.353684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567f01e-836a-4f13-bbfe-41287cf37e94 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:34.354274 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567f01e-836a-4f13-bbfe-41287cf37e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:34.354934 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567f01e-836a-4f13-bbfe-41287cf37e94 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:34.355902 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567f01e-836a-4f13-bbfe-41287cf37e94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:34.358877 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567f01e-836a-4f13-bbfe-41287cf37e94 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:34.375288 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86411c-97d2-4ebd-8d25-7cc5aa56c7f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd773f59921d4e6e9c2a95e6b08dd85e, user_id=9a46e57644d0404f9c228f5d270225b8, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:34.385651 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86411c-97d2-4ebd-8d25-7cc5aa56c7f4 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:34.487772 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 856/1725] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:56:34 2022] POST /identity/v3/projects => generated 408 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:34.489016 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567f01e-836a-4f13-bbfe-41287cf37e94 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:34.566837 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 870/1726] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:56:34 2022] PUT /identity/v3/projects/dd773f59921d4e6e9c2a95e6b08dd85e/users/9a46e57644d0404f9c228f5d270225b8/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:34.566837 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86411c-97d2-4ebd-8d25-7cc5aa56c7f4 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:34.570013 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-ca86411c-97d2-4ebd-8d25-7cc5aa56c7f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:34.710945 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86411c-97d2-4ebd-8d25-7cc5aa56c7f4 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:34.723519 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567f01e-836a-4f13-bbfe-41287cf37e94 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:34.725271 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ebe29-7632-407b-8b15-d8df5f5234d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:34.725951 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ebe29-7632-407b-8b15-d8df5f5234d0 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:34.731762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ebe29-7632-407b-8b15-d8df5f5234d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:34.731762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ebe29-7632-407b-8b15-d8df5f5234d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:34.742863 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ebe29-7632-407b-8b15-d8df5f5234d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:34.751571 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ebe29-7632-407b-8b15-d8df5f5234d0 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:34.806359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 871/1727] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:34.807617 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ebe29-7632-407b-8b15-d8df5f5234d0 service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:35.016718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477058e4-9915-411f-9ae5-f588c81527ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:35.017750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477058e4-9915-411f-9ae5-f588c81527ad admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:35.018289 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477058e4-9915-411f-9ae5-f588c81527ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:35.018632 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477058e4-9915-411f-9ae5-f588c81527ad admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:35.027803 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477058e4-9915-411f-9ae5-f588c81527ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:35.032480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477058e4-9915-411f-9ae5-f588c81527ad admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:35.063644 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ebe29-7632-407b-8b15-d8df5f5234d0 service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:35.092876 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ce0c8-101f-4f8a-853b-c67d8070c7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:35.093620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ce0c8-101f-4f8a-853b-c67d8070c7a7 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:35.095294 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ce0c8-101f-4f8a-853b-c67d8070c7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:35.095605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ce0c8-101f-4f8a-853b-c67d8070c7a7 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:35.101990 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ce0c8-101f-4f8a-853b-c67d8070c7a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:35.110824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ce0c8-101f-4f8a-853b-c67d8070c7a7 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:35.191385 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 857/1728] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:56:34 2022] POST /identity/v3/projects => generated 374 bytes in 703 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:35.193284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5edc1-f6df-4a60-82c0-d413fd087684 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:35.194229 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5edc1-f6df-4a60-82c0-d413fd087684 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:35.194948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5edc1-f6df-4a60-82c0-d413fd087684 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:35.204137 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 858/1729] 10.222.0.119 () {54 vars in 917 bytes} [Thu Jul 14 15:56:35 2022] GET /identity => generated 271 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:56:35.205214 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5edc1-f6df-4a60-82c0-d413fd087684 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:35.226610 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 872/1730] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:56:34 2022] POST /identity/v3/users => generated 305 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:35.227528 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ce0c8-101f-4f8a-853b-c67d8070c7a7 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:35.263071 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ce0c8-101f-4f8a-853b-c67d8070c7a7 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:35.356750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5edc1-f6df-4a60-82c0-d413fd087684 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:35.362743 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7996691-e462-414a-8c9f-7b0ccb456536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:35.363666 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7996691-e462-414a-8c9f-7b0ccb456536 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:35.364065 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7996691-e462-414a-8c9f-7b0ccb456536 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:35.365051 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7996691-e462-414a-8c9f-7b0ccb456536 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:35.368582 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7996691-e462-414a-8c9f-7b0ccb456536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:35.371965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7996691-e462-414a-8c9f-7b0ccb456536 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:35.392546 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 859/1731] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:35 2022] GET /identity/v3/roles => generated 1427 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:35.394020 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19d4aa-cc68-44b1-bc87-f817c2daf4aa None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:35.394385 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19d4aa-cc68-44b1-bc87-f817c2daf4aa None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:35.394727 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19d4aa-cc68-44b1-bc87-f817c2daf4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:35.435339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-1e19d4aa-cc68-44b1-bc87-f817c2daf4aa None None] MFA Rules not processed for user `70559c2ce32043dd9a902837ab444622`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:35.436848 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-1e19d4aa-cc68-44b1-bc87-f817c2daf4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:35.446073 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ff17c-e79a-4596-87c1-438121b912cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:35.446902 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ff17c-e79a-4596-87c1-438121b912cc admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:35.447066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ff17c-e79a-4596-87c1-438121b912cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:35.447356 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ff17c-e79a-4596-87c1-438121b912cc admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:35.448052 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399ff17c-e79a-4596-87c1-438121b912cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:35.456043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399ff17c-e79a-4596-87c1-438121b912cc admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:35.513690 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:35.566593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 860/1732] 10.222.0.119 () {58 vars in 1014 bytes} [Thu Jul 14 15:56:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:35.574586 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19d4aa-cc68-44b1-bc87-f817c2daf4aa None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:35.602446 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19d4aa-cc68-44b1-bc87-f817c2daf4aa None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:35.603122 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 873/1733] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:56:35 2022] POST /identity/v3/users => generated 288 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:35.605161 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ff17c-e79a-4596-87c1-438121b912cc admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:35.617322 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40ee15-b971-42c3-8e5c-32c4ab7192ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:35.619206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40ee15-b971-42c3-8e5c-32c4ab7192ae admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:35.619493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40ee15-b971-42c3-8e5c-32c4ab7192ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:35.619775 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40ee15-b971-42c3-8e5c-32c4ab7192ae admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:35.620325 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ff17c-e79a-4596-87c1-438121b912cc admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:35.620616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40ee15-b971-42c3-8e5c-32c4ab7192ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:35.624049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40ee15-b971-42c3-8e5c-32c4ab7192ae admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:35.627959 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44542b95-d970-4fce-9a5f-a99eb7e6840d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:35.629152 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44542b95-d970-4fce-9a5f-a99eb7e6840d admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:35.629696 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44542b95-d970-4fce-9a5f-a99eb7e6840d admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:35.630128 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44542b95-d970-4fce-9a5f-a99eb7e6840d admin admin] PATH_INFO: `/v3/projects/dd773f59921d4e6e9c2a95e6b08dd85e/users/9a46e57644d0404f9c228f5d270225b8/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:35.632437 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44542b95-d970-4fce-9a5f-a99eb7e6840d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd773f59921d4e6e9c2a95e6b08dd85e, user_id=9a46e57644d0404f9c228f5d270225b8, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:35.635908 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44542b95-d970-4fce-9a5f-a99eb7e6840d admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:35.648997 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 861/1734] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:35 2022] GET /identity/v3/roles => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:35.650517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40ee15-b971-42c3-8e5c-32c4ab7192ae admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:35.662941 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 874/1735] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:56:35 2022] PUT /identity/v3/projects/dd773f59921d4e6e9c2a95e6b08dd85e/users/9a46e57644d0404f9c228f5d270225b8/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:35.664902 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44542b95-d970-4fce-9a5f-a99eb7e6840d admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:35.674471 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40ee15-b971-42c3-8e5c-32c4ab7192ae admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:35.798231 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f09f89-e803-486b-919d-9a9c5f4d75da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:35.800388 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f09f89-e803-486b-919d-9a9c5f4d75da service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:35.808482 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f09f89-e803-486b-919d-9a9c5f4d75da service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:35.809108 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f09f89-e803-486b-919d-9a9c5f4d75da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:35.819947 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f09f89-e803-486b-919d-9a9c5f4d75da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:35.822885 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f09f89-e803-486b-919d-9a9c5f4d75da service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:35.851857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 862/1736] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:35.854046 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f09f89-e803-486b-919d-9a9c5f4d75da service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:35.870506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44542b95-d970-4fce-9a5f-a99eb7e6840d admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:35.885310 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f09f89-e803-486b-919d-9a9c5f4d75da service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:35.899181 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a928a23-83fd-4194-81af-ffdd4f8c3c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:35.900688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a928a23-83fd-4194-81af-ffdd4f8c3c66 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:35.901079 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a928a23-83fd-4194-81af-ffdd4f8c3c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:35.901787 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a928a23-83fd-4194-81af-ffdd4f8c3c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:35.904255 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a928a23-83fd-4194-81af-ffdd4f8c3c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:35.906486 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a256f-0499-4bf4-9528-5f25440c9faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:35.907226 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a256f-0499-4bf4-9528-5f25440c9faf admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:35.907522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a256f-0499-4bf4-9528-5f25440c9faf admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:35.913827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a928a23-83fd-4194-81af-ffdd4f8c3c66 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:35.914176 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a256f-0499-4bf4-9528-5f25440c9faf admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:35.914176 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a256f-0499-4bf4-9528-5f25440c9faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:35.914176 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a256f-0499-4bf4-9528-5f25440c9faf admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:35.932348 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 863/1737] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:35 2022] GET /identity/v3/roles => generated 1427 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:35.939536 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb690a41-a9fd-428c-ad0e-9512eeaac590 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:35.939813 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb690a41-a9fd-428c-ad0e-9512eeaac590 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:35.940140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb690a41-a9fd-428c-ad0e-9512eeaac590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:35.947892 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 875/1738] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:35 2022] GET /identity/v3/roles => generated 1427 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:35.952602 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a256f-0499-4bf4-9528-5f25440c9faf admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:35.990505 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a256f-0499-4bf4-9528-5f25440c9faf admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:36.003396 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-cb690a41-a9fd-428c-ad0e-9512eeaac590 None None] MFA Rules not processed for user `9a46e57644d0404f9c228f5d270225b8`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:36.006250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-cb690a41-a9fd-428c-ad0e-9512eeaac590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:36.007602 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f682a-b4f3-42dc-bb24-123f97c75be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:36.008570 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f682a-b4f3-42dc-bb24-123f97c75be4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:36.008861 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f682a-b4f3-42dc-bb24-123f97c75be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:36.009320 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f682a-b4f3-42dc-bb24-123f97c75be4 admin admin] PATH_INFO: `/v3/projects/b8a305f3df9b49519fe849399489a67e/users/dc65cd059e024a23a512a4f66c02b751/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:36.055402 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f682a-b4f3-42dc-bb24-123f97c75be4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8a305f3df9b49519fe849399489a67e, user_id=dc65cd059e024a23a512a4f66c02b751, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:36.058663 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f682a-b4f3-42dc-bb24-123f97c75be4 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:36.191613 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 864/1739] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:36.192624 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb690a41-a9fd-428c-ad0e-9512eeaac590 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:36.244874 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb690a41-a9fd-428c-ad0e-9512eeaac590 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:36.245772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 876/1740] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:56:35 2022] PUT /identity/v3/projects/b8a305f3df9b49519fe849399489a67e/users/dc65cd059e024a23a512a4f66c02b751/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:36.247514 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f682a-b4f3-42dc-bb24-123f97c75be4 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:36.251179 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-910f682a-b4f3-42dc-bb24-123f97c75be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:36.379607 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f682a-b4f3-42dc-bb24-123f97c75be4 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:36.392013 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60df402-15b4-4210-8b0a-9019e90819ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:36.392814 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60df402-15b4-4210-8b0a-9019e90819ad service nova] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:36.393289 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60df402-15b4-4210-8b0a-9019e90819ad service nova] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:36.393583 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60df402-15b4-4210-8b0a-9019e90819ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:36.398669 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bd430-4055-4ca9-a0a8-e6802165eb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:36.399537 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bd430-4055-4ca9-a0a8-e6802165eb83 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:36.399927 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bd430-4055-4ca9-a0a8-e6802165eb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:36.400354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bd430-4055-4ca9-a0a8-e6802165eb83 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:36.401195 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320bd430-4055-4ca9-a0a8-e6802165eb83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:36.403029 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320bd430-4055-4ca9-a0a8-e6802165eb83 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:36.437360 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 865/1741] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:36 2022] GET /identity/v3/roles => generated 1427 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:36.439207 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b84b2e-e19a-42e4-a9e8-61eee8c362ce None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:36.450154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b84b2e-e19a-42e4-a9e8-61eee8c362ce None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:36.450154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b84b2e-e19a-42e4-a9e8-61eee8c362ce None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:36.450154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 866/1742] 10.222.0.119 () {54 vars in 965 bytes} [Thu Jul 14 15:56:36 2022] GET /identity => generated 271 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:56:36.450154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b84b2e-e19a-42e4-a9e8-61eee8c362ce None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:36.453849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-47b84b2e-e19a-42e4-a9e8-61eee8c362ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:36.499251 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60df402-15b4-4210-8b0a-9019e90819ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:36.501426 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60df402-15b4-4210-8b0a-9019e90819ad service nova] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:36.515386 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 877/1743] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:36.516692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d475f7-8d19-4856-ae3e-7bb1ecb6ba1c None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:36.517100 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d475f7-8d19-4856-ae3e-7bb1ecb6ba1c None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:36.517393 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d475f7-8d19-4856-ae3e-7bb1ecb6ba1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:36.554124 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-a7d475f7-8d19-4856-ae3e-7bb1ecb6ba1c None None] MFA Rules not processed for user `dc65cd059e024a23a512a4f66c02b751`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:36.555588 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-a7d475f7-8d19-4856-ae3e-7bb1ecb6ba1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:36.602251 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b84b2e-e19a-42e4-a9e8-61eee8c362ce None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:36.607123 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990850e-7192-4d17-bb5f-b11f2b2a7005 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:36.608017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990850e-7192-4d17-bb5f-b11f2b2a7005 service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:36.608475 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990850e-7192-4d17-bb5f-b11f2b2a7005 service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:36.608943 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990850e-7192-4d17-bb5f-b11f2b2a7005 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:36.665810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 878/1744] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:36 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:36.666644 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d475f7-8d19-4856-ae3e-7bb1ecb6ba1c None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:36.687238 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d475f7-8d19-4856-ae3e-7bb1ecb6ba1c None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:36.697895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc40c5d-9efe-498a-9c1d-dd5f8c874f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:36.699468 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc40c5d-9efe-498a-9c1d-dd5f8c874f4d admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:36.699764 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc40c5d-9efe-498a-9c1d-dd5f8c874f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:36.700051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc40c5d-9efe-498a-9c1d-dd5f8c874f4d admin admin] PATH_INFO: `/v3/projects/d52bf23e6c5546a8a905ae46e862eb55/users/1bce8e22418748369ec85428835e039a/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:36.714507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990850e-7192-4d17-bb5f-b11f2b2a7005 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:36.717628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990850e-7192-4d17-bb5f-b11f2b2a7005 service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:36.718512 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc40c5d-9efe-498a-9c1d-dd5f8c874f4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d52bf23e6c5546a8a905ae46e862eb55, user_id=1bce8e22418748369ec85428835e039a, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:36.733808 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc40c5d-9efe-498a-9c1d-dd5f8c874f4d admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:36.740856 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 867/1745] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:36 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:36.743424 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8455fc-8242-498d-98bd-beec94b6a5e4 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:36.743768 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8455fc-8242-498d-98bd-beec94b6a5e4 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:36.744057 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8455fc-8242-498d-98bd-beec94b6a5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:36.789534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-bf8455fc-8242-498d-98bd-beec94b6a5e4 None None] MFA Rules not processed for user `716cbbfeede34885b0411e5b9b25df47`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:36.791416 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-bf8455fc-8242-498d-98bd-beec94b6a5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:36.857186 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 879/1746] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:56:36 2022] PUT /identity/v3/projects/d52bf23e6c5546a8a905ae46e862eb55/users/1bce8e22418748369ec85428835e039a/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:36.857186 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc40c5d-9efe-498a-9c1d-dd5f8c874f4d admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:36.959810 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 868/1747] 10.222.0.119 () {58 vars in 1062 bytes} [Thu Jul 14 15:56:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:36.961208 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b98e3-d068-4e87-a0c9-8c4f1a21501b None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:36.961489 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b98e3-d068-4e87-a0c9-8c4f1a21501b None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:36.961771 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b98e3-d068-4e87-a0c9-8c4f1a21501b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:37.049497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-969b98e3-d068-4e87-a0c9-8c4f1a21501b None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:37.050765 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-969b98e3-d068-4e87-a0c9-8c4f1a21501b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:37.120358 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc40c5d-9efe-498a-9c1d-dd5f8c874f4d admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:37.126299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3cac80-1797-4d5a-97d5-021b2231d87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:37.127048 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cac80-1797-4d5a-97d5-021b2231d87b admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:37.127347 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cac80-1797-4d5a-97d5-021b2231d87b admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:37.127633 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cac80-1797-4d5a-97d5-021b2231d87b admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:37.140361 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3cac80-1797-4d5a-97d5-021b2231d87b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:37.142838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3cac80-1797-4d5a-97d5-021b2231d87b admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:37.160455 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:37.189630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 869/1748] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:37.190615 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b98e3-d068-4e87-a0c9-8c4f1a21501b None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:37.266513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b98e3-d068-4e87-a0c9-8c4f1a21501b None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:37.279730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b1dfd-d12d-4967-9076-48edb85b823c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716cbbfeede34885b0411e5b9b25df47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:37.280499 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b1dfd-d12d-4967-9076-48edb85b823c service placement] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:37.280791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b1dfd-d12d-4967-9076-48edb85b823c service placement] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:37.281102 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b1dfd-d12d-4967-9076-48edb85b823c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:37.283181 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-dd2b1dfd-d12d-4967-9076-48edb85b823c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:37.295524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b1dfd-d12d-4967-9076-48edb85b823c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:37.297523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b1dfd-d12d-4967-9076-48edb85b823c service placement] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:37.312772 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 870/1749] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:37.313747 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b1dfd-d12d-4967-9076-48edb85b823c service placement] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:37.316496 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-dd2b1dfd-d12d-4967-9076-48edb85b823c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:37.331782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b1dfd-d12d-4967-9076-48edb85b823c service placement] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:37.340012 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587256c-7d85-4ce0-9fc7-8b97ad6ae3c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716cbbfeede34885b0411e5b9b25df47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:37.343913 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587256c-7d85-4ce0-9fc7-8b97ad6ae3c1 service placement] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:37.343913 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587256c-7d85-4ce0-9fc7-8b97ad6ae3c1 service placement] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:37.350522 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587256c-7d85-4ce0-9fc7-8b97ad6ae3c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:37.354643 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 880/1750] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:56:36 2022] POST /identity/v3/projects => generated 408 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:37.355526 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3cac80-1797-4d5a-97d5-021b2231d87b admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:37.362544 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9587256c-7d85-4ce0-9fc7-8b97ad6ae3c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:37.364302 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9587256c-7d85-4ce0-9fc7-8b97ad6ae3c1 service placement] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:37.379850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 871/1751] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:37.381703 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf5b5e-7dd1-444c-b8dd-cd540f9b6c26 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:37.382233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf5b5e-7dd1-444c-b8dd-cd540f9b6c26 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:37.382660 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf5b5e-7dd1-444c-b8dd-cd540f9b6c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:37.407207 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-16cf5b5e-7dd1-444c-b8dd-cd540f9b6c26 None None] MFA Rules not processed for user `fe6f58bedd87454bad46b0c48697eec9`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:37.409379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-16cf5b5e-7dd1-444c-b8dd-cd540f9b6c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:37.552519 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 872/1752] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:37.554174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf5b5e-7dd1-444c-b8dd-cd540f9b6c26 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:37.617921 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3cac80-1797-4d5a-97d5-021b2231d87b admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:37.639560 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb97982-72e2-4906-b873-d1ef8155a9b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:37.640207 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb97982-72e2-4906-b873-d1ef8155a9b7 service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:37.640495 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb97982-72e2-4906-b873-d1ef8155a9b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:37.640780 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb97982-72e2-4906-b873-d1ef8155a9b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:37.648433 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-9cb97982-72e2-4906-b873-d1ef8155a9b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:37.756750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf5b5e-7dd1-444c-b8dd-cd540f9b6c26 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:37.763179 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b34f7-8ff1-4622-84c0-aeabaa67ea54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:37.764338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b34f7-8ff1-4622-84c0-aeabaa67ea54 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:37.764811 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b34f7-8ff1-4622-84c0-aeabaa67ea54 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:37.765182 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b34f7-8ff1-4622-84c0-aeabaa67ea54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:37.913346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb97982-72e2-4906-b873-d1ef8155a9b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:37.914770 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb97982-72e2-4906-b873-d1ef8155a9b7 service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:37.920280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b34f7-8ff1-4622-84c0-aeabaa67ea54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:37.922341 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b34f7-8ff1-4622-84c0-aeabaa67ea54 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:37.951219 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 873/1753] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:37.952617 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b34f7-8ff1-4622-84c0-aeabaa67ea54 service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:37.986983 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 881/1754] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:37 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:37.988439 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acc46e-b762-42ae-81e6-3caa2d816d0c None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:37.988583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b34f7-8ff1-4622-84c0-aeabaa67ea54 service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:37.993282 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acc46e-b762-42ae-81e6-3caa2d816d0c None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:37.993587 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acc46e-b762-42ae-81e6-3caa2d816d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:37.997887 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabad7c1-34d7-4081-8a79-c121d37385e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:37.998907 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabad7c1-34d7-4081-8a79-c121d37385e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:37.999228 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabad7c1-34d7-4081-8a79-c121d37385e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:37.999623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabad7c1-34d7-4081-8a79-c121d37385e0 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:38.000670 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabad7c1-34d7-4081-8a79-c121d37385e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:38.004225 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabad7c1-34d7-4081-8a79-c121d37385e0 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:38.069259 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-c8acc46e-b762-42ae-81e6-3caa2d816d0c None None] MFA Rules not processed for user `b0d02887422a43e4bb69566a2d64e890`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:38.070496 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-c8acc46e-b762-42ae-81e6-3caa2d816d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:38.156664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 874/1755] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:56:37 2022] POST /identity/v3/users => generated 311 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:38.160087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabad7c1-34d7-4081-8a79-c121d37385e0 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:38.220358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabad7c1-34d7-4081-8a79-c121d37385e0 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:38.258955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94277d80-5a8a-4d46-89df-a3174b871bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:38.265695 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94277d80-5a8a-4d46-89df-a3174b871bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:38.266440 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94277d80-5a8a-4d46-89df-a3174b871bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:38.267472 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94277d80-5a8a-4d46-89df-a3174b871bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:38.268477 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94277d80-5a8a-4d46-89df-a3174b871bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:38.276708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94277d80-5a8a-4d46-89df-a3174b871bd4 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:38.279771 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 882/1756] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:38.340802 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acc46e-b762-42ae-81e6-3caa2d816d0c None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:38.342151 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 875/1757] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:38 2022] GET /identity/v3/roles => generated 1427 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:38.366977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acc46e-b762-42ae-81e6-3caa2d816d0c None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:38.382129 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb251ba-e98c-4b9c-940e-d0e7903519be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:38.383234 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb251ba-e98c-4b9c-940e-d0e7903519be admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:38.383708 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb251ba-e98c-4b9c-940e-d0e7903519be admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:38.384255 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb251ba-e98c-4b9c-940e-d0e7903519be admin admin] PATH_INFO: `/v3/projects/bbaad5c135314098a75cb06a3f85ae3e/users/9a112d4433b841d0b681e0c164650089/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:38.431308 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb251ba-e98c-4b9c-940e-d0e7903519be admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbaad5c135314098a75cb06a3f85ae3e, user_id=9a112d4433b841d0b681e0c164650089, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:38.439162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb251ba-e98c-4b9c-940e-d0e7903519be admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:38.597376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94277d80-5a8a-4d46-89df-a3174b871bd4 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:38.597533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 883/1758] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:56:38 2022] PUT /identity/v3/projects/bbaad5c135314098a75cb06a3f85ae3e/users/9a112d4433b841d0b681e0c164650089/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:38.612489 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94277d80-5a8a-4d46-89df-a3174b871bd4 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:38.647209 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:38.844867 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866650dc-e396-4568-a1c4-0cb27a073792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:38.845764 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866650dc-e396-4568-a1c4-0cb27a073792 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:38.846045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866650dc-e396-4568-a1c4-0cb27a073792 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:38.846326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866650dc-e396-4568-a1c4-0cb27a073792 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:38.847118 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866650dc-e396-4568-a1c4-0cb27a073792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:38.848800 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866650dc-e396-4568-a1c4-0cb27a073792 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:38.872321 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 876/1759] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:38 2022] GET /identity/v3/roles => generated 1427 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:38.873659 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb251ba-e98c-4b9c-940e-d0e7903519be admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:38.892473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb251ba-e98c-4b9c-940e-d0e7903519be admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:38.908195 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13990b6b-5063-4036-a95a-cd46f0a7aeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:38.909375 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13990b6b-5063-4036-a95a-cd46f0a7aeb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:38.909801 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13990b6b-5063-4036-a95a-cd46f0a7aeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:38.910553 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13990b6b-5063-4036-a95a-cd46f0a7aeb2 admin admin] PATH_INFO: `/v3/projects/bbaad5c135314098a75cb06a3f85ae3e/users/9a112d4433b841d0b681e0c164650089/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:38.917235 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13990b6b-5063-4036-a95a-cd46f0a7aeb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbaad5c135314098a75cb06a3f85ae3e, user_id=9a112d4433b841d0b681e0c164650089, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:38.920292 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13990b6b-5063-4036-a95a-cd46f0a7aeb2 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:38.968566 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 884/1760] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:56:38 2022] PUT /identity/v3/projects/bbaad5c135314098a75cb06a3f85ae3e/users/9a112d4433b841d0b681e0c164650089/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:38.973798 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ea356-8d12-45fe-8f10-b4d84731ac8e None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:38.975707 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ea356-8d12-45fe-8f10-b4d84731ac8e None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:38.976318 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ea356-8d12-45fe-8f10-b4d84731ac8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:39.057420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-0f6ea356-8d12-45fe-8f10-b4d84731ac8e None None] MFA Rules not processed for user `9a112d4433b841d0b681e0c164650089`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:39.066892 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-0f6ea356-8d12-45fe-8f10-b4d84731ac8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:39.217035 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 877/1761] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:38 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:39.228628 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13990b6b-5063-4036-a95a-cd46f0a7aeb2 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:39.326998 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13990b6b-5063-4036-a95a-cd46f0a7aeb2 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:39.342185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bc206-84a8-43d8-a661-2d3a0f27aaa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:39.343197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bc206-84a8-43d8-a661-2d3a0f27aaa7 service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:39.343791 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bc206-84a8-43d8-a661-2d3a0f27aaa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:39.344290 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bc206-84a8-43d8-a661-2d3a0f27aaa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:39.363528 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bc206-84a8-43d8-a661-2d3a0f27aaa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:39.366275 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bc206-84a8-43d8-a661-2d3a0f27aaa7 service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:39.429859 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 885/1762] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:39 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:40.293531 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ea356-8d12-45fe-8f10-b4d84731ac8e None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:40.298545 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-0f6ea356-8d12-45fe-8f10-b4d84731ac8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:40.327171 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ea356-8d12-45fe-8f10-b4d84731ac8e None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:40.338467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4b8cd-415b-4b79-a9da-a344dce58664 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:40.341076 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4b8cd-415b-4b79-a9da-a344dce58664 service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:40.341629 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4b8cd-415b-4b79-a9da-a344dce58664 service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:40.342996 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4b8cd-415b-4b79-a9da-a344dce58664 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:40.481515 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4b8cd-415b-4b79-a9da-a344dce58664 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:40.487977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4b8cd-415b-4b79-a9da-a344dce58664 service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:40.528082 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 878/1763] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:40 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:41.782705 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:41.797457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969f888-a0de-4435-871e-fa1c30acc592 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:41.798348 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969f888-a0de-4435-871e-fa1c30acc592 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:41.798806 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969f888-a0de-4435-871e-fa1c30acc592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:41.864978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-f969f888-a0de-4435-871e-fa1c30acc592 None None] MFA Rules not processed for user `1bce8e22418748369ec85428835e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:41.867171 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f969f888-a0de-4435-871e-fa1c30acc592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:41.970632 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:41.982513 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 886/1764] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:41.987183 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4b8cd-415b-4b79-a9da-a344dce58664 service cinder] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:42.093013 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4b8cd-415b-4b79-a9da-a344dce58664 service cinder] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:42.097770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83097b-589b-4514-a456-8592a4b97671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:42.098445 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83097b-589b-4514-a456-8592a4b97671 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:42.098901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83097b-589b-4514-a456-8592a4b97671 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:42.100090 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83097b-589b-4514-a456-8592a4b97671 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:42.101255 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83097b-589b-4514-a456-8592a4b97671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:42.108837 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83097b-589b-4514-a456-8592a4b97671 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:42.112992 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd5e2c-88ad-47b2-8178-c866325022d7 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:42.113514 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd5e2c-88ad-47b2-8178-c866325022d7 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:42.113980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd5e2c-88ad-47b2-8178-c866325022d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:42.133797 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-c2fd5e2c-88ad-47b2-8178-c866325022d7 None None] MFA Rules not processed for user `6bbbf243c1334013ac235aa5b0853621`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:42.135186 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-c2fd5e2c-88ad-47b2-8178-c866325022d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:42.202913 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 887/1765] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:56:42.216381 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 879/1766] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:56:41 2022] POST /identity/v3/projects => generated 374 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:42.221313 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd5e2c-88ad-47b2-8178-c866325022d7 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:42.233815 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd5e2c-88ad-47b2-8178-c866325022d7 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:42.303061 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad4c28-14b1-4135-99f2-16615c48ea97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:42.303617 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad4c28-14b1-4135-99f2-16615c48ea97 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:42.304387 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad4c28-14b1-4135-99f2-16615c48ea97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:42.304387 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad4c28-14b1-4135-99f2-16615c48ea97 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:42.304988 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad4c28-14b1-4135-99f2-16615c48ea97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:42.306925 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad4c28-14b1-4135-99f2-16615c48ea97 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:42.460017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 888/1767] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:56:42 2022] POST /identity/v3/users => generated 294 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:56:42.464376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83097b-589b-4514-a456-8592a4b97671 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:42.476509 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83097b-589b-4514-a456-8592a4b97671 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:42.482029 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ca013-a39c-4f04-82d5-1ddec937da28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:42.482714 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ca013-a39c-4f04-82d5-1ddec937da28 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:42.483011 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ca013-a39c-4f04-82d5-1ddec937da28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:42.483293 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ca013-a39c-4f04-82d5-1ddec937da28 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:42.484069 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ca013-a39c-4f04-82d5-1ddec937da28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:42.485896 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ca013-a39c-4f04-82d5-1ddec937da28 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:42.502650 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 880/1768] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:42 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:56:42.507147 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad4c28-14b1-4135-99f2-16615c48ea97 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:42.518197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad4c28-14b1-4135-99f2-16615c48ea97 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:42.539742 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6cae4-b3c5-4448-9710-a24d4ed193f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:42.540696 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6cae4-b3c5-4448-9710-a24d4ed193f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:42.541182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6cae4-b3c5-4448-9710-a24d4ed193f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:42.541472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6cae4-b3c5-4448-9710-a24d4ed193f9 admin admin] PATH_INFO: `/v3/projects/f0fa9e6624a84ae6adcf2dbd35045b26/users/36076feefe304dfdbe4700edec1d32f6/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:42.562844 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6cae4-b3c5-4448-9710-a24d4ed193f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0fa9e6624a84ae6adcf2dbd35045b26, user_id=36076feefe304dfdbe4700edec1d32f6, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:42.565744 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6cae4-b3c5-4448-9710-a24d4ed193f9 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:42.584308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:42.639716 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 889/1769] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:56:42 2022] PUT /identity/v3/projects/f0fa9e6624a84ae6adcf2dbd35045b26/users/36076feefe304dfdbe4700edec1d32f6/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:42.648582 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ca013-a39c-4f04-82d5-1ddec937da28 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:42.665674 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ca013-a39c-4f04-82d5-1ddec937da28 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:42.738250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086c5e1-0fac-47b8-ba44-7553dd7110a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:42.738947 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086c5e1-0fac-47b8-ba44-7553dd7110a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:42.740466 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086c5e1-0fac-47b8-ba44-7553dd7110a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:42.740830 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086c5e1-0fac-47b8-ba44-7553dd7110a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:42.741883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086c5e1-0fac-47b8-ba44-7553dd7110a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:42.743693 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086c5e1-0fac-47b8-ba44-7553dd7110a9 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:42.763628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 881/1770] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:56:42 2022] GET /identity/v3/roles => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:56:42.768429 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6cae4-b3c5-4448-9710-a24d4ed193f9 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:42.781557 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6cae4-b3c5-4448-9710-a24d4ed193f9 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:42.796549 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26ef75-a054-47aa-8d75-c03df533eff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:42.797583 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26ef75-a054-47aa-8d75-c03df533eff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:42.798149 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26ef75-a054-47aa-8d75-c03df533eff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:42.798237 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26ef75-a054-47aa-8d75-c03df533eff8 admin admin] PATH_INFO: `/v3/projects/f0fa9e6624a84ae6adcf2dbd35045b26/users/36076feefe304dfdbe4700edec1d32f6/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:42.800817 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26ef75-a054-47aa-8d75-c03df533eff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0fa9e6624a84ae6adcf2dbd35045b26, user_id=36076feefe304dfdbe4700edec1d32f6, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:42.805202 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26ef75-a054-47aa-8d75-c03df533eff8 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:42.820146 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 890/1771] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:56:42 2022] PUT /identity/v3/projects/f0fa9e6624a84ae6adcf2dbd35045b26/users/36076feefe304dfdbe4700edec1d32f6/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:56:43.265386 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:43.398090 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:44.428216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9fefd-e0e4-419e-94cd-53448bcd2d5c None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:44.429922 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9fefd-e0e4-419e-94cd-53448bcd2d5c None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:44.430376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9fefd-e0e4-419e-94cd-53448bcd2d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:44.461592 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-90f9fefd-e0e4-419e-94cd-53448bcd2d5c None None] MFA Rules not processed for user `36076feefe304dfdbe4700edec1d32f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:44.462962 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-90f9fefd-e0e4-419e-94cd-53448bcd2d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:44.580552 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 882/1772] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:56:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:44.594647 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26ef75-a054-47aa-8d75-c03df533eff8 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:44.663920 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26ef75-a054-47aa-8d75-c03df533eff8 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:44.670720 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d8513-47f7-48d8-a824-2224ea46cdcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:44.671392 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d8513-47f7-48d8-a824-2224ea46cdcf service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:44.671856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d8513-47f7-48d8-a824-2224ea46cdcf service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:44.672349 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d8513-47f7-48d8-a824-2224ea46cdcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:44.732711 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d8513-47f7-48d8-a824-2224ea46cdcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:44.734449 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d8513-47f7-48d8-a824-2224ea46cdcf service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:44.745811 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 891/1773] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:45.876972 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:45.974736 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:46.922471 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:47.664969 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9fefd-e0e4-419e-94cd-53448bcd2d5c None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:47.674569 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9fefd-e0e4-419e-94cd-53448bcd2d5c None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:47.679571 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666a05d-6006-4df0-9fdc-70f87991a7e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:47.680273 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666a05d-6006-4df0-9fdc-70f87991a7e1 service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:47.680581 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666a05d-6006-4df0-9fdc-70f87991a7e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:47.680863 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666a05d-6006-4df0-9fdc-70f87991a7e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:47.690756 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666a05d-6006-4df0-9fdc-70f87991a7e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:47.692225 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666a05d-6006-4df0-9fdc-70f87991a7e1 service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:47.702432 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 883/1774] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:56:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:48.145610 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:49.459011 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:49.816591 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561b5e5-a9bb-478a-ba51-46315c41cf14 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:49.817497 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561b5e5-a9bb-478a-ba51-46315c41cf14 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:49.818642 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561b5e5-a9bb-478a-ba51-46315c41cf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:49.877341 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-4561b5e5-a9bb-478a-ba51-46315c41cf14 None None] MFA Rules not processed for user `4a1474b39e0b477daff5833491cd6df5`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:56:49.879156 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-4561b5e5-a9bb-478a-ba51-46315c41cf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:49.979015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 892/1775] 10.222.0.119 () {58 vars in 1014 bytes} [Thu Jul 14 15:56:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:56:50.434917 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666a05d-6006-4df0-9fdc-70f87991a7e1 service cinder] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:50.436745 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-d666a05d-6006-4df0-9fdc-70f87991a7e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:50.574021 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666a05d-6006-4df0-9fdc-70f87991a7e1 service cinder] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:50.581914 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c2d74-a2b9-45e2-8c3c-94dc12654fa6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a5c169576e432c8174a562ae358e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:50.582928 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c2d74-a2b9-45e2-8c3c-94dc12654fa6 service swift] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:50.583346 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c2d74-a2b9-45e2-8c3c-94dc12654fa6 service swift] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:50.583727 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c2d74-a2b9-45e2-8c3c-94dc12654fa6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:50.596865 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c2d74-a2b9-45e2-8c3c-94dc12654fa6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:50.599482 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c2d74-a2b9-45e2-8c3c-94dc12654fa6 service swift] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:50.621737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 884/1776] 10.222.0.119 () {60 vars in 1389 bytes} [Thu Jul 14 15:56:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:56:51.234977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:51.323597 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:52.183498 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:52.728138 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:52.762129 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:53.881226 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:53.929299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:54.705342 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:02.015358 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561b5e5-a9bb-478a-ba51-46315c41cf14 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:02.113956 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561b5e5-a9bb-478a-ba51-46315c41cf14 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:02.119891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa76a05-958d-4123-8bd2-b54c4589a106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:02.120805 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa76a05-958d-4123-8bd2-b54c4589a106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:02.121289 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa76a05-958d-4123-8bd2-b54c4589a106 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:02.121887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa76a05-958d-4123-8bd2-b54c4589a106 admin admin] PATH_INFO: `/v3/users/dc65cd059e024a23a512a4f66c02b751` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:02.123260 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa76a05-958d-4123-8bd2-b54c4589a106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc65cd059e024a23a512a4f66c02b751)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:02.125818 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa76a05-958d-4123-8bd2-b54c4589a106 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:02.411072 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-efa76a05-958d-4123-8bd2-b54c4589a106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc65cd059e024a23a512a4f66c02b751'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:02.420249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-efa76a05-958d-4123-8bd2-b54c4589a106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc65cd059e024a23a512a4f66c02b751'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:02.424761 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-efa76a05-958d-4123-8bd2-b54c4589a106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc65cd059e024a23a512a4f66c02b751'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:02.432586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-efa76a05-958d-4123-8bd2-b54c4589a106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc65cd059e024a23a512a4f66c02b751'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:02.433286 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-efa76a05-958d-4123-8bd2-b54c4589a106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc65cd059e024a23a512a4f66c02b751'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:02.436849 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:02.601571 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 893/1777] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:57:02 2022] DELETE /identity/v3/users/dc65cd059e024a23a512a4f66c02b751 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:02.606330 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6123ba-f3d6-4da2-89e4-6b597e64a398 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:02.606844 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6123ba-f3d6-4da2-89e4-6b597e64a398 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:02.606934 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6123ba-f3d6-4da2-89e4-6b597e64a398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:02.625000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-db6123ba-f3d6-4da2-89e4-6b597e64a398 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:02.626351 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-db6123ba-f3d6-4da2-89e4-6b597e64a398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:02.652038 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:02.687746 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 885/1778] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:02.697674 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa76a05-958d-4123-8bd2-b54c4589a106 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:02.699270 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-efa76a05-958d-4123-8bd2-b54c4589a106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:02.756349 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa76a05-958d-4123-8bd2-b54c4589a106 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:02.759975 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582739b-6cce-4c97-8ef8-bd3902d6de95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:02.760783 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582739b-6cce-4c97-8ef8-bd3902d6de95 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:02.761068 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582739b-6cce-4c97-8ef8-bd3902d6de95 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:02.761345 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582739b-6cce-4c97-8ef8-bd3902d6de95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:02.775545 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582739b-6cce-4c97-8ef8-bd3902d6de95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:02.777128 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582739b-6cce-4c97-8ef8-bd3902d6de95 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:02.788088 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 894/1779] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:57:03.274014 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6123ba-f3d6-4da2-89e4-6b597e64a398 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:03.277541 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-db6123ba-f3d6-4da2-89e4-6b597e64a398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:03.305098 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6123ba-f3d6-4da2-89e4-6b597e64a398 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:03.317440 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742dadd8-f3fd-456f-8d11-1a12bd74d07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:03.322209 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742dadd8-f3fd-456f-8d11-1a12bd74d07c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:03.322669 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742dadd8-f3fd-456f-8d11-1a12bd74d07c admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:03.324132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742dadd8-f3fd-456f-8d11-1a12bd74d07c admin admin] PATH_INFO: `/v3/projects/b8a305f3df9b49519fe849399489a67e` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:03.328914 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742dadd8-f3fd-456f-8d11-1a12bd74d07c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8a305f3df9b49519fe849399489a67e)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:03.346782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742dadd8-f3fd-456f-8d11-1a12bd74d07c admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:03.555452 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-742dadd8-f3fd-456f-8d11-1a12bd74d07c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8a305f3df9b49519fe849399489a67e', 'request_id': 'req-742dadd8-f3fd-456f-8d11-1a12bd74d07c'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:03.574068 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-742dadd8-f3fd-456f-8d11-1a12bd74d07c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8a305f3df9b49519fe849399489a67e', 'request_id': 'req-742dadd8-f3fd-456f-8d11-1a12bd74d07c'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:03.669544 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-742dadd8-f3fd-456f-8d11-1a12bd74d07c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8a305f3df9b49519fe849399489a67e', 'request_id': 'req-742dadd8-f3fd-456f-8d11-1a12bd74d07c'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:03.686476 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-742dadd8-f3fd-456f-8d11-1a12bd74d07c admin admin] The token cache is being invalidate because project b8a305f3df9b49519fe849399489a67e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:57:03.686780 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-742dadd8-f3fd-456f-8d11-1a12bd74d07c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:03.687577 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-742dadd8-f3fd-456f-8d11-1a12bd74d07c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:03.698644 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 886/1780] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:57:03 2022] DELETE /identity/v3/projects/b8a305f3df9b49519fe849399489a67e => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:03.699862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582739b-6cce-4c97-8ef8-bd3902d6de95 service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:03.710301 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582739b-6cce-4c97-8ef8-bd3902d6de95 service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:03.767225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf988e-856e-4c40-ad90-a07b77fd7c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:03.768119 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf988e-856e-4c40-ad90-a07b77fd7c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:03.768420 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf988e-856e-4c40-ad90-a07b77fd7c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:03.768701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf988e-856e-4c40-ad90-a07b77fd7c6e admin admin] PATH_INFO: `/v3/users/9a112d4433b841d0b681e0c164650089` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:03.769950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf988e-856e-4c40-ad90-a07b77fd7c6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a112d4433b841d0b681e0c164650089)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:03.772015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf988e-856e-4c40-ad90-a07b77fd7c6e admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:03.948764 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-acaf988e-856e-4c40-ad90-a07b77fd7c6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a112d4433b841d0b681e0c164650089'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:03.949420 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-acaf988e-856e-4c40-ad90-a07b77fd7c6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a112d4433b841d0b681e0c164650089'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:03.961925 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-acaf988e-856e-4c40-ad90-a07b77fd7c6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a112d4433b841d0b681e0c164650089'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:03.968860 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-acaf988e-856e-4c40-ad90-a07b77fd7c6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a112d4433b841d0b681e0c164650089'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:03.969665 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-acaf988e-856e-4c40-ad90-a07b77fd7c6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a112d4433b841d0b681e0c164650089'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:04.043394 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 895/1781] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:57:03 2022] DELETE /identity/v3/users/9a112d4433b841d0b681e0c164650089 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:04.439145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21826087-8b38-43f0-a869-f6e28343f739 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:04.439894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21826087-8b38-43f0-a869-f6e28343f739 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:04.440638 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21826087-8b38-43f0-a869-f6e28343f739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:04.462612 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-21826087-8b38-43f0-a869-f6e28343f739 None None] MFA Rules not processed for user `70559c2ce32043dd9a902837ab444622`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:04.463928 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-21826087-8b38-43f0-a869-f6e28343f739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:04.524447 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 887/1782] 10.222.0.121 () {58 vars in 1020 bytes} [Thu Jul 14 15:57:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:04.541264 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf988e-856e-4c40-ad90-a07b77fd7c6e admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:04.542640 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-acaf988e-856e-4c40-ad90-a07b77fd7c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:04.588924 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:04.658424 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf988e-856e-4c40-ad90-a07b77fd7c6e admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:04.668400 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc865bd1-9b1a-40da-9f47-7e3b71cb1e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:04.670037 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc865bd1-9b1a-40da-9f47-7e3b71cb1e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:04.670748 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc865bd1-9b1a-40da-9f47-7e3b71cb1e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:04.670748 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc865bd1-9b1a-40da-9f47-7e3b71cb1e1c admin admin] PATH_INFO: `/v3/projects/bbaad5c135314098a75cb06a3f85ae3e` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:04.671900 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc865bd1-9b1a-40da-9f47-7e3b71cb1e1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbaad5c135314098a75cb06a3f85ae3e)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:04.674460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc865bd1-9b1a-40da-9f47-7e3b71cb1e1c admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:04.730035 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21826087-8b38-43f0-a869-f6e28343f739 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:04.731728 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-21826087-8b38-43f0-a869-f6e28343f739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:04.748296 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21826087-8b38-43f0-a869-f6e28343f739 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:04.753676 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688873b-ae9d-42bb-a530-316d4ca3994b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:04.754579 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688873b-ae9d-42bb-a530-316d4ca3994b service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:04.754738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688873b-ae9d-42bb-a530-316d4ca3994b service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:04.755017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688873b-ae9d-42bb-a530-316d4ca3994b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:04.769734 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688873b-ae9d-42bb-a530-316d4ca3994b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:04.772742 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688873b-ae9d-42bb-a530-316d4ca3994b service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:04.785712 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 888/1783] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:57:04.786704 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688873b-ae9d-42bb-a530-316d4ca3994b service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:04.805209 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688873b-ae9d-42bb-a530-316d4ca3994b service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:04.812058 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2312c7-e0ad-487c-a084-54054b7cec75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:04.812971 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2312c7-e0ad-487c-a084-54054b7cec75 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:04.813562 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2312c7-e0ad-487c-a084-54054b7cec75 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:04.813859 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2312c7-e0ad-487c-a084-54054b7cec75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:04.824439 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2312c7-e0ad-487c-a084-54054b7cec75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:04.827108 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2312c7-e0ad-487c-a084-54054b7cec75 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:04.839263 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 889/1784] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:57:04.840242 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2312c7-e0ad-487c-a084-54054b7cec75 service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:04.859400 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2312c7-e0ad-487c-a084-54054b7cec75 service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:04.867511 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-dc865bd1-9b1a-40da-9f47-7e3b71cb1e1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbaad5c135314098a75cb06a3f85ae3e', 'request_id': 'req-dc865bd1-9b1a-40da-9f47-7e3b71cb1e1c'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:04.883405 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-dc865bd1-9b1a-40da-9f47-7e3b71cb1e1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbaad5c135314098a75cb06a3f85ae3e', 'request_id': 'req-dc865bd1-9b1a-40da-9f47-7e3b71cb1e1c'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:04.894564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-dc865bd1-9b1a-40da-9f47-7e3b71cb1e1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbaad5c135314098a75cb06a3f85ae3e', 'request_id': 'req-dc865bd1-9b1a-40da-9f47-7e3b71cb1e1c'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:04.915136 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:04.940685 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450dd9f-479e-4dcd-addb-379748ecb284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:04.941359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450dd9f-479e-4dcd-addb-379748ecb284 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:04.941717 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450dd9f-479e-4dcd-addb-379748ecb284 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:04.942013 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450dd9f-479e-4dcd-addb-379748ecb284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:04.949828 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450dd9f-479e-4dcd-addb-379748ecb284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:04.951260 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450dd9f-479e-4dcd-addb-379748ecb284 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:04.960123 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 890/1785] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:57:04.960815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450dd9f-479e-4dcd-addb-379748ecb284 service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:04.962133 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-2450dd9f-479e-4dcd-addb-379748ecb284 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:04.972729 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450dd9f-479e-4dcd-addb-379748ecb284 service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:04.978419 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471067bc-088f-4857-b242-e11f082c7c22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:04.979078 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471067bc-088f-4857-b242-e11f082c7c22 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:04.979372 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471067bc-088f-4857-b242-e11f082c7c22 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:04.979657 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471067bc-088f-4857-b242-e11f082c7c22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:04.987417 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471067bc-088f-4857-b242-e11f082c7c22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:04.989108 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471067bc-088f-4857-b242-e11f082c7c22 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:04.998235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 891/1786] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:57:04.999031 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471067bc-088f-4857-b242-e11f082c7c22 service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:05.009266 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471067bc-088f-4857-b242-e11f082c7c22 service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:05.015001 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf64ad-400d-4269-a695-ae1748712925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:05.015681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf64ad-400d-4269-a695-ae1748712925 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:05.015969 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf64ad-400d-4269-a695-ae1748712925 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:05.016304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf64ad-400d-4269-a695-ae1748712925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:05.020221 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-dc865bd1-9b1a-40da-9f47-7e3b71cb1e1c admin admin] The token cache is being invalidate because project bbaad5c135314098a75cb06a3f85ae3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:57:05.024580 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-dc865bd1-9b1a-40da-9f47-7e3b71cb1e1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:05.026483 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-dc865bd1-9b1a-40da-9f47-7e3b71cb1e1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:05.026698 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf64ad-400d-4269-a695-ae1748712925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:05.028263 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf64ad-400d-4269-a695-ae1748712925 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:05.032903 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 896/1787] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:57:04 2022] DELETE /identity/v3/projects/bbaad5c135314098a75cb06a3f85ae3e => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:05.039193 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 892/1788] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:57:05.041584 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a874c68-716d-4d94-86b5-2549b272d38b None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:05.042134 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a874c68-716d-4d94-86b5-2549b272d38b None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:05.042647 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a874c68-716d-4d94-86b5-2549b272d38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:05.078794 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-4a874c68-716d-4d94-86b5-2549b272d38b None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:05.080034 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-4a874c68-716d-4d94-86b5-2549b272d38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:05.155116 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 897/1789] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:05.166313 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c58cb3-7d3c-4fc3-827d-29eb7cb3fcd8 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:05.166855 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c58cb3-7d3c-4fc3-827d-29eb7cb3fcd8 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:05.167149 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c58cb3-7d3c-4fc3-827d-29eb7cb3fcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:05.219670 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-35c58cb3-7d3c-4fc3-827d-29eb7cb3fcd8 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:05.225935 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-35c58cb3-7d3c-4fc3-827d-29eb7cb3fcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:05.238641 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 893/1790] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:05.247808 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a874c68-716d-4d94-86b5-2549b272d38b None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:05.260552 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a874c68-716d-4d94-86b5-2549b272d38b None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:05.265723 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61875b8b-fffd-4b86-b6ce-923d7100b62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:05.266483 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61875b8b-fffd-4b86-b6ce-923d7100b62e admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:05.266863 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61875b8b-fffd-4b86-b6ce-923d7100b62e admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:05.267221 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61875b8b-fffd-4b86-b6ce-923d7100b62e admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:05.268528 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61875b8b-fffd-4b86-b6ce-923d7100b62e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:57:05.268528 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61875b8b-fffd-4b86-b6ce-923d7100b62e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:05.270907 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61875b8b-fffd-4b86-b6ce-923d7100b62e admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:05.293791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c58cb3-7d3c-4fc3-827d-29eb7cb3fcd8 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:05.298550 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 898/1791] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:57:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:57:05.304387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c58cb3-7d3c-4fc3-827d-29eb7cb3fcd8 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:05.309619 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98171f-db11-414b-a660-566f7fe42036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:05.310366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98171f-db11-414b-a660-566f7fe42036 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:05.310766 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98171f-db11-414b-a660-566f7fe42036 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:05.311114 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98171f-db11-414b-a660-566f7fe42036 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:05.311901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb98171f-db11-414b-a660-566f7fe42036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:05.315369 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb98171f-db11-414b-a660-566f7fe42036 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:05.473747 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61875b8b-fffd-4b86-b6ce-923d7100b62e admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:05.481414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 894/1792] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:57:05 2022] POST /identity/v3/projects => generated 382 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:57:05.488994 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61875b8b-fffd-4b86-b6ce-923d7100b62e admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:05.575397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:05.632537 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da8f33-74ec-418a-91ad-b9ee5ff3d6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:05.633804 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da8f33-74ec-418a-91ad-b9ee5ff3d6a6 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:05.634339 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da8f33-74ec-418a-91ad-b9ee5ff3d6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:05.635435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da8f33-74ec-418a-91ad-b9ee5ff3d6a6 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:05.636844 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da8f33-74ec-418a-91ad-b9ee5ff3d6a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:05.655253 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da8f33-74ec-418a-91ad-b9ee5ff3d6a6 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:05.765315 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 899/1793] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:57:05 2022] POST /identity/v3/users => generated 292 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:57:05.767793 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98171f-db11-414b-a660-566f7fe42036 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:05.782252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98171f-db11-414b-a660-566f7fe42036 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:05.787174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfba1c-7d9a-4614-acc4-0f4f33688065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:05.788017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfba1c-7d9a-4614-acc4-0f4f33688065 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:05.788381 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfba1c-7d9a-4614-acc4-0f4f33688065 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:05.788665 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfba1c-7d9a-4614-acc4-0f4f33688065 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:05.790332 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfba1c-7d9a-4614-acc4-0f4f33688065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:05.791992 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfba1c-7d9a-4614-acc4-0f4f33688065 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:05.813382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 895/1794] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:05 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:57:05.814739 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da8f33-74ec-418a-91ad-b9ee5ff3d6a6 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:05.833874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da8f33-74ec-418a-91ad-b9ee5ff3d6a6 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:05.849827 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99931df-21d4-4366-8469-d9f714e55207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:05.851009 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99931df-21d4-4366-8469-d9f714e55207 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:05.851310 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99931df-21d4-4366-8469-d9f714e55207 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:05.851597 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99931df-21d4-4366-8469-d9f714e55207 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:05.852415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99931df-21d4-4366-8469-d9f714e55207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:05.854198 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99931df-21d4-4366-8469-d9f714e55207 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:05.870196 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 900/1795] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:05 2022] GET /identity/v3/roles => generated 1427 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:57:05.874683 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfba1c-7d9a-4614-acc4-0f4f33688065 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:05.892509 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfba1c-7d9a-4614-acc4-0f4f33688065 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:05.905094 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca437c96-da5e-4fdd-8d8c-99bc43297b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:05.906094 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca437c96-da5e-4fdd-8d8c-99bc43297b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:05.906451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca437c96-da5e-4fdd-8d8c-99bc43297b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:05.906811 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca437c96-da5e-4fdd-8d8c-99bc43297b13 admin admin] PATH_INFO: `/v3/projects/fe2e65e9fb9345c8a11d00765db3c34d/users/0e0a8148644244f9965f26d5e34f74ef/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:05.940550 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca437c96-da5e-4fdd-8d8c-99bc43297b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2e65e9fb9345c8a11d00765db3c34d, user_id=0e0a8148644244f9965f26d5e34f74ef, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:05.948723 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca437c96-da5e-4fdd-8d8c-99bc43297b13 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:06.066432 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 896/1796] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:57:05 2022] PUT /identity/v3/projects/fe2e65e9fb9345c8a11d00765db3c34d/users/0e0a8148644244f9965f26d5e34f74ef/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:06.067932 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cd171-188f-47c3-98dc-e883a9236d07 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:06.068884 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cd171-188f-47c3-98dc-e883a9236d07 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:06.069317 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cd171-188f-47c3-98dc-e883a9236d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:06.128239 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-af2cd171-188f-47c3-98dc-e883a9236d07 None None] MFA Rules not processed for user `0e0a8148644244f9965f26d5e34f74ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:06.129768 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-af2cd171-188f-47c3-98dc-e883a9236d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:06.299245 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 901/1797] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:06.303198 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca437c96-da5e-4fdd-8d8c-99bc43297b13 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:06.514056 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca437c96-da5e-4fdd-8d8c-99bc43297b13 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:06.548967 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a7b1e-fddb-4ea1-9e09-cb132bb21ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:06.549685 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a7b1e-fddb-4ea1-9e09-cb132bb21ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:06.549979 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a7b1e-fddb-4ea1-9e09-cb132bb21ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:06.550264 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a7b1e-fddb-4ea1-9e09-cb132bb21ff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:06.550984 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a7b1e-fddb-4ea1-9e09-cb132bb21ff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:06.553648 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a7b1e-fddb-4ea1-9e09-cb132bb21ff0 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:06.728955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 897/1798] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:57:06 2022] POST /identity/v3/projects => generated 384 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:57:06.734353 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cd171-188f-47c3-98dc-e883a9236d07 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:06.756225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cd171-188f-47c3-98dc-e883a9236d07 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:06.951205 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecbd5e-5286-4f24-8b4d-33a9fcc883e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:06.952515 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecbd5e-5286-4f24-8b4d-33a9fcc883e1 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:06.952515 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecbd5e-5286-4f24-8b4d-33a9fcc883e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:06.952515 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecbd5e-5286-4f24-8b4d-33a9fcc883e1 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:06.953873 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecbd5e-5286-4f24-8b4d-33a9fcc883e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:06.955865 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecbd5e-5286-4f24-8b4d-33a9fcc883e1 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:07.102848 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 902/1799] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:57:06 2022] POST /identity/v3/users => generated 299 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:57:07.107308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a7b1e-fddb-4ea1-9e09-cb132bb21ff0 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:07.134403 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a7b1e-fddb-4ea1-9e09-cb132bb21ff0 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:07.153669 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfc3fe-1b42-4e5b-ba90-bab53c50a879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:07.154751 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfc3fe-1b42-4e5b-ba90-bab53c50a879 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:07.155119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfc3fe-1b42-4e5b-ba90-bab53c50a879 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:07.155361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfc3fe-1b42-4e5b-ba90-bab53c50a879 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:07.156165 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfc3fe-1b42-4e5b-ba90-bab53c50a879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:07.157828 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfc3fe-1b42-4e5b-ba90-bab53c50a879 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:07.174083 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 898/1800] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:07 2022] GET /identity/v3/roles => generated 1427 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:57:07.179087 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecbd5e-5286-4f24-8b4d-33a9fcc883e1 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:07.187236 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155ae12-dba8-44d3-aebb-fbc11ce8a003 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:07.187857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155ae12-dba8-44d3-aebb-fbc11ce8a003 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:07.188388 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155ae12-dba8-44d3-aebb-fbc11ce8a003 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:07.190538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 899/1801] 10.222.0.119 () {54 vars in 926 bytes} [Thu Jul 14 15:57:07 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:57:07.205198 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04c97b-35fe-4916-a21f-8733a93b9a08 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:07.205607 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecbd5e-5286-4f24-8b4d-33a9fcc883e1 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:07.205724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04c97b-35fe-4916-a21f-8733a93b9a08 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:07.206041 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04c97b-35fe-4916-a21f-8733a93b9a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:07.211970 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eab50d-be78-453a-b24a-4720150fb00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:07.212916 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eab50d-be78-453a-b24a-4720150fb00c admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:07.213203 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eab50d-be78-453a-b24a-4720150fb00c admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:07.213485 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eab50d-be78-453a-b24a-4720150fb00c admin admin] PATH_INFO: `/v3/projects/9b42a0f9c71148e1b184ef25bf12ee8e/users/c328cf591e50409ca62647f160dbfe69/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:07.235382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eab50d-be78-453a-b24a-4720150fb00c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b42a0f9c71148e1b184ef25bf12ee8e, user_id=c328cf591e50409ca62647f160dbfe69, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:07.238972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eab50d-be78-453a-b24a-4720150fb00c admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:07.241460 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-fa04c97b-35fe-4916-a21f-8733a93b9a08 None None] MFA Rules not processed for user `a1e4c833a4684561ab52eda5734a7766`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:07.244076 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-fa04c97b-35fe-4916-a21f-8733a93b9a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:07.272401 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:07.357389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 903/1802] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:57:07 2022] PUT /identity/v3/projects/9b42a0f9c71148e1b184ef25bf12ee8e/users/c328cf591e50409ca62647f160dbfe69/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:07.361156 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eab50d-be78-453a-b24a-4720150fb00c admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:07.393072 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 900/1803] 10.222.0.119 () {58 vars in 1023 bytes} [Thu Jul 14 15:57:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:57:07.500198 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:07.551648 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04c97b-35fe-4916-a21f-8733a93b9a08 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:07.553947 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-fa04c97b-35fe-4916-a21f-8733a93b9a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:07.557609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eab50d-be78-453a-b24a-4720150fb00c admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:07.575237 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de3094-283b-4bcb-8a57-5c39b7d7c382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:07.580691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de3094-283b-4bcb-8a57-5c39b7d7c382 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:07.580691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de3094-283b-4bcb-8a57-5c39b7d7c382 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:07.580691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de3094-283b-4bcb-8a57-5c39b7d7c382 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:07.580691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de3094-283b-4bcb-8a57-5c39b7d7c382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:07.589949 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04c97b-35fe-4916-a21f-8733a93b9a08 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:07.590818 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de3094-283b-4bcb-8a57-5c39b7d7c382 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:07.626606 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 904/1804] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:07 2022] GET /identity/v3/roles => generated 1427 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:57:07.626606 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a178d-3f4a-437c-a96f-2c984afc3250 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:07.626606 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a178d-3f4a-437c-a96f-2c984afc3250 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:07.626940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a178d-3f4a-437c-a96f-2c984afc3250 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:07.628141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 905/1805] 10.222.0.119 () {54 vars in 926 bytes} [Thu Jul 14 15:57:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:57:07.628850 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a178d-3f4a-437c-a96f-2c984afc3250 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:07.719412 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a178d-3f4a-437c-a96f-2c984afc3250 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:07.733010 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d6de5-9349-4071-9a5b-cdeec896dc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:07.733868 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d6de5-9349-4071-9a5b-cdeec896dc0d admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:07.734132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d6de5-9349-4071-9a5b-cdeec896dc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:07.734408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d6de5-9349-4071-9a5b-cdeec896dc0d admin admin] PATH_INFO: `/v3/projects/9b42a0f9c71148e1b184ef25bf12ee8e/users/c328cf591e50409ca62647f160dbfe69/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:07.742659 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d6de5-9349-4071-9a5b-cdeec896dc0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b42a0f9c71148e1b184ef25bf12ee8e, user_id=c328cf591e50409ca62647f160dbfe69, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:07.754827 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d6de5-9349-4071-9a5b-cdeec896dc0d admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:07.796942 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 906/1806] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:57:07 2022] PUT /identity/v3/projects/9b42a0f9c71148e1b184ef25bf12ee8e/users/c328cf591e50409ca62647f160dbfe69/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:07.803161 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014ed3c-63fa-48e6-8cc1-ba633b113e23 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:07.803451 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014ed3c-63fa-48e6-8cc1-ba633b113e23 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:07.805999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014ed3c-63fa-48e6-8cc1-ba633b113e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:07.806341 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48de437-7482-4d22-941e-442a9915ff9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:07.807200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48de437-7482-4d22-941e-442a9915ff9a service nova] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:07.807646 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48de437-7482-4d22-941e-442a9915ff9a service nova] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:07.808078 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48de437-7482-4d22-941e-442a9915ff9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:07.827250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48de437-7482-4d22-941e-442a9915ff9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:07.829177 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48de437-7482-4d22-941e-442a9915ff9a service nova] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:07.842687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-a014ed3c-63fa-48e6-8cc1-ba633b113e23 None None] MFA Rules not processed for user `a1e4c833a4684561ab52eda5734a7766`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:07.844267 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-a014ed3c-63fa-48e6-8cc1-ba633b113e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:07.847940 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 901/1807] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:57:07.849880 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6978616-953b-404a-8233-acb3ff4e0522 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:07.850176 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6978616-953b-404a-8233-acb3ff4e0522 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:07.850444 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6978616-953b-404a-8233-acb3ff4e0522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:07.942472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 907/1808] 10.222.0.119 () {58 vars in 1023 bytes} [Thu Jul 14 15:57:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:07.973890 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-d6978616-953b-404a-8233-acb3ff4e0522 None None] MFA Rules not processed for user `c328cf591e50409ca62647f160dbfe69`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:07.978481 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-d6978616-953b-404a-8233-acb3ff4e0522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:08.194297 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 902/1809] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:08.213483 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014ed3c-63fa-48e6-8cc1-ba633b113e23 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:08.214998 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-a014ed3c-63fa-48e6-8cc1-ba633b113e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:08.311657 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014ed3c-63fa-48e6-8cc1-ba633b113e23 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:08.319360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab6b4c-d650-4ee2-b892-1eb54e6856fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:08.321396 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab6b4c-d650-4ee2-b892-1eb54e6856fe service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:08.321396 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab6b4c-d650-4ee2-b892-1eb54e6856fe service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:08.321396 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab6b4c-d650-4ee2-b892-1eb54e6856fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:08.344758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab6b4c-d650-4ee2-b892-1eb54e6856fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:08.346341 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab6b4c-d650-4ee2-b892-1eb54e6856fe service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:08.364733 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 908/1810] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:57:08.481951 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6978616-953b-404a-8233-acb3ff4e0522 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:08.484257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-d6978616-953b-404a-8233-acb3ff4e0522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:08.501543 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6978616-953b-404a-8233-acb3ff4e0522 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:08.518428 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2786d-bc48-415f-87cc-db1b528a27e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:08.519216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2786d-bc48-415f-87cc-db1b528a27e6 service nova] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:08.519618 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2786d-bc48-415f-87cc-db1b528a27e6 service nova] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:08.519998 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2786d-bc48-415f-87cc-db1b528a27e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:08.536125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2786d-bc48-415f-87cc-db1b528a27e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:08.541479 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2786d-bc48-415f-87cc-db1b528a27e6 service nova] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:08.566135 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab6b4c-d650-4ee2-b892-1eb54e6856fe service cinder] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:08.578343 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab6b4c-d650-4ee2-b892-1eb54e6856fe service cinder] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:08.578739 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 903/1811] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:57:08.585239 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5f1cc-88d5-4c54-9267-312988eb53a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:08.586095 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5f1cc-88d5-4c54-9267-312988eb53a5 service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:08.586598 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5f1cc-88d5-4c54-9267-312988eb53a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:08.588042 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5f1cc-88d5-4c54-9267-312988eb53a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:08.761717 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5f1cc-88d5-4c54-9267-312988eb53a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:08.763254 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5f1cc-88d5-4c54-9267-312988eb53a5 service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:08.786966 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 909/1812] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:57:08.979035 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:09.876865 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2786d-bc48-415f-87cc-db1b528a27e6 service nova] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:09.891027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:09.949451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2786d-bc48-415f-87cc-db1b528a27e6 service nova] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:09.954655 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13497a-4edc-4eb4-b2e5-a1b1cbc181f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:09.955495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13497a-4edc-4eb4-b2e5-a1b1cbc181f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:09.955784 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13497a-4edc-4eb4-b2e5-a1b1cbc181f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:09.956215 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13497a-4edc-4eb4-b2e5-a1b1cbc181f3 admin admin] PATH_INFO: `/v3/users/0e0a8148644244f9965f26d5e34f74ef` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:09.958134 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13497a-4edc-4eb4-b2e5-a1b1cbc181f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e0a8148644244f9965f26d5e34f74ef)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:09.968870 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13497a-4edc-4eb4-b2e5-a1b1cbc181f3 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:10.262311 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-dc13497a-4edc-4eb4-b2e5-a1b1cbc181f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e0a8148644244f9965f26d5e34f74ef'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:10.275823 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-dc13497a-4edc-4eb4-b2e5-a1b1cbc181f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e0a8148644244f9965f26d5e34f74ef'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:10.282937 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-dc13497a-4edc-4eb4-b2e5-a1b1cbc181f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e0a8148644244f9965f26d5e34f74ef'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:10.283697 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-dc13497a-4edc-4eb4-b2e5-a1b1cbc181f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e0a8148644244f9965f26d5e34f74ef'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:10.377570 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-dc13497a-4edc-4eb4-b2e5-a1b1cbc181f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e0a8148644244f9965f26d5e34f74ef'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:10.384681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 904/1813] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:57:09 2022] DELETE /identity/v3/users/0e0a8148644244f9965f26d5e34f74ef => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:10.389185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdad5e-9d00-4216-a62a-49023d2a4d47 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:10.389711 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdad5e-9d00-4216-a62a-49023d2a4d47 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:10.389835 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdad5e-9d00-4216-a62a-49023d2a4d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:10.409907 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-92cdad5e-9d00-4216-a62a-49023d2a4d47 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:10.411107 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-92cdad5e-9d00-4216-a62a-49023d2a4d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:10.481130 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 910/1814] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:10.493887 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13497a-4edc-4eb4-b2e5-a1b1cbc181f3 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:10.495306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-dc13497a-4edc-4eb4-b2e5-a1b1cbc181f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:10.569600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13497a-4edc-4eb4-b2e5-a1b1cbc181f3 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:10.573458 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b31b6a-de88-4c48-9ff8-51a849b42e21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:10.576785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b31b6a-de88-4c48-9ff8-51a849b42e21 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:10.576785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b31b6a-de88-4c48-9ff8-51a849b42e21 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:10.576785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b31b6a-de88-4c48-9ff8-51a849b42e21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:10.585539 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b31b6a-de88-4c48-9ff8-51a849b42e21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:10.587016 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b31b6a-de88-4c48-9ff8-51a849b42e21 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:10.596837 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 905/1815] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:57:11.312862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdad5e-9d00-4216-a62a-49023d2a4d47 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:11.314603 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-92cdad5e-9d00-4216-a62a-49023d2a4d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:11.331672 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdad5e-9d00-4216-a62a-49023d2a4d47 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:11.338782 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312a085-7357-40b8-90fd-8543695d6ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:11.339583 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312a085-7357-40b8-90fd-8543695d6ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:11.339865 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312a085-7357-40b8-90fd-8543695d6ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:11.340300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312a085-7357-40b8-90fd-8543695d6ceb admin admin] PATH_INFO: `/v3/projects/fe2e65e9fb9345c8a11d00765db3c34d` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:11.341913 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312a085-7357-40b8-90fd-8543695d6ceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe2e65e9fb9345c8a11d00765db3c34d)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:11.343474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312a085-7357-40b8-90fd-8543695d6ceb admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:11.486641 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9312a085-7357-40b8-90fd-8543695d6ceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe2e65e9fb9345c8a11d00765db3c34d', 'request_id': 'req-9312a085-7357-40b8-90fd-8543695d6ceb'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:11.496884 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9312a085-7357-40b8-90fd-8543695d6ceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe2e65e9fb9345c8a11d00765db3c34d', 'request_id': 'req-9312a085-7357-40b8-90fd-8543695d6ceb'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:11.503808 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9312a085-7357-40b8-90fd-8543695d6ceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe2e65e9fb9345c8a11d00765db3c34d', 'request_id': 'req-9312a085-7357-40b8-90fd-8543695d6ceb'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:11.716219 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9312a085-7357-40b8-90fd-8543695d6ceb admin admin] The token cache is being invalidate because project fe2e65e9fb9345c8a11d00765db3c34d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:57:11.716517 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9312a085-7357-40b8-90fd-8543695d6ceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:11.717151 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9312a085-7357-40b8-90fd-8543695d6ceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:11.718843 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 911/1816] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:57:11 2022] DELETE /identity/v3/projects/fe2e65e9fb9345c8a11d00765db3c34d => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:11.722976 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b31b6a-de88-4c48-9ff8-51a849b42e21 service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:11.734042 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b31b6a-de88-4c48-9ff8-51a849b42e21 service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:11.796328 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:11.829459 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad2417-d149-40b2-99b9-b963f0dc79ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:11.834354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad2417-d149-40b2-99b9-b963f0dc79ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:11.834354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad2417-d149-40b2-99b9-b963f0dc79ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:11.834354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad2417-d149-40b2-99b9-b963f0dc79ec admin admin] PATH_INFO: `/v3/users/c328cf591e50409ca62647f160dbfe69` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:11.834354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad2417-d149-40b2-99b9-b963f0dc79ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=c328cf591e50409ca62647f160dbfe69)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:11.834746 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad2417-d149-40b2-99b9-b963f0dc79ec admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:12.107812 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-d7ad2417-d149-40b2-99b9-b963f0dc79ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c328cf591e50409ca62647f160dbfe69'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:12.121030 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-d7ad2417-d149-40b2-99b9-b963f0dc79ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c328cf591e50409ca62647f160dbfe69'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:12.128542 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-d7ad2417-d149-40b2-99b9-b963f0dc79ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c328cf591e50409ca62647f160dbfe69'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:12.129267 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-d7ad2417-d149-40b2-99b9-b963f0dc79ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c328cf591e50409ca62647f160dbfe69'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:12.277763 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-d7ad2417-d149-40b2-99b9-b963f0dc79ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c328cf591e50409ca62647f160dbfe69'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:12.285585 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 906/1817] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:57:11 2022] DELETE /identity/v3/users/c328cf591e50409ca62647f160dbfe69 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:57:12.717659 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312a085-7357-40b8-90fd-8543695d6ceb admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:12.719137 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-9312a085-7357-40b8-90fd-8543695d6ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:12.732957 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312a085-7357-40b8-90fd-8543695d6ceb admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:12.797276 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:12.810043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451818c-2947-43cd-8979-106afdf9e168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:12.810955 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451818c-2947-43cd-8979-106afdf9e168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:12.811249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451818c-2947-43cd-8979-106afdf9e168 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:12.811576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451818c-2947-43cd-8979-106afdf9e168 admin admin] PATH_INFO: `/v3/projects/9b42a0f9c71148e1b184ef25bf12ee8e` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:12.813032 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451818c-2947-43cd-8979-106afdf9e168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b42a0f9c71148e1b184ef25bf12ee8e)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:12.815108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451818c-2947-43cd-8979-106afdf9e168 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:12.969777 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5451818c-2947-43cd-8979-106afdf9e168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b42a0f9c71148e1b184ef25bf12ee8e', 'request_id': 'req-5451818c-2947-43cd-8979-106afdf9e168'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:12.980973 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5451818c-2947-43cd-8979-106afdf9e168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b42a0f9c71148e1b184ef25bf12ee8e', 'request_id': 'req-5451818c-2947-43cd-8979-106afdf9e168'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:12.986618 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5451818c-2947-43cd-8979-106afdf9e168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b42a0f9c71148e1b184ef25bf12ee8e', 'request_id': 'req-5451818c-2947-43cd-8979-106afdf9e168'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:13.093839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5451818c-2947-43cd-8979-106afdf9e168 admin admin] The token cache is being invalidate because project 9b42a0f9c71148e1b184ef25bf12ee8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:57:13.094405 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5451818c-2947-43cd-8979-106afdf9e168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:13.095072 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5451818c-2947-43cd-8979-106afdf9e168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:13.096757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 912/1818] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:57:12 2022] DELETE /identity/v3/projects/9b42a0f9c71148e1b184ef25bf12ee8e => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:13.102235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79a9f2-2b64-4ff8-a425-455b0ca5d3d9 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:13.102739 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79a9f2-2b64-4ff8-a425-455b0ca5d3d9 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:13.103022 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79a9f2-2b64-4ff8-a425-455b0ca5d3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:13.127993 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-8b79a9f2-2b64-4ff8-a425-455b0ca5d3d9 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:13.129970 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-8b79a9f2-2b64-4ff8-a425-455b0ca5d3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:13.221280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 907/1819] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:13.229828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9ad18-efc3-4c94-a249-e45730732c83 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:13.230198 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9ad18-efc3-4c94-a249-e45730732c83 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:13.230487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9ad18-efc3-4c94-a249-e45730732c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:13.258775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-a8c9ad18-efc3-4c94-a249-e45730732c83 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:13.262317 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-a8c9ad18-efc3-4c94-a249-e45730732c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:13.268812 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 913/1820] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:13.274180 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79a9f2-2b64-4ff8-a425-455b0ca5d3d9 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:13.287365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79a9f2-2b64-4ff8-a425-455b0ca5d3d9 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:13.296328 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18928139-0fd8-4dab-88dc-da75b4fa4223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:13.302875 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18928139-0fd8-4dab-88dc-da75b4fa4223 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:13.302875 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18928139-0fd8-4dab-88dc-da75b4fa4223 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:13.302875 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18928139-0fd8-4dab-88dc-da75b4fa4223 admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:13.302875 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18928139-0fd8-4dab-88dc-da75b4fa4223 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:57:13.302875 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18928139-0fd8-4dab-88dc-da75b4fa4223 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:13.302875 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18928139-0fd8-4dab-88dc-da75b4fa4223 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:13.315286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 908/1821] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:57:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:57:13.321314 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9ad18-efc3-4c94-a249-e45730732c83 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:13.331543 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9ad18-efc3-4c94-a249-e45730732c83 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:13.336739 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6c063-3e69-4f21-8b65-9255436485aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:13.337408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6c063-3e69-4f21-8b65-9255436485aa admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:13.337699 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6c063-3e69-4f21-8b65-9255436485aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:13.338172 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6c063-3e69-4f21-8b65-9255436485aa admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:13.339307 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6c063-3e69-4f21-8b65-9255436485aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:13.342250 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6c063-3e69-4f21-8b65-9255436485aa admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:13.490629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 914/1822] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:57:13 2022] POST /identity/v3/projects => generated 376 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:57:13.494591 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18928139-0fd8-4dab-88dc-da75b4fa4223 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:13.519283 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18928139-0fd8-4dab-88dc-da75b4fa4223 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:13.580282 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:13.610145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a5cd0-d1d6-4c10-ab71-8f1c1fd60be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:13.613063 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a5cd0-d1d6-4c10-ab71-8f1c1fd60be5 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:13.613063 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a5cd0-d1d6-4c10-ab71-8f1c1fd60be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:13.613063 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a5cd0-d1d6-4c10-ab71-8f1c1fd60be5 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:13.616027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a5cd0-d1d6-4c10-ab71-8f1c1fd60be5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:13.622875 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a5cd0-d1d6-4c10-ab71-8f1c1fd60be5 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:13.731373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 909/1823] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:57:13 2022] POST /identity/v3/users => generated 289 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:57:13.736531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6c063-3e69-4f21-8b65-9255436485aa admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:13.747690 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6c063-3e69-4f21-8b65-9255436485aa admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:13.752807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945fbfd-dbb4-4958-8a5b-de4ee6a05d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:13.753491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945fbfd-dbb4-4958-8a5b-de4ee6a05d2c admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:13.753779 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945fbfd-dbb4-4958-8a5b-de4ee6a05d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:13.754053 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945fbfd-dbb4-4958-8a5b-de4ee6a05d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:13.754823 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945fbfd-dbb4-4958-8a5b-de4ee6a05d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:13.757467 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945fbfd-dbb4-4958-8a5b-de4ee6a05d2c admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:13.772615 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 915/1824] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:13 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:57:13.775024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a5cd0-d1d6-4c10-ab71-8f1c1fd60be5 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:13.785968 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a5cd0-d1d6-4c10-ab71-8f1c1fd60be5 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:13.791683 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1933aa-4e5d-4df1-91fb-43f0190a441a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:13.792397 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1933aa-4e5d-4df1-91fb-43f0190a441a admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:13.792691 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1933aa-4e5d-4df1-91fb-43f0190a441a admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:13.792976 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1933aa-4e5d-4df1-91fb-43f0190a441a admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:13.793719 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1933aa-4e5d-4df1-91fb-43f0190a441a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:13.795321 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1933aa-4e5d-4df1-91fb-43f0190a441a admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:13.808545 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 910/1825] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:13 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:57:13.813033 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945fbfd-dbb4-4958-8a5b-de4ee6a05d2c admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:13.824409 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945fbfd-dbb4-4958-8a5b-de4ee6a05d2c admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:13.829272 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21a4bb-52e5-48a6-a030-160e5dd11770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:13.830170 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21a4bb-52e5-48a6-a030-160e5dd11770 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:13.830487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21a4bb-52e5-48a6-a030-160e5dd11770 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:13.830765 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21a4bb-52e5-48a6-a030-160e5dd11770 admin admin] PATH_INFO: `/v3/projects/36cf03ba8b6b46ee8d88fea473e8cb2e/users/8a51069e8e944e8f85e2afcb5dba7d02/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:13.852697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21a4bb-52e5-48a6-a030-160e5dd11770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36cf03ba8b6b46ee8d88fea473e8cb2e, user_id=8a51069e8e944e8f85e2afcb5dba7d02, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:13.855509 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21a4bb-52e5-48a6-a030-160e5dd11770 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:13.982685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 916/1826] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:57:13 2022] PUT /identity/v3/projects/36cf03ba8b6b46ee8d88fea473e8cb2e/users/8a51069e8e944e8f85e2afcb5dba7d02/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:13.996811 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e1b49-c327-4285-90a8-da315a07bd33 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:13.996811 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e1b49-c327-4285-90a8-da315a07bd33 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:13.997085 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e1b49-c327-4285-90a8-da315a07bd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:14.057933 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-4b9e1b49-c327-4285-90a8-da315a07bd33 None None] MFA Rules not processed for user `8a51069e8e944e8f85e2afcb5dba7d02`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:14.059239 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-4b9e1b49-c327-4285-90a8-da315a07bd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:14.162300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 911/1827] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:14.163712 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21a4bb-52e5-48a6-a030-160e5dd11770 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:14.278066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21a4bb-52e5-48a6-a030-160e5dd11770 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:14.287870 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55c98b-2a63-448a-b226-1573f6ca3be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:14.292450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55c98b-2a63-448a-b226-1573f6ca3be4 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:14.292450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55c98b-2a63-448a-b226-1573f6ca3be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:14.292450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55c98b-2a63-448a-b226-1573f6ca3be4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:14.292450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55c98b-2a63-448a-b226-1573f6ca3be4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:14.293213 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55c98b-2a63-448a-b226-1573f6ca3be4 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:14.391985 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:14.402757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 917/1828] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:57:14 2022] POST /identity/v3/projects => generated 374 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:57:14.404274 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e1b49-c327-4285-90a8-da315a07bd33 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:14.415970 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e1b49-c327-4285-90a8-da315a07bd33 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:14.479211 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30654b5-4e69-418e-8a2b-686898d55192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:14.480182 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30654b5-4e69-418e-8a2b-686898d55192 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:14.480478 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30654b5-4e69-418e-8a2b-686898d55192 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:14.480761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30654b5-4e69-418e-8a2b-686898d55192 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:14.483066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30654b5-4e69-418e-8a2b-686898d55192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:14.483355 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30654b5-4e69-418e-8a2b-686898d55192 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:14.643800 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 912/1829] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:57:14 2022] POST /identity/v3/users => generated 294 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:57:14.644987 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55c98b-2a63-448a-b226-1573f6ca3be4 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:14.655896 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55c98b-2a63-448a-b226-1573f6ca3be4 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:14.661414 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08854660-22a4-47fa-a782-cc8cbd9ef808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:14.662194 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08854660-22a4-47fa-a782-cc8cbd9ef808 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:14.662487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08854660-22a4-47fa-a782-cc8cbd9ef808 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:14.662790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08854660-22a4-47fa-a782-cc8cbd9ef808 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:14.663576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08854660-22a4-47fa-a782-cc8cbd9ef808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:14.665203 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08854660-22a4-47fa-a782-cc8cbd9ef808 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:14.676410 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 918/1830] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:14 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:57:14.681016 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30654b5-4e69-418e-8a2b-686898d55192 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:14.698927 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30654b5-4e69-418e-8a2b-686898d55192 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:14.706167 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08854660-22a4-47fa-a782-cc8cbd9ef808 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:14.707121 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f87af-14c8-409b-ab5e-58228cde2724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:14.708319 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f87af-14c8-409b-ab5e-58228cde2724 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:14.710689 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-08854660-22a4-47fa-a782-cc8cbd9ef808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:14.714233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f87af-14c8-409b-ab5e-58228cde2724 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:14.714233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f87af-14c8-409b-ab5e-58228cde2724 admin admin] PATH_INFO: `/v3/projects/36e50f1ea48b4f6e859eb9b464e8a5be/users/fd7decabd8594e9f9c82a1ee2eae1593/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:14.734432 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08854660-22a4-47fa-a782-cc8cbd9ef808 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:14.741932 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f87af-14c8-409b-ab5e-58228cde2724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36e50f1ea48b4f6e859eb9b464e8a5be, user_id=fd7decabd8594e9f9c82a1ee2eae1593, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:14.744960 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f87af-14c8-409b-ab5e-58228cde2724 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:14.748536 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b574f-ce1b-423e-93d6-1f7c5aa4b84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:14.752872 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b574f-ce1b-423e-93d6-1f7c5aa4b84d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:14.753267 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b574f-ce1b-423e-93d6-1f7c5aa4b84d admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:14.753619 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b574f-ce1b-423e-93d6-1f7c5aa4b84d admin admin] PATH_INFO: `/v3/users/0de3513e4b4b4ca8b509dadfcc278858` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:14.756178 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b574f-ce1b-423e-93d6-1f7c5aa4b84d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0de3513e4b4b4ca8b509dadfcc278858)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:14.758646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b574f-ce1b-423e-93d6-1f7c5aa4b84d admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:14.875345 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 913/1831] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:57:14 2022] PUT /identity/v3/projects/36e50f1ea48b4f6e859eb9b464e8a5be/users/fd7decabd8594e9f9c82a1ee2eae1593/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:14.879234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f87af-14c8-409b-ab5e-58228cde2724 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:14.893420 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:14.971638 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f87af-14c8-409b-ab5e-58228cde2724 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:14.977858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff634f0-79ee-4d40-9343-37d6aea80f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:14.977858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff634f0-79ee-4d40-9343-37d6aea80f73 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:14.977858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff634f0-79ee-4d40-9343-37d6aea80f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:14.978198 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff634f0-79ee-4d40-9343-37d6aea80f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:14.978627 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff634f0-79ee-4d40-9343-37d6aea80f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:14.980402 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff634f0-79ee-4d40-9343-37d6aea80f73 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:14.991468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 914/1832] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:14 2022] GET /identity/v3/roles => generated 1427 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:57:14.995509 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff634f0-79ee-4d40-9343-37d6aea80f73 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:15.007393 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff634f0-79ee-4d40-9343-37d6aea80f73 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:15.012120 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eab812-c9aa-4c46-bf3d-e83e2a58f3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:15.013030 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eab812-c9aa-4c46-bf3d-e83e2a58f3db admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:15.013474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eab812-c9aa-4c46-bf3d-e83e2a58f3db admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:15.013792 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eab812-c9aa-4c46-bf3d-e83e2a58f3db admin admin] PATH_INFO: `/v3/projects/36e50f1ea48b4f6e859eb9b464e8a5be/users/fd7decabd8594e9f9c82a1ee2eae1593/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:15.017597 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eab812-c9aa-4c46-bf3d-e83e2a58f3db admin admin] RBAC: Authorizing `identity:create_grant(project_id=36e50f1ea48b4f6e859eb9b464e8a5be, user_id=fd7decabd8594e9f9c82a1ee2eae1593, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:15.018424 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eab812-c9aa-4c46-bf3d-e83e2a58f3db admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:15.028916 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 915/1833] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:57:14 2022] PUT /identity/v3/projects/36e50f1ea48b4f6e859eb9b464e8a5be/users/fd7decabd8594e9f9c82a1ee2eae1593/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:57:15.040526 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f9da3-f076-4f95-91cf-798e48a452f1 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:15.040824 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f9da3-f076-4f95-91cf-798e48a452f1 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:15.041110 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f9da3-f076-4f95-91cf-798e48a452f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:15.068825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-4a0f9da3-f076-4f95-91cf-798e48a452f1 None None] MFA Rules not processed for user `fd7decabd8594e9f9c82a1ee2eae1593`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:15.070395 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-4a0f9da3-f076-4f95-91cf-798e48a452f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:15.098803 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-8e4b574f-ce1b-423e-93d6-1f7c5aa4b84d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0de3513e4b4b4ca8b509dadfcc278858'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:15.099564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-8e4b574f-ce1b-423e-93d6-1f7c5aa4b84d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0de3513e4b4b4ca8b509dadfcc278858'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:15.114047 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-8e4b574f-ce1b-423e-93d6-1f7c5aa4b84d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0de3513e4b4b4ca8b509dadfcc278858'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:15.124879 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-8e4b574f-ce1b-423e-93d6-1f7c5aa4b84d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0de3513e4b4b4ca8b509dadfcc278858'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:15.125683 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-8e4b574f-ce1b-423e-93d6-1f7c5aa4b84d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0de3513e4b4b4ca8b509dadfcc278858'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:15.143278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 916/1834] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:57:15.154947 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f9da3-f076-4f95-91cf-798e48a452f1 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:15.156349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-4a0f9da3-f076-4f95-91cf-798e48a452f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:15.226243 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f9da3-f076-4f95-91cf-798e48a452f1 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:15.229931 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ff77d-5e00-4bf3-a7d7-8d9eb32c6218 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:15.230590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ff77d-5e00-4bf3-a7d7-8d9eb32c6218 service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:15.230878 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ff77d-5e00-4bf3-a7d7-8d9eb32c6218 service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:15.231156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ff77d-5e00-4bf3-a7d7-8d9eb32c6218 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:15.232953 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-0b3ff77d-5e00-4bf3-a7d7-8d9eb32c6218 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:15.256345 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 919/1835] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:57:14 2022] DELETE /identity/v3/users/0de3513e4b4b4ca8b509dadfcc278858 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:57:15.258951 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25924cd-a936-4ea4-8647-f6270e6690e0 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:15.259355 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25924cd-a936-4ea4-8647-f6270e6690e0 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:15.259691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25924cd-a936-4ea4-8647-f6270e6690e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:15.285913 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-f25924cd-a936-4ea4-8647-f6270e6690e0 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:15.287682 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f25924cd-a936-4ea4-8647-f6270e6690e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:15.308445 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:15.319736 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ff77d-5e00-4bf3-a7d7-8d9eb32c6218 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:15.319736 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ff77d-5e00-4bf3-a7d7-8d9eb32c6218 service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:15.324530 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 917/1836] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:57:15.366019 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 920/1837] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:15.375716 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ff77d-5e00-4bf3-a7d7-8d9eb32c6218 service cinder] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:15.377463 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-0b3ff77d-5e00-4bf3-a7d7-8d9eb32c6218 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:15.436742 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ff77d-5e00-4bf3-a7d7-8d9eb32c6218 service cinder] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:15.493948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cb7a5-4cf6-42da-95cf-49a02f9c0706 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:15.494587 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cb7a5-4cf6-42da-95cf-49a02f9c0706 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:15.494880 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cb7a5-4cf6-42da-95cf-49a02f9c0706 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:15.495166 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cb7a5-4cf6-42da-95cf-49a02f9c0706 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:15.505159 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198cb7a5-4cf6-42da-95cf-49a02f9c0706 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:15.507289 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198cb7a5-4cf6-42da-95cf-49a02f9c0706 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:15.517680 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 918/1838] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:57:15.755505 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e78a7-daeb-4ab8-b556-0aaae444c99f None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:15.756575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e78a7-daeb-4ab8-b556-0aaae444c99f None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:15.756970 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e78a7-daeb-4ab8-b556-0aaae444c99f None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:15.758385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 921/1839] 10.222.0.119 () {54 vars in 926 bytes} [Thu Jul 14 15:57:15 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:57:15.769737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43663edc-94ac-4702-ac6f-f407e7aa4ded None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:15.770195 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43663edc-94ac-4702-ac6f-f407e7aa4ded None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:15.770476 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43663edc-94ac-4702-ac6f-f407e7aa4ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:15.792577 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-43663edc-94ac-4702-ac6f-f407e7aa4ded None None] MFA Rules not processed for user `a1e4c833a4684561ab52eda5734a7766`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:15.793846 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-43663edc-94ac-4702-ac6f-f407e7aa4ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:15.883991 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 919/1840] 10.222.0.119 () {58 vars in 1023 bytes} [Thu Jul 14 15:57:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:15.901753 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e78a7-daeb-4ab8-b556-0aaae444c99f None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:15.908265 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-296e78a7-daeb-4ab8-b556-0aaae444c99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:15.931236 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e78a7-daeb-4ab8-b556-0aaae444c99f None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:15.938919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6911ae-78f9-416c-abdf-3e4d218b82b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:15.940029 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6911ae-78f9-416c-abdf-3e4d218b82b1 service nova] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:15.940542 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6911ae-78f9-416c-abdf-3e4d218b82b1 service nova] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:15.941358 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6911ae-78f9-416c-abdf-3e4d218b82b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:15.953409 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6911ae-78f9-416c-abdf-3e4d218b82b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:15.955037 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6911ae-78f9-416c-abdf-3e4d218b82b1 service nova] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:15.979642 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 922/1841] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:57:16.119593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43663edc-94ac-4702-ac6f-f407e7aa4ded None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:16.121237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-43663edc-94ac-4702-ac6f-f407e7aa4ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:16.147710 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43663edc-94ac-4702-ac6f-f407e7aa4ded None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:16.153606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f9985-6edb-4901-ab19-8d2e23b064f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:16.155248 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f9985-6edb-4901-ab19-8d2e23b064f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:16.155615 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f9985-6edb-4901-ab19-8d2e23b064f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:16.155965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f9985-6edb-4901-ab19-8d2e23b064f6 admin admin] PATH_INFO: `/v3/projects/45455e98cd5d488182b5b9a3cae68906` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:16.157486 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f9985-6edb-4901-ab19-8d2e23b064f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45455e98cd5d488182b5b9a3cae68906)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:16.159656 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f9985-6edb-4901-ab19-8d2e23b064f6 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:16.193769 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:16.303823 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-9f8f9985-6edb-4901-ab19-8d2e23b064f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45455e98cd5d488182b5b9a3cae68906', 'request_id': 'req-9f8f9985-6edb-4901-ab19-8d2e23b064f6'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:16.310502 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-9f8f9985-6edb-4901-ab19-8d2e23b064f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45455e98cd5d488182b5b9a3cae68906', 'request_id': 'req-9f8f9985-6edb-4901-ab19-8d2e23b064f6'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:16.407344 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-9f8f9985-6edb-4901-ab19-8d2e23b064f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45455e98cd5d488182b5b9a3cae68906', 'request_id': 'req-9f8f9985-6edb-4901-ab19-8d2e23b064f6'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:16.423569 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-9f8f9985-6edb-4901-ab19-8d2e23b064f6 admin admin] The token cache is being invalidate because project 45455e98cd5d488182b5b9a3cae68906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:57:16.423789 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-9f8f9985-6edb-4901-ab19-8d2e23b064f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:16.427724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-9f8f9985-6edb-4901-ab19-8d2e23b064f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:16.433893 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6911ae-78f9-416c-abdf-3e4d218b82b1 service nova] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:16.435581 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 920/1842] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:57:16 2022] DELETE /identity/v3/projects/45455e98cd5d488182b5b9a3cae68906 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:16.445460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6911ae-78f9-416c-abdf-3e4d218b82b1 service nova] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:16.518390 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:16.541907 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303977b9-aeda-492f-8563-f11ff47db199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:16.542898 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303977b9-aeda-492f-8563-f11ff47db199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:16.547257 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303977b9-aeda-492f-8563-f11ff47db199 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:16.547257 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303977b9-aeda-492f-8563-f11ff47db199 admin admin] PATH_INFO: `/v3/users/9a46e57644d0404f9c228f5d270225b8` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:16.547257 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303977b9-aeda-492f-8563-f11ff47db199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a46e57644d0404f9c228f5d270225b8)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:16.547961 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303977b9-aeda-492f-8563-f11ff47db199 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:16.812657 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-303977b9-aeda-492f-8563-f11ff47db199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a46e57644d0404f9c228f5d270225b8'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:16.813362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-303977b9-aeda-492f-8563-f11ff47db199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a46e57644d0404f9c228f5d270225b8'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:16.826149 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-303977b9-aeda-492f-8563-f11ff47db199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a46e57644d0404f9c228f5d270225b8'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:16.833624 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-303977b9-aeda-492f-8563-f11ff47db199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a46e57644d0404f9c228f5d270225b8'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:16.835068 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-303977b9-aeda-492f-8563-f11ff47db199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a46e57644d0404f9c228f5d270225b8'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:16.922262 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 923/1843] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:57:16 2022] DELETE /identity/v3/users/9a46e57644d0404f9c228f5d270225b8 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:17.224976 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97ed7b-0a81-4a8b-ba1b-dad257a836b7 None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:17.225330 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97ed7b-0a81-4a8b-ba1b-dad257a836b7 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:17.225617 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97ed7b-0a81-4a8b-ba1b-dad257a836b7 None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:17.227057 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 921/1844] 10.222.0.119 () {54 vars in 926 bytes} [Thu Jul 14 15:57:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 15:57:17.240460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea3350-8d5b-4934-99cc-586fe1ef8550 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:17.240828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea3350-8d5b-4934-99cc-586fe1ef8550 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:17.241178 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea3350-8d5b-4934-99cc-586fe1ef8550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:17.260753 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-f7ea3350-8d5b-4934-99cc-586fe1ef8550 None None] MFA Rules not processed for user `716cbbfeede34885b0411e5b9b25df47`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:17.261960 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f7ea3350-8d5b-4934-99cc-586fe1ef8550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:17.372369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 924/1845] 10.222.0.119 () {58 vars in 1023 bytes} [Thu Jul 14 15:57:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:17.396559 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97ed7b-0a81-4a8b-ba1b-dad257a836b7 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:17.398649 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-bb97ed7b-0a81-4a8b-ba1b-dad257a836b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:17.417493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97ed7b-0a81-4a8b-ba1b-dad257a836b7 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:17.422795 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397737e-7b1a-4cb6-89b2-9156d5417f86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716cbbfeede34885b0411e5b9b25df47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:17.423757 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397737e-7b1a-4cb6-89b2-9156d5417f86 service placement] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:17.424308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397737e-7b1a-4cb6-89b2-9156d5417f86 service placement] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:17.428668 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397737e-7b1a-4cb6-89b2-9156d5417f86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:17.437285 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397737e-7b1a-4cb6-89b2-9156d5417f86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:17.439309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397737e-7b1a-4cb6-89b2-9156d5417f86 service placement] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:17.454076 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 922/1846] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:57:17.574235 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea3350-8d5b-4934-99cc-586fe1ef8550 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:17.575847 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f7ea3350-8d5b-4934-99cc-586fe1ef8550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:17.711023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea3350-8d5b-4934-99cc-586fe1ef8550 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:17.717435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34d657-edf0-42fe-8e87-677973f8d4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:17.718309 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34d657-edf0-42fe-8e87-677973f8d4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:17.718598 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34d657-edf0-42fe-8e87-677973f8d4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:17.718882 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34d657-edf0-42fe-8e87-677973f8d4a0 admin admin] PATH_INFO: `/v3/projects/dd773f59921d4e6e9c2a95e6b08dd85e` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:17.720124 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34d657-edf0-42fe-8e87-677973f8d4a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd773f59921d4e6e9c2a95e6b08dd85e)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:17.722452 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34d657-edf0-42fe-8e87-677973f8d4a0 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:17.730594 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:17.878278 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9b34d657-edf0-42fe-8e87-677973f8d4a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd773f59921d4e6e9c2a95e6b08dd85e', 'request_id': 'req-9b34d657-edf0-42fe-8e87-677973f8d4a0'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:17.888572 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9b34d657-edf0-42fe-8e87-677973f8d4a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd773f59921d4e6e9c2a95e6b08dd85e', 'request_id': 'req-9b34d657-edf0-42fe-8e87-677973f8d4a0'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:17.895361 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9b34d657-edf0-42fe-8e87-677973f8d4a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd773f59921d4e6e9c2a95e6b08dd85e', 'request_id': 'req-9b34d657-edf0-42fe-8e87-677973f8d4a0'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:18.018869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9b34d657-edf0-42fe-8e87-677973f8d4a0 admin admin] The token cache is being invalidate because project dd773f59921d4e6e9c2a95e6b08dd85e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:57:18.019159 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9b34d657-edf0-42fe-8e87-677973f8d4a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:18.019864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9b34d657-edf0-42fe-8e87-677973f8d4a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:18.022057 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 925/1847] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:57:17 2022] DELETE /identity/v3/projects/dd773f59921d4e6e9c2a95e6b08dd85e => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:18.027222 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc550d4-eb52-434e-81ce-b91dd68aa0a9 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:18.027547 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc550d4-eb52-434e-81ce-b91dd68aa0a9 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:18.027838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc550d4-eb52-434e-81ce-b91dd68aa0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:18.054714 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-cbc550d4-eb52-434e-81ce-b91dd68aa0a9 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:18.055953 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-cbc550d4-eb52-434e-81ce-b91dd68aa0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:18.119675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 923/1848] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:18.128255 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdaa19-5e0b-4a91-af40-c1149be334bc None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:18.128557 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdaa19-5e0b-4a91-af40-c1149be334bc None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:18.128839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdaa19-5e0b-4a91-af40-c1149be334bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:18.149000 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-43bdaa19-5e0b-4a91-af40-c1149be334bc None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:18.150271 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-43bdaa19-5e0b-4a91-af40-c1149be334bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:18.161328 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 926/1849] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:18.163562 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc550d4-eb52-434e-81ce-b91dd68aa0a9 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:18.173505 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc550d4-eb52-434e-81ce-b91dd68aa0a9 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:18.178883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6ae1f-ca35-4d7c-9500-077c169868c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:18.179560 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6ae1f-ca35-4d7c-9500-077c169868c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:18.179885 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6ae1f-ca35-4d7c-9500-077c169868c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:18.180206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6ae1f-ca35-4d7c-9500-077c169868c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:18.180947 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6ae1f-ca35-4d7c-9500-077c169868c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:57:18.181262 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6ae1f-ca35-4d7c-9500-077c169868c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:18.182949 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6ae1f-ca35-4d7c-9500-077c169868c0 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:18.199542 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 924/1850] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:57:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:57:18.199723 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe57560-3b7b-46b5-842a-394daab72668 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:18.199723 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe57560-3b7b-46b5-842a-394daab72668 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:18.199723 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe57560-3b7b-46b5-842a-394daab72668 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:18.199723 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 927/1851] 10.222.0.119 () {54 vars in 926 bytes} [Thu Jul 14 15:57:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 14 15:57:18.200681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6ae1f-ca35-4d7c-9500-077c169868c0 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:18.211590 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded56c6-6aee-41db-99e4-9702520e0d72 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:18.211901 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded56c6-6aee-41db-99e4-9702520e0d72 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:18.212197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded56c6-6aee-41db-99e4-9702520e0d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:18.212667 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6ae1f-ca35-4d7c-9500-077c169868c0 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:18.217478 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdf67d-2559-47a8-b19f-1c45a0666d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:18.218250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdf67d-2559-47a8-b19f-1c45a0666d04 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:18.218643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdf67d-2559-47a8-b19f-1c45a0666d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:18.219028 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdf67d-2559-47a8-b19f-1c45a0666d04 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:18.219849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffdf67d-2559-47a8-b19f-1c45a0666d04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:18.221904 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffdf67d-2559-47a8-b19f-1c45a0666d04 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:18.233691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-0ded56c6-6aee-41db-99e4-9702520e0d72 None None] MFA Rules not processed for user `716cbbfeede34885b0411e5b9b25df47`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:18.234917 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-0ded56c6-6aee-41db-99e4-9702520e0d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:18.302417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 928/1852] 10.222.0.119 () {58 vars in 1023 bytes} [Thu Jul 14 15:57:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:18.313495 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded56c6-6aee-41db-99e4-9702520e0d72 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:18.314771 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-0ded56c6-6aee-41db-99e4-9702520e0d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:18.329336 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded56c6-6aee-41db-99e4-9702520e0d72 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:18.336801 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b361f6-42c4-40ef-9177-372feb504383 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716cbbfeede34885b0411e5b9b25df47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:18.337670 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b361f6-42c4-40ef-9177-372feb504383 service placement] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:18.338029 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b361f6-42c4-40ef-9177-372feb504383 service placement] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:18.338418 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b361f6-42c4-40ef-9177-372feb504383 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:18.344306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 925/1853] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:57:18 2022] POST /identity/v3/projects => generated 386 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:57:18.345522 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdf67d-2559-47a8-b19f-1c45a0666d04 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:18.348767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b361f6-42c4-40ef-9177-372feb504383 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:18.350694 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b361f6-42c4-40ef-9177-372feb504383 service placement] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:18.362776 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 929/1854] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:57:18.363769 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b361f6-42c4-40ef-9177-372feb504383 service placement] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:18.366473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-57b361f6-42c4-40ef-9177-372feb504383 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:18.381802 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b361f6-42c4-40ef-9177-372feb504383 service placement] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:18.421901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdf67d-2559-47a8-b19f-1c45a0666d04 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:18.427594 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaaa8f5-6eb9-4625-8c36-2f1d5885c2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:18.428488 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaaa8f5-6eb9-4625-8c36-2f1d5885c2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:18.428862 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaaa8f5-6eb9-4625-8c36-2f1d5885c2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:18.429081 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaaa8f5-6eb9-4625-8c36-2f1d5885c2f4 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:18.432316 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaaa8f5-6eb9-4625-8c36-2f1d5885c2f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:18.434372 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaaa8f5-6eb9-4625-8c36-2f1d5885c2f4 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:18.445758 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:18.454684 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d92c8-c2d9-434c-85bc-9bd484367426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:18.455568 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d92c8-c2d9-434c-85bc-9bd484367426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:18.455852 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d92c8-c2d9-434c-85bc-9bd484367426 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:18.456160 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d92c8-c2d9-434c-85bc-9bd484367426 admin admin] PATH_INFO: `/v3/users/1bce8e22418748369ec85428835e039a` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:18.457615 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d92c8-c2d9-434c-85bc-9bd484367426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bce8e22418748369ec85428835e039a)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:18.460178 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d92c8-c2d9-434c-85bc-9bd484367426 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:18.585040 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 926/1855] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:57:18 2022] POST /identity/v3/users => generated 294 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:57:18.588849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaaa8f5-6eb9-4625-8c36-2f1d5885c2f4 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:18.599460 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaaa8f5-6eb9-4625-8c36-2f1d5885c2f4 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:18.604200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40be17-5e79-48e9-9a18-9100a37eee35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:18.604919 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40be17-5e79-48e9-9a18-9100a37eee35 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:18.605206 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40be17-5e79-48e9-9a18-9100a37eee35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:18.605483 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40be17-5e79-48e9-9a18-9100a37eee35 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:18.606218 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40be17-5e79-48e9-9a18-9100a37eee35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:18.608119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40be17-5e79-48e9-9a18-9100a37eee35 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:18.620142 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 927/1856] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:18 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:57:18.623085 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40be17-5e79-48e9-9a18-9100a37eee35 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:18.633677 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40be17-5e79-48e9-9a18-9100a37eee35 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:18.638670 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf67c3-d17e-4fef-83f0-43b58a6fbd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:18.639352 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf67c3-d17e-4fef-83f0-43b58a6fbd3b admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:18.639681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf67c3-d17e-4fef-83f0-43b58a6fbd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:18.639963 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf67c3-d17e-4fef-83f0-43b58a6fbd3b admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:18.640745 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf67c3-d17e-4fef-83f0-43b58a6fbd3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:18.642503 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf67c3-d17e-4fef-83f0-43b58a6fbd3b admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:18.653717 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 928/1857] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:18 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:57:18.657764 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf67c3-d17e-4fef-83f0-43b58a6fbd3b admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:18.667791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf67c3-d17e-4fef-83f0-43b58a6fbd3b admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:18.672714 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf382c1-505a-485d-80b7-2c4b389d5df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:18.673661 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf382c1-505a-485d-80b7-2c4b389d5df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:18.673945 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf382c1-505a-485d-80b7-2c4b389d5df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:18.674223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf382c1-505a-485d-80b7-2c4b389d5df9 admin admin] PATH_INFO: `/v3/projects/29452ee0848d44958f7c4ece35287255/users/98d140cc27964c4884c6f3ffeb98910f/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:18.691613 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf382c1-505a-485d-80b7-2c4b389d5df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29452ee0848d44958f7c4ece35287255, user_id=98d140cc27964c4884c6f3ffeb98910f, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:18.695442 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf382c1-505a-485d-80b7-2c4b389d5df9 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:18.730114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-b76d92c8-c2d9-434c-85bc-9bd484367426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bce8e22418748369ec85428835e039a'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:18.731175 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-b76d92c8-c2d9-434c-85bc-9bd484367426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bce8e22418748369ec85428835e039a'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:18.751422 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-b76d92c8-c2d9-434c-85bc-9bd484367426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bce8e22418748369ec85428835e039a'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:18.765506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-b76d92c8-c2d9-434c-85bc-9bd484367426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bce8e22418748369ec85428835e039a'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:18.767135 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-b76d92c8-c2d9-434c-85bc-9bd484367426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bce8e22418748369ec85428835e039a'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:18.807692 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 929/1858] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:57:18 2022] PUT /identity/v3/projects/29452ee0848d44958f7c4ece35287255/users/98d140cc27964c4884c6f3ffeb98910f/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:57:18.814175 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:18.817795 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c814c4-4be0-41d7-a53c-ec482117c19a None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:18.819342 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c814c4-4be0-41d7-a53c-ec482117c19a None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:18.819639 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c814c4-4be0-41d7-a53c-ec482117c19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:18.846845 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-57c814c4-4be0-41d7-a53c-ec482117c19a None None] MFA Rules not processed for user `98d140cc27964c4884c6f3ffeb98910f`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:18.848237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-57c814c4-4be0-41d7-a53c-ec482117c19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:18.887449 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 930/1859] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:57:18 2022] DELETE /identity/v3/users/1bce8e22418748369ec85428835e039a => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:18.940275 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 930/1860] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:57:18.941566 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d92c8-c2d9-434c-85bc-9bd484367426 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:18.943237 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-b76d92c8-c2d9-434c-85bc-9bd484367426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:19.030980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d92c8-c2d9-434c-85bc-9bd484367426 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:19.036165 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683cc19-b1db-483a-86dd-e9fd81c59d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:19.038334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683cc19-b1db-483a-86dd-e9fd81c59d7f admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:19.038708 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683cc19-b1db-483a-86dd-e9fd81c59d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:19.039072 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683cc19-b1db-483a-86dd-e9fd81c59d7f admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:19.039864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683cc19-b1db-483a-86dd-e9fd81c59d7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:19.041929 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683cc19-b1db-483a-86dd-e9fd81c59d7f admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:19.161924 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 931/1861] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:57:18 2022] POST /identity/v3/projects => generated 388 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:57:19.165973 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c814c4-4be0-41d7-a53c-ec482117c19a None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:19.197287 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683cc19-b1db-483a-86dd-e9fd81c59d7f admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:19.199660 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-2683cc19-b1db-483a-86dd-e9fd81c59d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:19.248433 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c814c4-4be0-41d7-a53c-ec482117c19a None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:19.273270 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683cc19-b1db-483a-86dd-e9fd81c59d7f admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:19.279307 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8eb32-e0f5-482e-bb17-f0cb6e6bb728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:19.280209 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8eb32-e0f5-482e-bb17-f0cb6e6bb728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:19.280501 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8eb32-e0f5-482e-bb17-f0cb6e6bb728 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:19.280780 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8eb32-e0f5-482e-bb17-f0cb6e6bb728 admin admin] PATH_INFO: `/v3/projects/d52bf23e6c5546a8a905ae46e862eb55` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:19.281977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8eb32-e0f5-482e-bb17-f0cb6e6bb728 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d52bf23e6c5546a8a905ae46e862eb55)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:19.283894 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8eb32-e0f5-482e-bb17-f0cb6e6bb728 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:19.289891 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:19.303259 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:19.307408 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b5960-6d49-4f3e-8613-883b34eaa8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:19.308135 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b5960-6d49-4f3e-8613-883b34eaa8f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:19.308419 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b5960-6d49-4f3e-8613-883b34eaa8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:19.308694 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b5960-6d49-4f3e-8613-883b34eaa8f8 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:19.309435 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b5960-6d49-4f3e-8613-883b34eaa8f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:19.311367 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b5960-6d49-4f3e-8613-883b34eaa8f8 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:19.424526 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7cf8eb32-e0f5-482e-bb17-f0cb6e6bb728 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd52bf23e6c5546a8a905ae46e862eb55', 'request_id': 'req-7cf8eb32-e0f5-482e-bb17-f0cb6e6bb728'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:19.425339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 931/1862] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:57:19 2022] POST /identity/v3/users => generated 301 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:57:19.429749 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b5960-6d49-4f3e-8613-883b34eaa8f8 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:19.434850 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7cf8eb32-e0f5-482e-bb17-f0cb6e6bb728 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd52bf23e6c5546a8a905ae46e862eb55', 'request_id': 'req-7cf8eb32-e0f5-482e-bb17-f0cb6e6bb728'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:19.439547 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b5960-6d49-4f3e-8613-883b34eaa8f8 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:19.440791 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7cf8eb32-e0f5-482e-bb17-f0cb6e6bb728 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd52bf23e6c5546a8a905ae46e862eb55', 'request_id': 'req-7cf8eb32-e0f5-482e-bb17-f0cb6e6bb728'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:19.495921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f551e41-a6c1-415a-9ca5-62f4dcc79353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:19.496734 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f551e41-a6c1-415a-9ca5-62f4dcc79353 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:19.497021 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f551e41-a6c1-415a-9ca5-62f4dcc79353 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:19.497297 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f551e41-a6c1-415a-9ca5-62f4dcc79353 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:19.498055 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f551e41-a6c1-415a-9ca5-62f4dcc79353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:19.499641 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f551e41-a6c1-415a-9ca5-62f4dcc79353 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:19.511780 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 932/1863] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:19 2022] GET /identity/v3/roles => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:57:19.515068 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f551e41-a6c1-415a-9ca5-62f4dcc79353 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:19.525337 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f551e41-a6c1-415a-9ca5-62f4dcc79353 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:19.529922 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de394ea3-fa45-4ce4-a1b7-b9f99e7e9c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:19.530812 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de394ea3-fa45-4ce4-a1b7-b9f99e7e9c86 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:19.531097 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de394ea3-fa45-4ce4-a1b7-b9f99e7e9c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:19.531375 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de394ea3-fa45-4ce4-a1b7-b9f99e7e9c86 admin admin] PATH_INFO: `/v3/projects/d670da926d564de189529784cb92de35/users/d8eaf089c76e426db1cf40c697eb3189/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:19.546248 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de394ea3-fa45-4ce4-a1b7-b9f99e7e9c86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d670da926d564de189529784cb92de35, user_id=d8eaf089c76e426db1cf40c697eb3189, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:19.548977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de394ea3-fa45-4ce4-a1b7-b9f99e7e9c86 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:19.577363 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7cf8eb32-e0f5-482e-bb17-f0cb6e6bb728 admin admin] The token cache is being invalidate because project d52bf23e6c5546a8a905ae46e862eb55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:57:19.577777 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7cf8eb32-e0f5-482e-bb17-f0cb6e6bb728 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:19.578434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7cf8eb32-e0f5-482e-bb17-f0cb6e6bb728 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:19.580013 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 932/1864] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:57:19 2022] DELETE /identity/v3/projects/d52bf23e6c5546a8a905ae46e862eb55 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:19.584140 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8eb32-e0f5-482e-bb17-f0cb6e6bb728 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:19.585461 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-7cf8eb32-e0f5-482e-bb17-f0cb6e6bb728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:19.597864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8eb32-e0f5-482e-bb17-f0cb6e6bb728 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:19.602571 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422ec5f-672e-4600-81c8-e662e8cb3805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:19.603426 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422ec5f-672e-4600-81c8-e662e8cb3805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:19.603714 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422ec5f-672e-4600-81c8-e662e8cb3805 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:19.603996 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422ec5f-672e-4600-81c8-e662e8cb3805 admin admin] PATH_INFO: `/v3/users/36076feefe304dfdbe4700edec1d32f6` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:19.605276 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422ec5f-672e-4600-81c8-e662e8cb3805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36076feefe304dfdbe4700edec1d32f6)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:19.607244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422ec5f-672e-4600-81c8-e662e8cb3805 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:19.698308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 933/1865] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:57:19 2022] PUT /identity/v3/projects/d670da926d564de189529784cb92de35/users/d8eaf089c76e426db1cf40c697eb3189/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:57:19.702203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de394ea3-fa45-4ce4-a1b7-b9f99e7e9c86 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:19.706551 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-de394ea3-fa45-4ce4-a1b7-b9f99e7e9c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:19.769172 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de394ea3-fa45-4ce4-a1b7-b9f99e7e9c86 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:19.774476 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12899df-a56b-4c12-9d3a-b9414aa8da82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:19.775143 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12899df-a56b-4c12-9d3a-b9414aa8da82 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:19.775431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12899df-a56b-4c12-9d3a-b9414aa8da82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:19.775708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12899df-a56b-4c12-9d3a-b9414aa8da82 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:19.776459 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12899df-a56b-4c12-9d3a-b9414aa8da82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:19.778048 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12899df-a56b-4c12-9d3a-b9414aa8da82 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:19.789670 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 934/1866] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:19 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:57:19.796297 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12899df-a56b-4c12-9d3a-b9414aa8da82 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:19.812594 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12899df-a56b-4c12-9d3a-b9414aa8da82 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:19.818255 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178bc24-fde6-43a4-80ff-6d83b45e855c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:19.819344 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178bc24-fde6-43a4-80ff-6d83b45e855c admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:19.819632 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178bc24-fde6-43a4-80ff-6d83b45e855c admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:19.819914 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178bc24-fde6-43a4-80ff-6d83b45e855c admin admin] PATH_INFO: `/v3/projects/d670da926d564de189529784cb92de35/users/d8eaf089c76e426db1cf40c697eb3189/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:19.829150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178bc24-fde6-43a4-80ff-6d83b45e855c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d670da926d564de189529784cb92de35, user_id=d8eaf089c76e426db1cf40c697eb3189, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:19.837216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178bc24-fde6-43a4-80ff-6d83b45e855c admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:19.845186 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7422ec5f-672e-4600-81c8-e662e8cb3805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36076feefe304dfdbe4700edec1d32f6'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:19.846129 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7422ec5f-672e-4600-81c8-e662e8cb3805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36076feefe304dfdbe4700edec1d32f6'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:19.872147 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 935/1867] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:57:19 2022] PUT /identity/v3/projects/d670da926d564de189529784cb92de35/users/d8eaf089c76e426db1cf40c697eb3189/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:19.873564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7422ec5f-672e-4600-81c8-e662e8cb3805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36076feefe304dfdbe4700edec1d32f6'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:19.878981 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0f9a5-b4bf-4b48-903f-15ec3e84ecf9 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:19.879357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0f9a5-b4bf-4b48-903f-15ec3e84ecf9 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:19.879700 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0f9a5-b4bf-4b48-903f-15ec3e84ecf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:19.886069 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7422ec5f-672e-4600-81c8-e662e8cb3805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36076feefe304dfdbe4700edec1d32f6'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:19.887160 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7422ec5f-672e-4600-81c8-e662e8cb3805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36076feefe304dfdbe4700edec1d32f6'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:19.908912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-26f0f9a5-b4bf-4b48-903f-15ec3e84ecf9 None None] MFA Rules not processed for user `d8eaf089c76e426db1cf40c697eb3189`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:19.910152 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-26f0f9a5-b4bf-4b48-903f-15ec3e84ecf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:19.924220 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:19.977908 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 933/1868] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:57:19 2022] DELETE /identity/v3/users/36076feefe304dfdbe4700edec1d32f6 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:57:19.991265 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 936/1869] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:19 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:20.001716 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422ec5f-672e-4600-81c8-e662e8cb3805 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:20.003808 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-7422ec5f-672e-4600-81c8-e662e8cb3805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:20.076326 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422ec5f-672e-4600-81c8-e662e8cb3805 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:20.079852 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a56a78-5024-4a2f-b43f-45c6e5d0a500 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:20.080543 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a56a78-5024-4a2f-b43f-45c6e5d0a500 service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:20.080830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a56a78-5024-4a2f-b43f-45c6e5d0a500 service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:20.081108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a56a78-5024-4a2f-b43f-45c6e5d0a500 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:20.140580 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:20.180805 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a56a78-5024-4a2f-b43f-45c6e5d0a500 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:20.182258 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a56a78-5024-4a2f-b43f-45c6e5d0a500 service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:20.192278 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 934/1870] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:20 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:57:20.256882 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0f9a5-b4bf-4b48-903f-15ec3e84ecf9 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:20.258491 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-26f0f9a5-b4bf-4b48-903f-15ec3e84ecf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:20.282988 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a56a78-5024-4a2f-b43f-45c6e5d0a500 service cinder] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:20.284524 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-52a56a78-5024-4a2f-b43f-45c6e5d0a500 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:20.337042 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0f9a5-b4bf-4b48-903f-15ec3e84ecf9 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:20.395289 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a56a78-5024-4a2f-b43f-45c6e5d0a500 service cinder] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:20.398315 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49f212-91ac-4675-ba95-dc713aef4100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:20.399210 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49f212-91ac-4675-ba95-dc713aef4100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:20.399505 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49f212-91ac-4675-ba95-dc713aef4100 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:20.399786 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49f212-91ac-4675-ba95-dc713aef4100 admin admin] PATH_INFO: `/v3/users/98d140cc27964c4884c6f3ffeb98910f` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:20.400676 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfa4b1-0caa-4e63-869a-537be056c934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:20.401186 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49f212-91ac-4675-ba95-dc713aef4100 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98d140cc27964c4884c6f3ffeb98910f)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:20.401574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfa4b1-0caa-4e63-869a-537be056c934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:20.401860 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfa4b1-0caa-4e63-869a-537be056c934 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:20.402137 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfa4b1-0caa-4e63-869a-537be056c934 admin admin] PATH_INFO: `/v3/projects/f0fa9e6624a84ae6adcf2dbd35045b26` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:20.403177 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49f212-91ac-4675-ba95-dc713aef4100 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:20.403318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfa4b1-0caa-4e63-869a-537be056c934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0fa9e6624a84ae6adcf2dbd35045b26)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:20.405238 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfa4b1-0caa-4e63-869a-537be056c934 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:20.690806 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-c3dfa4b1-0caa-4e63-869a-537be056c934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0fa9e6624a84ae6adcf2dbd35045b26', 'request_id': 'req-c3dfa4b1-0caa-4e63-869a-537be056c934'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:20.691018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-5d49f212-91ac-4675-ba95-dc713aef4100 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98d140cc27964c4884c6f3ffeb98910f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:20.698317 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-c3dfa4b1-0caa-4e63-869a-537be056c934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0fa9e6624a84ae6adcf2dbd35045b26', 'request_id': 'req-c3dfa4b1-0caa-4e63-869a-537be056c934'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:20.702067 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:20.704178 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-c3dfa4b1-0caa-4e63-869a-537be056c934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0fa9e6624a84ae6adcf2dbd35045b26', 'request_id': 'req-c3dfa4b1-0caa-4e63-869a-537be056c934'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:20.704570 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-5d49f212-91ac-4675-ba95-dc713aef4100 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98d140cc27964c4884c6f3ffeb98910f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:20.714669 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-5d49f212-91ac-4675-ba95-dc713aef4100 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98d140cc27964c4884c6f3ffeb98910f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:20.715400 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-5d49f212-91ac-4675-ba95-dc713aef4100 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98d140cc27964c4884c6f3ffeb98910f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:20.808282 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-c3dfa4b1-0caa-4e63-869a-537be056c934 admin admin] The token cache is being invalidate because project f0fa9e6624a84ae6adcf2dbd35045b26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:57:20.808486 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-c3dfa4b1-0caa-4e63-869a-537be056c934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:20.809239 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-c3dfa4b1-0caa-4e63-869a-537be056c934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:20.810819 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 935/1871] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:57:20 2022] DELETE /identity/v3/projects/f0fa9e6624a84ae6adcf2dbd35045b26 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:57:20.815539 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf46a53-ae6e-4c1e-8fa0-3e395614149c None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:20.815831 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf46a53-ae6e-4c1e-8fa0-3e395614149c None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:20.816125 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf46a53-ae6e-4c1e-8fa0-3e395614149c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:20.834938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-faf46a53-ae6e-4c1e-8fa0-3e395614149c None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:20.836225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-faf46a53-ae6e-4c1e-8fa0-3e395614149c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:20.887799 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:20.904468 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 936/1872] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:57:20.904825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-5d49f212-91ac-4675-ba95-dc713aef4100 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98d140cc27964c4884c6f3ffeb98910f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:20.916064 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb60e7-adef-4590-9eed-7c28756ec764 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:20.916064 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb60e7-adef-4590-9eed-7c28756ec764 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:20.916064 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb60e7-adef-4590-9eed-7c28756ec764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:20.921632 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 937/1873] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:57:20 2022] DELETE /identity/v3/users/98d140cc27964c4884c6f3ffeb98910f => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:20.921632 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a35b8-379e-426e-b3c3-3653e1433b99 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:20.921632 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a35b8-379e-426e-b3c3-3653e1433b99 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:20.921632 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a35b8-379e-426e-b3c3-3653e1433b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:20.930555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-74fb60e7-adef-4590-9eed-7c28756ec764 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:20.931849 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-74fb60e7-adef-4590-9eed-7c28756ec764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:20.936373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-fa8a35b8-379e-426e-b3c3-3653e1433b99 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:20.937668 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-fa8a35b8-379e-426e-b3c3-3653e1433b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:20.993674 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 937/1874] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:20.998083 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb60e7-adef-4590-9eed-7c28756ec764 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:21.004457 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 938/1875] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:57:21.009107 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb60e7-adef-4590-9eed-7c28756ec764 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:21.013551 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4e8b9-ba3a-41c2-a10d-75265502c497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:21.014228 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4e8b9-ba3a-41c2-a10d-75265502c497 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:21.014515 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4e8b9-ba3a-41c2-a10d-75265502c497 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:21.014796 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4e8b9-ba3a-41c2-a10d-75265502c497 admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:21.014889 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a35b8-379e-426e-b3c3-3653e1433b99 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:21.015535 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4e8b9-ba3a-41c2-a10d-75265502c497 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:57:21.015848 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4e8b9-ba3a-41c2-a10d-75265502c497 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:21.016195 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-fa8a35b8-379e-426e-b3c3-3653e1433b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:21.017496 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4e8b9-ba3a-41c2-a10d-75265502c497 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:21.029940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 938/1876] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:57:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:57:21.034570 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4e8b9-ba3a-41c2-a10d-75265502c497 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:21.044663 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4e8b9-ba3a-41c2-a10d-75265502c497 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:21.049385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae04e77-b694-4d9c-97c5-3a959dd7beea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:21.050038 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae04e77-b694-4d9c-97c5-3a959dd7beea admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:21.050333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae04e77-b694-4d9c-97c5-3a959dd7beea admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:21.050621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae04e77-b694-4d9c-97c5-3a959dd7beea admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:21.051317 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae04e77-b694-4d9c-97c5-3a959dd7beea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:21.054148 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae04e77-b694-4d9c-97c5-3a959dd7beea admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:21.078032 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a35b8-379e-426e-b3c3-3653e1433b99 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:21.081732 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6d98e-68b3-43a1-b3d4-bf7b7c3bb608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:21.082963 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6d98e-68b3-43a1-b3d4-bf7b7c3bb608 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:21.083258 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6d98e-68b3-43a1-b3d4-bf7b7c3bb608 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:21.084210 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6d98e-68b3-43a1-b3d4-bf7b7c3bb608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:21.094618 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6d98e-68b3-43a1-b3d4-bf7b7c3bb608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:21.096178 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6d98e-68b3-43a1-b3d4-bf7b7c3bb608 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:21.120343 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 939/1877] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:57:21.164706 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 939/1878] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:57:21 2022] POST /identity/v3/projects => generated 362 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:57:21.168913 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6d98e-68b3-43a1-b3d4-bf7b7c3bb608 service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:21.180679 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6d98e-68b3-43a1-b3d4-bf7b7c3bb608 service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:21.245037 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad438ea-0184-4941-bc2a-8188ff829722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:21.245732 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad438ea-0184-4941-bc2a-8188ff829722 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:21.246063 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad438ea-0184-4941-bc2a-8188ff829722 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:21.246384 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad438ea-0184-4941-bc2a-8188ff829722 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:21.247065 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad438ea-0184-4941-bc2a-8188ff829722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:21.249042 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad438ea-0184-4941-bc2a-8188ff829722 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:21.365022 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 940/1879] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:57:21 2022] POST /identity/v3/users => generated 282 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:57:21.371675 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae04e77-b694-4d9c-97c5-3a959dd7beea admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:21.385859 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae04e77-b694-4d9c-97c5-3a959dd7beea admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:21.392355 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c71188-44ed-441a-b0cd-d2af28f96836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:21.393373 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c71188-44ed-441a-b0cd-d2af28f96836 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:21.393756 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c71188-44ed-441a-b0cd-d2af28f96836 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:21.394623 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c71188-44ed-441a-b0cd-d2af28f96836 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:21.395094 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c71188-44ed-441a-b0cd-d2af28f96836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:21.398040 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c71188-44ed-441a-b0cd-d2af28f96836 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:21.413986 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 940/1880] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:21 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:57:21.426670 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad438ea-0184-4941-bc2a-8188ff829722 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:21.438165 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad438ea-0184-4941-bc2a-8188ff829722 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:21.445550 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9804e1e-1a29-406c-a908-e7200ce9aeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:21.446348 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9804e1e-1a29-406c-a908-e7200ce9aeb2 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:21.446635 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9804e1e-1a29-406c-a908-e7200ce9aeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:21.446916 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9804e1e-1a29-406c-a908-e7200ce9aeb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:21.447661 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9804e1e-1a29-406c-a908-e7200ce9aeb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:21.449511 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9804e1e-1a29-406c-a908-e7200ce9aeb2 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:21.456656 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:21.466877 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 941/1881] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:21 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:57:21.468645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c71188-44ed-441a-b0cd-d2af28f96836 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:21.480551 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c71188-44ed-441a-b0cd-d2af28f96836 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:21.486050 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46247dd-fcef-4dad-8c0d-c2c8331a48f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:21.486976 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46247dd-fcef-4dad-8c0d-c2c8331a48f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:21.487263 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46247dd-fcef-4dad-8c0d-c2c8331a48f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:21.487544 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46247dd-fcef-4dad-8c0d-c2c8331a48f5 admin admin] PATH_INFO: `/v3/projects/7a54a49c2c8a4775ac5804a0b96bbe45/users/9afa3361f65941aaaf6ac81913ce6c6d/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:21.524042 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46247dd-fcef-4dad-8c0d-c2c8331a48f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a54a49c2c8a4775ac5804a0b96bbe45, user_id=9afa3361f65941aaaf6ac81913ce6c6d, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:21.527407 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46247dd-fcef-4dad-8c0d-c2c8331a48f5 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:21.699124 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 941/1882] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:57:21 2022] PUT /identity/v3/projects/7a54a49c2c8a4775ac5804a0b96bbe45/users/9afa3361f65941aaaf6ac81913ce6c6d/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:21.709559 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fa796-ee96-4596-b345-0153693dba00 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:21.710125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fa796-ee96-4596-b345-0153693dba00 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:21.710214 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fa796-ee96-4596-b345-0153693dba00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:21.729528 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46247dd-fcef-4dad-8c0d-c2c8331a48f5 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:21.732238 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-c46247dd-fcef-4dad-8c0d-c2c8331a48f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:21.768713 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-a12fa796-ee96-4596-b345-0153693dba00 None None] MFA Rules not processed for user `9afa3361f65941aaaf6ac81913ce6c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:21.769947 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-a12fa796-ee96-4596-b345-0153693dba00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:21.826852 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46247dd-fcef-4dad-8c0d-c2c8331a48f5 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:21.831472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e80cb-a3a5-4831-a783-45876b9f30bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:21.832362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e80cb-a3a5-4831-a783-45876b9f30bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:21.832916 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e80cb-a3a5-4831-a783-45876b9f30bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:21.833190 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e80cb-a3a5-4831-a783-45876b9f30bb admin admin] PATH_INFO: `/v3/projects/29452ee0848d44958f7c4ece35287255` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:21.835926 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e80cb-a3a5-4831-a783-45876b9f30bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=29452ee0848d44958f7c4ece35287255)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:21.842965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 942/1883] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:21.843130 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e80cb-a3a5-4831-a783-45876b9f30bb admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:21.882664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fa796-ee96-4596-b345-0153693dba00 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:21.884172 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-a12fa796-ee96-4596-b345-0153693dba00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:21.946569 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:21.952667 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fa796-ee96-4596-b345-0153693dba00 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:21.962678 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-197e80cb-a3a5-4831-a783-45876b9f30bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29452ee0848d44958f7c4ece35287255', 'request_id': 'req-197e80cb-a3a5-4831-a783-45876b9f30bb'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:21.969117 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-197e80cb-a3a5-4831-a783-45876b9f30bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29452ee0848d44958f7c4ece35287255', 'request_id': 'req-197e80cb-a3a5-4831-a783-45876b9f30bb'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:21.975090 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-197e80cb-a3a5-4831-a783-45876b9f30bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29452ee0848d44958f7c4ece35287255', 'request_id': 'req-197e80cb-a3a5-4831-a783-45876b9f30bb'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:22.007078 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876c855-ef91-4a82-947d-5ed8232c5af8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:22.007736 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876c855-ef91-4a82-947d-5ed8232c5af8 service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:22.008028 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876c855-ef91-4a82-947d-5ed8232c5af8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:22.009295 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876c855-ef91-4a82-947d-5ed8232c5af8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:22.065825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876c855-ef91-4a82-947d-5ed8232c5af8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:22.067264 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876c855-ef91-4a82-947d-5ed8232c5af8 service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:22.072667 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:22.077489 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 943/1884] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:57:22.092191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876c855-ef91-4a82-947d-5ed8232c5af8 service cinder] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:22.099147 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-197e80cb-a3a5-4831-a783-45876b9f30bb admin admin] The token cache is being invalidate because project 29452ee0848d44958f7c4ece35287255 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:57:22.099671 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-197e80cb-a3a5-4831-a783-45876b9f30bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:22.100125 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-197e80cb-a3a5-4831-a783-45876b9f30bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:22.101694 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 942/1885] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:57:21 2022] DELETE /identity/v3/projects/29452ee0848d44958f7c4ece35287255 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:22.105542 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e80cb-a3a5-4831-a783-45876b9f30bb admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:22.106922 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-197e80cb-a3a5-4831-a783-45876b9f30bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:22.154031 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876c855-ef91-4a82-947d-5ed8232c5af8 service cinder] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:22.159029 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc55dfc-66ae-4399-a193-862c03028305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:22.159903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc55dfc-66ae-4399-a193-862c03028305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:22.160212 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc55dfc-66ae-4399-a193-862c03028305 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:22.160489 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc55dfc-66ae-4399-a193-862c03028305 admin admin] PATH_INFO: `/v3/users/9afa3361f65941aaaf6ac81913ce6c6d` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:22.161750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc55dfc-66ae-4399-a193-862c03028305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9afa3361f65941aaaf6ac81913ce6c6d)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:22.163729 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc55dfc-66ae-4399-a193-862c03028305 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:22.171565 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e80cb-a3a5-4831-a783-45876b9f30bb admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:22.176288 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c40c5a-a7d0-409c-a55a-b7c31d8f8148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:22.177200 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c40c5a-a7d0-409c-a55a-b7c31d8f8148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:22.177591 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c40c5a-a7d0-409c-a55a-b7c31d8f8148 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:22.177832 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c40c5a-a7d0-409c-a55a-b7c31d8f8148 admin admin] PATH_INFO: `/v3/users/d8eaf089c76e426db1cf40c697eb3189` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:22.179200 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c40c5a-a7d0-409c-a55a-b7c31d8f8148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8eaf089c76e426db1cf40c697eb3189)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:22.182654 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c40c5a-a7d0-409c-a55a-b7c31d8f8148 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:22.405201 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-8fc55dfc-66ae-4399-a193-862c03028305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9afa3361f65941aaaf6ac81913ce6c6d'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:22.417125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-8fc55dfc-66ae-4399-a193-862c03028305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9afa3361f65941aaaf6ac81913ce6c6d'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:22.424255 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-8fc55dfc-66ae-4399-a193-862c03028305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9afa3361f65941aaaf6ac81913ce6c6d'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:22.424888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-8fc55dfc-66ae-4399-a193-862c03028305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9afa3361f65941aaaf6ac81913ce6c6d'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:22.444523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-a3c40c5a-a7d0-409c-a55a-b7c31d8f8148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8eaf089c76e426db1cf40c697eb3189'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:22.445193 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-a3c40c5a-a7d0-409c-a55a-b7c31d8f8148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8eaf089c76e426db1cf40c697eb3189'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:22.456771 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-a3c40c5a-a7d0-409c-a55a-b7c31d8f8148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8eaf089c76e426db1cf40c697eb3189'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:22.463854 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-a3c40c5a-a7d0-409c-a55a-b7c31d8f8148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8eaf089c76e426db1cf40c697eb3189'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:22.464517 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-a3c40c5a-a7d0-409c-a55a-b7c31d8f8148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8eaf089c76e426db1cf40c697eb3189'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:22.589102 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-8fc55dfc-66ae-4399-a193-862c03028305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9afa3361f65941aaaf6ac81913ce6c6d'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:22.596017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 944/1886] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:57:22 2022] DELETE /identity/v3/users/9afa3361f65941aaaf6ac81913ce6c6d => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:57:22.600633 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d22a7-c5fa-49fb-a2c2-fcaf83efdccf None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:22.601000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d22a7-c5fa-49fb-a2c2-fcaf83efdccf None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:22.601350 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d22a7-c5fa-49fb-a2c2-fcaf83efdccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:22.620292 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-2f6d22a7-c5fa-49fb-a2c2-fcaf83efdccf None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:22.621597 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-2f6d22a7-c5fa-49fb-a2c2-fcaf83efdccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:22.690341 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 943/1887] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:57:22 2022] DELETE /identity/v3/users/d8eaf089c76e426db1cf40c697eb3189 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:22.697136 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 945/1888] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:22.715686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c40c5a-a7d0-409c-a55a-b7c31d8f8148 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:22.717865 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-a3c40c5a-a7d0-409c-a55a-b7c31d8f8148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:22.810027 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:22.819211 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c40c5a-a7d0-409c-a55a-b7c31d8f8148 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:22.828523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e8a14-7a01-473c-ada0-c5ead37c1462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:22.829247 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e8a14-7a01-473c-ada0-c5ead37c1462 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:22.829545 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e8a14-7a01-473c-ada0-c5ead37c1462 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:22.829830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e8a14-7a01-473c-ada0-c5ead37c1462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:22.916217 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e8a14-7a01-473c-ada0-c5ead37c1462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:22.918032 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e8a14-7a01-473c-ada0-c5ead37c1462 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:22.929921 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 944/1889] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:57:23.019003 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d22a7-c5fa-49fb-a2c2-fcaf83efdccf None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:23.020667 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-2f6d22a7-c5fa-49fb-a2c2-fcaf83efdccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:23.040592 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d22a7-c5fa-49fb-a2c2-fcaf83efdccf None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:23.048581 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a976f2d-e342-4ada-b765-3503c6a04f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:23.049552 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a976f2d-e342-4ada-b765-3503c6a04f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:23.049940 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a976f2d-e342-4ada-b765-3503c6a04f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:23.050296 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a976f2d-e342-4ada-b765-3503c6a04f5f admin admin] PATH_INFO: `/v3/users/8a51069e8e944e8f85e2afcb5dba7d02` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:23.051603 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a976f2d-e342-4ada-b765-3503c6a04f5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a51069e8e944e8f85e2afcb5dba7d02)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:23.064937 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a976f2d-e342-4ada-b765-3503c6a04f5f admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:23.086501 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:23.302342 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e8a14-7a01-473c-ada0-c5ead37c1462 service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:23.303492 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-2d8e8a14-7a01-473c-ada0-c5ead37c1462 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:23.313781 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-7a976f2d-e342-4ada-b765-3503c6a04f5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a51069e8e944e8f85e2afcb5dba7d02'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:23.319518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e8a14-7a01-473c-ada0-c5ead37c1462 service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:23.334880 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-7a976f2d-e342-4ada-b765-3503c6a04f5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a51069e8e944e8f85e2afcb5dba7d02'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:23.338731 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c230a-0cba-46fd-b60c-91f7e09a7293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:23.339789 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c230a-0cba-46fd-b60c-91f7e09a7293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:23.340074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c230a-0cba-46fd-b60c-91f7e09a7293 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:23.340750 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c230a-0cba-46fd-b60c-91f7e09a7293 admin admin] PATH_INFO: `/v3/projects/d670da926d564de189529784cb92de35` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:23.343308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-7a976f2d-e342-4ada-b765-3503c6a04f5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a51069e8e944e8f85e2afcb5dba7d02'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:23.343997 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c230a-0cba-46fd-b60c-91f7e09a7293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d670da926d564de189529784cb92de35)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:23.344129 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-7a976f2d-e342-4ada-b765-3503c6a04f5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a51069e8e944e8f85e2afcb5dba7d02'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:23.345949 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c230a-0cba-46fd-b60c-91f7e09a7293 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:23.424808 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-7a976f2d-e342-4ada-b765-3503c6a04f5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a51069e8e944e8f85e2afcb5dba7d02'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:23.431572 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 946/1890] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:57:23 2022] DELETE /identity/v3/users/8a51069e8e944e8f85e2afcb5dba7d02 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:23.435912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7ae07-049e-492a-8b61-983851a0e856 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:23.436231 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7ae07-049e-492a-8b61-983851a0e856 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:23.436519 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7ae07-049e-492a-8b61-983851a0e856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:23.456213 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-8dd7ae07-049e-492a-8b61-983851a0e856 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:23.457418 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-8dd7ae07-049e-492a-8b61-983851a0e856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:23.463159 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-e47c230a-0cba-46fd-b60c-91f7e09a7293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd670da926d564de189529784cb92de35', 'request_id': 'req-e47c230a-0cba-46fd-b60c-91f7e09a7293'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:23.469484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-e47c230a-0cba-46fd-b60c-91f7e09a7293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd670da926d564de189529784cb92de35', 'request_id': 'req-e47c230a-0cba-46fd-b60c-91f7e09a7293'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:23.475881 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-e47c230a-0cba-46fd-b60c-91f7e09a7293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd670da926d564de189529784cb92de35', 'request_id': 'req-e47c230a-0cba-46fd-b60c-91f7e09a7293'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:23.517663 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 947/1891] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:23.527959 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7ae07-049e-492a-8b61-983851a0e856 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:23.529352 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-8dd7ae07-049e-492a-8b61-983851a0e856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:23.565464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-e47c230a-0cba-46fd-b60c-91f7e09a7293 admin admin] The token cache is being invalidate because project d670da926d564de189529784cb92de35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:57:23.565765 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-e47c230a-0cba-46fd-b60c-91f7e09a7293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:23.566790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-e47c230a-0cba-46fd-b60c-91f7e09a7293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:23.570456 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 945/1892] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:57:23 2022] DELETE /identity/v3/projects/d670da926d564de189529784cb92de35 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:57:23.570456 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c230a-0cba-46fd-b60c-91f7e09a7293 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:23.575792 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-e47c230a-0cba-46fd-b60c-91f7e09a7293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:23.590101 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c230a-0cba-46fd-b60c-91f7e09a7293 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:23.595496 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e8f9a-0367-4f31-bc90-9c41e7fcdce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:23.596406 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e8f9a-0367-4f31-bc90-9c41e7fcdce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:23.596695 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e8f9a-0367-4f31-bc90-9c41e7fcdce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:23.596986 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e8f9a-0367-4f31-bc90-9c41e7fcdce2 admin admin] PATH_INFO: `/v3/projects/7a54a49c2c8a4775ac5804a0b96bbe45` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:23.598327 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e8f9a-0367-4f31-bc90-9c41e7fcdce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a54a49c2c8a4775ac5804a0b96bbe45)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:23.600279 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7ae07-049e-492a-8b61-983851a0e856 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:23.600559 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e8f9a-0367-4f31-bc90-9c41e7fcdce2 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:23.603912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c48bb-69a9-4a44-b8f9-bb1c4792d503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:23.604671 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c48bb-69a9-4a44-b8f9-bb1c4792d503 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:23.604959 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c48bb-69a9-4a44-b8f9-bb1c4792d503 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:23.605240 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c48bb-69a9-4a44-b8f9-bb1c4792d503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:23.607182 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-dc1c48bb-69a9-4a44-b8f9-bb1c4792d503 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:23.619952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c48bb-69a9-4a44-b8f9-bb1c4792d503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:23.621527 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c48bb-69a9-4a44-b8f9-bb1c4792d503 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:23.631749 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 948/1893] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:57:23.633217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1a462-5b6a-464b-9e59-775e3728f98e None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:23.633617 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1a462-5b6a-464b-9e59-775e3728f98e None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:23.633802 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1a462-5b6a-464b-9e59-775e3728f98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:23.651839 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-d6d1a462-5b6a-464b-9e59-775e3728f98e None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:23.653146 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-d6d1a462-5b6a-464b-9e59-775e3728f98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:23.663107 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 949/1894] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:23.670857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f57b1-47d9-419f-9983-c3e040cf98b1 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:23.671149 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f57b1-47d9-419f-9983-c3e040cf98b1 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:23.671431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f57b1-47d9-419f-9983-c3e040cf98b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:23.689841 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-8f2f57b1-47d9-419f-9983-c3e040cf98b1 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:23.692226 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-8f2f57b1-47d9-419f-9983-c3e040cf98b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:23.699574 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 950/1895] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:57:23.703851 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f57b1-47d9-419f-9983-c3e040cf98b1 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:23.714028 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f57b1-47d9-419f-9983-c3e040cf98b1 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:23.718577 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1f5b2-219d-4811-aa5e-a8984faa6e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:23.719237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1f5b2-219d-4811-aa5e-a8984faa6e15 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:23.719520 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1f5b2-219d-4811-aa5e-a8984faa6e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:23.719798 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1f5b2-219d-4811-aa5e-a8984faa6e15 admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:23.720614 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1f5b2-219d-4811-aa5e-a8984faa6e15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:57:23.720924 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1f5b2-219d-4811-aa5e-a8984faa6e15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:23.722505 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1f5b2-219d-4811-aa5e-a8984faa6e15 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:23.734215 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 951/1896] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:57:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:57:23.741142 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1f5b2-219d-4811-aa5e-a8984faa6e15 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:23.750849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1f5b2-219d-4811-aa5e-a8984faa6e15 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:23.753404 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-047e8f9a-0367-4f31-bc90-9c41e7fcdce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a54a49c2c8a4775ac5804a0b96bbe45', 'request_id': 'req-047e8f9a-0367-4f31-bc90-9c41e7fcdce2'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:23.760160 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-047e8f9a-0367-4f31-bc90-9c41e7fcdce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a54a49c2c8a4775ac5804a0b96bbe45', 'request_id': 'req-047e8f9a-0367-4f31-bc90-9c41e7fcdce2'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:23.765894 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-047e8f9a-0367-4f31-bc90-9c41e7fcdce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a54a49c2c8a4775ac5804a0b96bbe45', 'request_id': 'req-047e8f9a-0367-4f31-bc90-9c41e7fcdce2'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:23.768516 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:23.815662 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092e87a-a0dd-4f92-9a71-ed3bf824654d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:23.816567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092e87a-a0dd-4f92-9a71-ed3bf824654d admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:23.816908 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092e87a-a0dd-4f92-9a71-ed3bf824654d admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:23.817195 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092e87a-a0dd-4f92-9a71-ed3bf824654d admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:23.819952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092e87a-a0dd-4f92-9a71-ed3bf824654d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:23.822185 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092e87a-a0dd-4f92-9a71-ed3bf824654d admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:23.856992 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-047e8f9a-0367-4f31-bc90-9c41e7fcdce2 admin admin] The token cache is being invalidate because project 7a54a49c2c8a4775ac5804a0b96bbe45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:57:23.857283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-047e8f9a-0367-4f31-bc90-9c41e7fcdce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:23.857927 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-047e8f9a-0367-4f31-bc90-9c41e7fcdce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:23.859526 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 946/1897] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:57:23 2022] DELETE /identity/v3/projects/7a54a49c2c8a4775ac5804a0b96bbe45 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:23.864318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8a13b-62a5-43fe-a043-cb71d5fd0963 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:23.864655 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8a13b-62a5-43fe-a043-cb71d5fd0963 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:23.865997 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8a13b-62a5-43fe-a043-cb71d5fd0963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:23.887882 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-81d8a13b-62a5-43fe-a043-cb71d5fd0963 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:23.889187 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-81d8a13b-62a5-43fe-a043-cb71d5fd0963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:23.898772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 947/1898] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:57:23.906954 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933153a-7ff1-4789-84e4-c20eff60d77a None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:23.907718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933153a-7ff1-4789-84e4-c20eff60d77a None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:23.907718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933153a-7ff1-4789-84e4-c20eff60d77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:23.917315 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:23.928244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-c933153a-7ff1-4789-84e4-c20eff60d77a None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:23.929474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-c933153a-7ff1-4789-84e4-c20eff60d77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:23.938478 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 948/1899] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:57:23.942532 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933153a-7ff1-4789-84e4-c20eff60d77a None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:23.954080 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933153a-7ff1-4789-84e4-c20eff60d77a None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:23.958397 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 952/1900] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:57:23 2022] POST /identity/v3/projects => generated 382 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:57:23.962523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092e87a-a0dd-4f92-9a71-ed3bf824654d admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:23.964960 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d352e-058a-43c0-ad7c-e81b70f27d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:23.965742 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d352e-058a-43c0-ad7c-e81b70f27d79 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:23.966128 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d352e-058a-43c0-ad7c-e81b70f27d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:23.967934 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-c092e87a-a0dd-4f92-9a71-ed3bf824654d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:23.968766 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d352e-058a-43c0-ad7c-e81b70f27d79 admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:23.970046 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d352e-058a-43c0-ad7c-e81b70f27d79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:57:23.970046 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d352e-058a-43c0-ad7c-e81b70f27d79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:23.971805 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d352e-058a-43c0-ad7c-e81b70f27d79 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:23.989533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 949/1901] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:57:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:57:23.993066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d352e-058a-43c0-ad7c-e81b70f27d79 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:24.013191 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d352e-058a-43c0-ad7c-e81b70f27d79 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:24.106205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092e87a-a0dd-4f92-9a71-ed3bf824654d admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:24.112153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af994b5e-696e-43e9-a970-0e8d73fa005a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:24.112977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af994b5e-696e-43e9-a970-0e8d73fa005a admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:24.113267 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af994b5e-696e-43e9-a970-0e8d73fa005a admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:24.113547 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af994b5e-696e-43e9-a970-0e8d73fa005a admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:24.114244 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af994b5e-696e-43e9-a970-0e8d73fa005a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:24.116530 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af994b5e-696e-43e9-a970-0e8d73fa005a admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:24.146863 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831ae4b-be28-4644-b0f8-9cbc12618d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:24.147105 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831ae4b-be28-4644-b0f8-9cbc12618d11 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:24.147368 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831ae4b-be28-4644-b0f8-9cbc12618d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:24.147658 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831ae4b-be28-4644-b0f8-9cbc12618d11 admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:24.148706 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831ae4b-be28-4644-b0f8-9cbc12618d11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:24.150867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831ae4b-be28-4644-b0f8-9cbc12618d11 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:24.254846 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 953/1902] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:57:23 2022] POST /identity/v3/users => generated 292 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:57:24.260305 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af994b5e-696e-43e9-a970-0e8d73fa005a admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:24.270869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af994b5e-696e-43e9-a970-0e8d73fa005a admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:24.276343 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f988b0e-ac93-4388-9cfd-efc3857f88f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:24.277098 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f988b0e-ac93-4388-9cfd-efc3857f88f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:24.277529 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f988b0e-ac93-4388-9cfd-efc3857f88f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:24.277910 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f988b0e-ac93-4388-9cfd-efc3857f88f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:24.278722 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f988b0e-ac93-4388-9cfd-efc3857f88f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:24.280969 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f988b0e-ac93-4388-9cfd-efc3857f88f4 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:24.294766 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 950/1903] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:57:23 2022] POST /identity/v3/projects => generated 378 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:57:24.301263 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831ae4b-be28-4644-b0f8-9cbc12618d11 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:24.302932 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 954/1904] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:24 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:57:24.303279 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-b831ae4b-be28-4644-b0f8-9cbc12618d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:24.304568 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f988b0e-ac93-4388-9cfd-efc3857f88f4 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:24.330361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f988b0e-ac93-4388-9cfd-efc3857f88f4 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:24.393102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831ae4b-be28-4644-b0f8-9cbc12618d11 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:24.398570 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abf564-e004-42c3-acf9-6f96f6cb5725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:24.399438 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abf564-e004-42c3-acf9-6f96f6cb5725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:24.399727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abf564-e004-42c3-acf9-6f96f6cb5725 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:24.400006 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abf564-e004-42c3-acf9-6f96f6cb5725 admin admin] PATH_INFO: `/v3/projects/36cf03ba8b6b46ee8d88fea473e8cb2e` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:24.401217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd482ac3-7d73-40e2-a4e4-3a24df888e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:24.401373 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abf564-e004-42c3-acf9-6f96f6cb5725 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36cf03ba8b6b46ee8d88fea473e8cb2e)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:24.401901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd482ac3-7d73-40e2-a4e4-3a24df888e52 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:24.402192 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd482ac3-7d73-40e2-a4e4-3a24df888e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:24.402482 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd482ac3-7d73-40e2-a4e4-3a24df888e52 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:24.403179 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd482ac3-7d73-40e2-a4e4-3a24df888e52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:24.403282 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abf564-e004-42c3-acf9-6f96f6cb5725 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:24.405119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd482ac3-7d73-40e2-a4e4-3a24df888e52 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:24.516310 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 955/1905] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:57:24 2022] POST /identity/v3/users => generated 290 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:57:24.516310 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd482ac3-7d73-40e2-a4e4-3a24df888e52 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:24.526664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd482ac3-7d73-40e2-a4e4-3a24df888e52 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:24.533529 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d87d5-f90e-45b4-a448-080437651f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:24.534584 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d87d5-f90e-45b4-a448-080437651f35 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:24.535057 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d87d5-f90e-45b4-a448-080437651f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:24.535529 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d87d5-f90e-45b4-a448-080437651f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:24.536467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d87d5-f90e-45b4-a448-080437651f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:24.538475 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d87d5-f90e-45b4-a448-080437651f35 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:24.548333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-e6abf564-e004-42c3-acf9-6f96f6cb5725 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36cf03ba8b6b46ee8d88fea473e8cb2e', 'request_id': 'req-e6abf564-e004-42c3-acf9-6f96f6cb5725'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:24.552080 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 956/1906] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:24 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:57:24.553676 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d87d5-f90e-45b4-a448-080437651f35 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:24.557926 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-e6abf564-e004-42c3-acf9-6f96f6cb5725 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36cf03ba8b6b46ee8d88fea473e8cb2e', 'request_id': 'req-e6abf564-e004-42c3-acf9-6f96f6cb5725'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:24.559579 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:24.564247 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d87d5-f90e-45b4-a448-080437651f35 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:24.565193 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-e6abf564-e004-42c3-acf9-6f96f6cb5725 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36cf03ba8b6b46ee8d88fea473e8cb2e', 'request_id': 'req-e6abf564-e004-42c3-acf9-6f96f6cb5725'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:24.603677 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:24.622238 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bd8dc-db96-4e5a-b8fa-0d0563cd03c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:24.622909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bd8dc-db96-4e5a-b8fa-0d0563cd03c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:24.623192 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bd8dc-db96-4e5a-b8fa-0d0563cd03c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:24.623466 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bd8dc-db96-4e5a-b8fa-0d0563cd03c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:24.624216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bd8dc-db96-4e5a-b8fa-0d0563cd03c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:24.625808 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bd8dc-db96-4e5a-b8fa-0d0563cd03c3 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:24.636429 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 957/1907] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:24 2022] GET /identity/v3/roles => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:57:24.636573 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-e6abf564-e004-42c3-acf9-6f96f6cb5725 admin admin] The token cache is being invalidate because project 36cf03ba8b6b46ee8d88fea473e8cb2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:57:24.636819 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-e6abf564-e004-42c3-acf9-6f96f6cb5725 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:24.637467 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-e6abf564-e004-42c3-acf9-6f96f6cb5725 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:24.639014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 951/1908] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:57:24 2022] DELETE /identity/v3/projects/36cf03ba8b6b46ee8d88fea473e8cb2e => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:24.640180 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bd8dc-db96-4e5a-b8fa-0d0563cd03c3 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:24.642082 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-618bd8dc-db96-4e5a-b8fa-0d0563cd03c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:24.642569 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abf564-e004-42c3-acf9-6f96f6cb5725 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:24.643873 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-e6abf564-e004-42c3-acf9-6f96f6cb5725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:24.655787 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bd8dc-db96-4e5a-b8fa-0d0563cd03c3 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:24.661073 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abf564-e004-42c3-acf9-6f96f6cb5725 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:24.661179 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6442c9-8c06-4bd1-a03d-acd8154e4717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:24.661283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed411568-a523-419a-b19f-7be5afce6be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:24.661378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6442c9-8c06-4bd1-a03d-acd8154e4717 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:24.661646 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6442c9-8c06-4bd1-a03d-acd8154e4717 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:24.661934 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6442c9-8c06-4bd1-a03d-acd8154e4717 admin admin] PATH_INFO: `/v3/projects/47408942ea1f4c6d88fe78463737d4d0/users/0b43e0ce1d6d4951b7fa9bb4db013c42/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:24.662052 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed411568-a523-419a-b19f-7be5afce6be2 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:24.662315 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed411568-a523-419a-b19f-7be5afce6be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:24.662591 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed411568-a523-419a-b19f-7be5afce6be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:24.663316 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed411568-a523-419a-b19f-7be5afce6be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:24.664950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed411568-a523-419a-b19f-7be5afce6be2 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:24.675073 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 952/1909] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:24 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:57:24.675877 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed411568-a523-419a-b19f-7be5afce6be2 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:24.678012 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-ed411568-a523-419a-b19f-7be5afce6be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:24.682234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6442c9-8c06-4bd1-a03d-acd8154e4717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47408942ea1f4c6d88fe78463737d4d0, user_id=0b43e0ce1d6d4951b7fa9bb4db013c42, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:24.684902 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6442c9-8c06-4bd1-a03d-acd8154e4717 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:24.691567 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed411568-a523-419a-b19f-7be5afce6be2 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:24.697237 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b09b1-7e4b-4585-91e3-9833ab56b892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:24.698132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b09b1-7e4b-4585-91e3-9833ab56b892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:24.698422 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b09b1-7e4b-4585-91e3-9833ab56b892 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:24.698704 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b09b1-7e4b-4585-91e3-9833ab56b892 admin admin] PATH_INFO: `/v3/users/fd7decabd8594e9f9c82a1ee2eae1593` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:24.699917 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b09b1-7e4b-4585-91e3-9833ab56b892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd7decabd8594e9f9c82a1ee2eae1593)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:24.701943 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b09b1-7e4b-4585-91e3-9833ab56b892 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:24.829488 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 958/1910] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:57:24 2022] PUT /identity/v3/projects/47408942ea1f4c6d88fe78463737d4d0/users/0b43e0ce1d6d4951b7fa9bb4db013c42/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:24.830309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6442c9-8c06-4bd1-a03d-acd8154e4717 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:24.892271 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6442c9-8c06-4bd1-a03d-acd8154e4717 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:24.897068 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc5313-1aaa-4249-872b-9c2422a2dced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:24.897956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc5313-1aaa-4249-872b-9c2422a2dced admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:24.898240 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc5313-1aaa-4249-872b-9c2422a2dced admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:24.898515 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc5313-1aaa-4249-872b-9c2422a2dced admin admin] PATH_INFO: `/v3/projects/110ed54c7490407ca67b5e01fc492858/users/fb0a3c78e2be4ad7b1cc3ff1b3421c93/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:24.913154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc5313-1aaa-4249-872b-9c2422a2dced admin admin] RBAC: Authorizing `identity:create_grant(project_id=110ed54c7490407ca67b5e01fc492858, user_id=fb0a3c78e2be4ad7b1cc3ff1b3421c93, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:24.915783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc5313-1aaa-4249-872b-9c2422a2dced admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:25.002404 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-da5b09b1-7e4b-4585-91e3-9833ab56b892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd7decabd8594e9f9c82a1ee2eae1593'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:25.003062 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-da5b09b1-7e4b-4585-91e3-9833ab56b892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd7decabd8594e9f9c82a1ee2eae1593'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:25.015698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-da5b09b1-7e4b-4585-91e3-9833ab56b892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd7decabd8594e9f9c82a1ee2eae1593'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:25.022872 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-da5b09b1-7e4b-4585-91e3-9833ab56b892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd7decabd8594e9f9c82a1ee2eae1593'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:25.023588 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-da5b09b1-7e4b-4585-91e3-9833ab56b892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd7decabd8594e9f9c82a1ee2eae1593'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:25.074907 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 959/1911] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:57:24 2022] PUT /identity/v3/projects/110ed54c7490407ca67b5e01fc492858/users/fb0a3c78e2be4ad7b1cc3ff1b3421c93/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:25.085286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1332b-cd7c-4868-afdf-b668eeac0b4f None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:25.085286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1332b-cd7c-4868-afdf-b668eeac0b4f None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:25.085286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1332b-cd7c-4868-afdf-b668eeac0b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:25.105824 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-9ec1332b-cd7c-4868-afdf-b668eeac0b4f None None] MFA Rules not processed for user `0b43e0ce1d6d4951b7fa9bb4db013c42`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:25.107260 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-9ec1332b-cd7c-4868-afdf-b668eeac0b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:25.118684 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 953/1912] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:57:24 2022] DELETE /identity/v3/users/fd7decabd8594e9f9c82a1ee2eae1593 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:25.119972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcba030-7eb5-4d3c-abc1-7c26064d1f79 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:25.120415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcba030-7eb5-4d3c-abc1-7c26064d1f79 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:25.120728 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcba030-7eb5-4d3c-abc1-7c26064d1f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:25.158139 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:25.172221 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-dfcba030-7eb5-4d3c-abc1-7c26064d1f79 None None] MFA Rules not processed for user `fb0a3c78e2be4ad7b1cc3ff1b3421c93`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:25.173714 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-dfcba030-7eb5-4d3c-abc1-7c26064d1f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:25.202283 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 960/1913] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:25.203437 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1332b-cd7c-4868-afdf-b668eeac0b4f None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:25.205260 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-9ec1332b-cd7c-4868-afdf-b668eeac0b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:25.280511 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 954/1914] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:25.285396 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcba030-7eb5-4d3c-abc1-7c26064d1f79 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:25.287788 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-dfcba030-7eb5-4d3c-abc1-7c26064d1f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:25.306547 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1332b-cd7c-4868-afdf-b668eeac0b4f None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:25.329833 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:25.370387 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcba030-7eb5-4d3c-abc1-7c26064d1f79 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:25.376219 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f4e5b-85dd-4137-ba39-454507725467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:25.377043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f4e5b-85dd-4137-ba39-454507725467 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:25.377464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f4e5b-85dd-4137-ba39-454507725467 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:25.378169 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f4e5b-85dd-4137-ba39-454507725467 admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:25.378910 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f4e5b-85dd-4137-ba39-454507725467 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:25.382240 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f4e5b-85dd-4137-ba39-454507725467 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:25.389252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78c3ec-3831-441d-a2a3-0fd9b39c6029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:25.390125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78c3ec-3831-441d-a2a3-0fd9b39c6029 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:25.390616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78c3ec-3831-441d-a2a3-0fd9b39c6029 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:25.391118 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78c3ec-3831-441d-a2a3-0fd9b39c6029 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:25.393204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78c3ec-3831-441d-a2a3-0fd9b39c6029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:25.394860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78c3ec-3831-441d-a2a3-0fd9b39c6029 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:25.506148 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 955/1915] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:57:25 2022] POST /identity/v3/projects => generated 378 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:57:25.512208 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f4e5b-85dd-4137-ba39-454507725467 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:25.530512 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 961/1916] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:57:25 2022] POST /identity/v3/projects => generated 384 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:57:25.537383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78c3ec-3831-441d-a2a3-0fd9b39c6029 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:25.616004 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f4e5b-85dd-4137-ba39-454507725467 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:25.619631 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78c3ec-3831-441d-a2a3-0fd9b39c6029 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:25.624502 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ab79f-4cb5-46fe-aaa9-a1507aeec7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:25.625182 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ab79f-4cb5-46fe-aaa9-a1507aeec7fb admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:25.625466 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ab79f-4cb5-46fe-aaa9-a1507aeec7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:25.625747 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ab79f-4cb5-46fe-aaa9-a1507aeec7fb admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:25.626434 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ab79f-4cb5-46fe-aaa9-a1507aeec7fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:25.628364 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ab79f-4cb5-46fe-aaa9-a1507aeec7fb admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:25.671894 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb0297-6f96-4760-a7ac-e9df1783eb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:25.672604 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb0297-6f96-4760-a7ac-e9df1783eb2f admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:25.672898 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb0297-6f96-4760-a7ac-e9df1783eb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:25.673175 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb0297-6f96-4760-a7ac-e9df1783eb2f admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:25.673867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb0297-6f96-4760-a7ac-e9df1783eb2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:25.675802 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb0297-6f96-4760-a7ac-e9df1783eb2f admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:25.768249 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:25.775430 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 962/1917] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:57:25 2022] POST /identity/v3/users => generated 299 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:57:25.776324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ab79f-4cb5-46fe-aaa9-a1507aeec7fb admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:25.777915 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-ba9ab79f-4cb5-46fe-aaa9-a1507aeec7fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:25.790273 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ab79f-4cb5-46fe-aaa9-a1507aeec7fb admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:25.794852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1f298-5165-4a64-a455-88f957e3afeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:25.795699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1f298-5165-4a64-a455-88f957e3afeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:25.795983 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1f298-5165-4a64-a455-88f957e3afeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:25.796299 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1f298-5165-4a64-a455-88f957e3afeb admin admin] PATH_INFO: `/v3/projects/36e50f1ea48b4f6e859eb9b464e8a5be` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:25.797512 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1f298-5165-4a64-a455-88f957e3afeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=36e50f1ea48b4f6e859eb9b464e8a5be)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:25.799386 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1f298-5165-4a64-a455-88f957e3afeb admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:25.823487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 956/1918] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:57:25 2022] POST /identity/v3/users => generated 290 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:57:25.823487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb0297-6f96-4760-a7ac-e9df1783eb2f admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:25.831353 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb0297-6f96-4760-a7ac-e9df1783eb2f admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:25.841007 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d315f-de05-43c6-8c62-7962f75075b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:25.841712 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d315f-de05-43c6-8c62-7962f75075b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:25.842013 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d315f-de05-43c6-8c62-7962f75075b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:25.842363 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d315f-de05-43c6-8c62-7962f75075b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:25.843096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d315f-de05-43c6-8c62-7962f75075b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:25.844831 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d315f-de05-43c6-8c62-7962f75075b6 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:25.863188 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 957/1919] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:25 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:57:25.864300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d315f-de05-43c6-8c62-7962f75075b6 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:25.874321 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d315f-de05-43c6-8c62-7962f75075b6 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:25.878880 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1accf67-788b-405c-9fc8-d17c027e325f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:25.879511 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1accf67-788b-405c-9fc8-d17c027e325f admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:25.879811 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1accf67-788b-405c-9fc8-d17c027e325f admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:25.880075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1accf67-788b-405c-9fc8-d17c027e325f admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:25.881472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1accf67-788b-405c-9fc8-d17c027e325f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:25.883041 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1accf67-788b-405c-9fc8-d17c027e325f admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:25.893602 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 958/1920] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:25 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:57:25.894373 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1accf67-788b-405c-9fc8-d17c027e325f admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:25.906116 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1accf67-788b-405c-9fc8-d17c027e325f admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:25.910847 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b5ad5-65d7-4929-a54b-07f256a63bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:25.911995 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b5ad5-65d7-4929-a54b-07f256a63bde admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:25.912497 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b5ad5-65d7-4929-a54b-07f256a63bde admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:25.912786 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b5ad5-65d7-4929-a54b-07f256a63bde admin admin] PATH_INFO: `/v3/projects/59c300e847f3446ca28e8343334caa7e/users/06e33b5d0eb84ff496717f56cc562a14/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:25.927554 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b5ad5-65d7-4929-a54b-07f256a63bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c300e847f3446ca28e8343334caa7e, user_id=06e33b5d0eb84ff496717f56cc562a14, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:25.932654 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b5ad5-65d7-4929-a54b-07f256a63bde admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:25.945858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-93f1f298-5165-4a64-a455-88f957e3afeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36e50f1ea48b4f6e859eb9b464e8a5be', 'request_id': 'req-93f1f298-5165-4a64-a455-88f957e3afeb'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:25.952506 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-93f1f298-5165-4a64-a455-88f957e3afeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36e50f1ea48b4f6e859eb9b464e8a5be', 'request_id': 'req-93f1f298-5165-4a64-a455-88f957e3afeb'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:26.042910 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 959/1921] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:57:25 2022] PUT /identity/v3/projects/59c300e847f3446ca28e8343334caa7e/users/06e33b5d0eb84ff496717f56cc562a14/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:26.043751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b5ad5-65d7-4929-a54b-07f256a63bde admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:26.055827 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:26.070724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-93f1f298-5165-4a64-a455-88f957e3afeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36e50f1ea48b4f6e859eb9b464e8a5be', 'request_id': 'req-93f1f298-5165-4a64-a455-88f957e3afeb'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:26.081908 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-93f1f298-5165-4a64-a455-88f957e3afeb admin admin] The token cache is being invalidate because project 36e50f1ea48b4f6e859eb9b464e8a5be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:57:26.082202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-93f1f298-5165-4a64-a455-88f957e3afeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:26.083148 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-93f1f298-5165-4a64-a455-88f957e3afeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:26.085285 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 963/1922] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:57:25 2022] DELETE /identity/v3/projects/36e50f1ea48b4f6e859eb9b464e8a5be => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:26.089293 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1f298-5165-4a64-a455-88f957e3afeb admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:26.090638 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-93f1f298-5165-4a64-a455-88f957e3afeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:26.115886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b5ad5-65d7-4929-a54b-07f256a63bde admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:26.116640 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd512f-0a44-4a1c-8a28-0f7359840406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:26.117323 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd512f-0a44-4a1c-8a28-0f7359840406 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:26.117616 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd512f-0a44-4a1c-8a28-0f7359840406 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:26.117901 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd512f-0a44-4a1c-8a28-0f7359840406 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:26.118643 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd512f-0a44-4a1c-8a28-0f7359840406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:26.120473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd512f-0a44-4a1c-8a28-0f7359840406 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:26.135645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 960/1923] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:26 2022] GET /identity/v3/roles => generated 1427 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:57:26.135645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df785c-01f2-4298-9689-2f3f8723f3ea None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:26.135645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df785c-01f2-4298-9689-2f3f8723f3ea None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:26.135645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df785c-01f2-4298-9689-2f3f8723f3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:26.153689 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-29df785c-01f2-4298-9689-2f3f8723f3ea None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:26.155017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-29df785c-01f2-4298-9689-2f3f8723f3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:26.163843 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 961/1924] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:26.164701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df785c-01f2-4298-9689-2f3f8723f3ea None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:26.165956 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-29df785c-01f2-4298-9689-2f3f8723f3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:26.168056 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1f298-5165-4a64-a455-88f957e3afeb admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:26.174721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ed154-3f25-48fe-97c5-3ebe7a11113f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:26.175723 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ed154-3f25-48fe-97c5-3ebe7a11113f admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:26.176187 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ed154-3f25-48fe-97c5-3ebe7a11113f admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:26.176611 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ed154-3f25-48fe-97c5-3ebe7a11113f admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:26.177787 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ed154-3f25-48fe-97c5-3ebe7a11113f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:26.178428 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df785c-01f2-4298-9689-2f3f8723f3ea None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:26.180348 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ed154-3f25-48fe-97c5-3ebe7a11113f admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:26.183333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063ee5b-18e8-438f-b7cb-72cc271e3653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:26.184412 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063ee5b-18e8-438f-b7cb-72cc271e3653 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:26.184796 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063ee5b-18e8-438f-b7cb-72cc271e3653 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:26.185169 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063ee5b-18e8-438f-b7cb-72cc271e3653 admin admin] PATH_INFO: `/v3/projects/325392c1cd5643a791cb510c48a0c4be/users/5968c582570d46bb91a5af00cb530819/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:26.194864 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 964/1925] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:26 2022] GET /identity/v3/roles => generated 1427 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:57:26.196198 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6100f35-5b01-4992-9881-63a1fc64a5ca None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:26.196571 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6100f35-5b01-4992-9881-63a1fc64a5ca None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:26.196952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6100f35-5b01-4992-9881-63a1fc64a5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:26.204869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0063ee5b-18e8-438f-b7cb-72cc271e3653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=325392c1cd5643a791cb510c48a0c4be, user_id=5968c582570d46bb91a5af00cb530819, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:26.207802 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0063ee5b-18e8-438f-b7cb-72cc271e3653 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:26.220612 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-d6100f35-5b01-4992-9881-63a1fc64a5ca None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:26.221822 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-d6100f35-5b01-4992-9881-63a1fc64a5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:26.230644 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 965/1926] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:26.231569 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6100f35-5b01-4992-9881-63a1fc64a5ca None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:26.240967 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6100f35-5b01-4992-9881-63a1fc64a5ca None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:26.245604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69043d7-bc97-4070-b45f-9a3a4ff38c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:26.250092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69043d7-bc97-4070-b45f-9a3a4ff38c06 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:26.250092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69043d7-bc97-4070-b45f-9a3a4ff38c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:26.250092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69043d7-bc97-4070-b45f-9a3a4ff38c06 admin admin] PATH_INFO: `/v3/projects/59c300e847f3446ca28e8343334caa7e/users/06e33b5d0eb84ff496717f56cc562a14/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:26.250092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69043d7-bc97-4070-b45f-9a3a4ff38c06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c300e847f3446ca28e8343334caa7e, user_id=06e33b5d0eb84ff496717f56cc562a14, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:26.251791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69043d7-bc97-4070-b45f-9a3a4ff38c06 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:26.262200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 966/1927] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:57:26 2022] PUT /identity/v3/projects/59c300e847f3446ca28e8343334caa7e/users/06e33b5d0eb84ff496717f56cc562a14/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:26.263038 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69043d7-bc97-4070-b45f-9a3a4ff38c06 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:26.304265 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 962/1928] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:57:26 2022] PUT /identity/v3/projects/325392c1cd5643a791cb510c48a0c4be/users/5968c582570d46bb91a5af00cb530819/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:26.305990 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303dc97-07d0-4f6e-9dd6-9b983a09fc93 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:26.306285 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303dc97-07d0-4f6e-9dd6-9b983a09fc93 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:26.306570 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303dc97-07d0-4f6e-9dd6-9b983a09fc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:26.326429 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:26.330436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69043d7-bc97-4070-b45f-9a3a4ff38c06 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:26.341406 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-c303dc97-07d0-4f6e-9dd6-9b983a09fc93 None None] MFA Rules not processed for user `06e33b5d0eb84ff496717f56cc562a14`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:26.344419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-c303dc97-07d0-4f6e-9dd6-9b983a09fc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:26.391515 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a4f40-31e8-4506-b80f-4d8271df302c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:26.391515 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a4f40-31e8-4506-b80f-4d8271df302c admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:26.391827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a4f40-31e8-4506-b80f-4d8271df302c admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:26.392070 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a4f40-31e8-4506-b80f-4d8271df302c admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:26.392811 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a4f40-31e8-4506-b80f-4d8271df302c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:57:26.393135 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a4f40-31e8-4506-b80f-4d8271df302c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:26.394755 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a4f40-31e8-4506-b80f-4d8271df302c admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:26.412663 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 967/1929] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:57:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:57:26.414644 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a29dee-c8b6-47e1-8a0a-29243efca46f None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:26.414938 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a29dee-c8b6-47e1-8a0a-29243efca46f None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:26.415229 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a29dee-c8b6-47e1-8a0a-29243efca46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:26.438357 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 963/1930] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:26.439174 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303dc97-07d0-4f6e-9dd6-9b983a09fc93 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:26.447994 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-d4a29dee-c8b6-47e1-8a0a-29243efca46f None None] MFA Rules not processed for user `5968c582570d46bb91a5af00cb530819`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:26.449249 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-d4a29dee-c8b6-47e1-8a0a-29243efca46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:26.451773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303dc97-07d0-4f6e-9dd6-9b983a09fc93 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:26.456677 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa600c1-fae5-4917-8f9a-645a669e89f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:26.457798 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa600c1-fae5-4917-8f9a-645a669e89f7 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:26.458223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa600c1-fae5-4917-8f9a-645a669e89f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:26.459207 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa600c1-fae5-4917-8f9a-645a669e89f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:26.460129 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa600c1-fae5-4917-8f9a-645a669e89f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:26.462125 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa600c1-fae5-4917-8f9a-645a669e89f7 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:26.528902 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 968/1931] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:26.530643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a29dee-c8b6-47e1-8a0a-29243efca46f None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:26.533551 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-d4a29dee-c8b6-47e1-8a0a-29243efca46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:26.596238 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 964/1932] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:57:26 2022] POST /identity/v3/projects => generated 378 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:57:26.596238 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa600c1-fae5-4917-8f9a-645a669e89f7 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:26.598517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a29dee-c8b6-47e1-8a0a-29243efca46f None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:26.650247 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:26.652087 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:26.660226 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760ec97-78d4-48c3-9e01-5ac3970936c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:26.661182 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760ec97-78d4-48c3-9e01-5ac3970936c5 service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:26.661675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760ec97-78d4-48c3-9e01-5ac3970936c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:26.662217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760ec97-78d4-48c3-9e01-5ac3970936c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:26.680714 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa600c1-fae5-4917-8f9a-645a669e89f7 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:26.686230 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1423118-deab-4f67-913f-842878e99157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:26.687629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1423118-deab-4f67-913f-842878e99157 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:26.687629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1423118-deab-4f67-913f-842878e99157 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:26.688052 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1423118-deab-4f67-913f-842878e99157 admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:26.688788 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1423118-deab-4f67-913f-842878e99157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:26.691287 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1423118-deab-4f67-913f-842878e99157 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:26.735813 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760ec97-78d4-48c3-9e01-5ac3970936c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:26.737314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760ec97-78d4-48c3-9e01-5ac3970936c5 service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:26.748675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 969/1933] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:57:26.749480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760ec97-78d4-48c3-9e01-5ac3970936c5 service cinder] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:26.760154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760ec97-78d4-48c3-9e01-5ac3970936c5 service cinder] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:26.765736 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d939d4d-c08c-416e-bd8c-b9d24b0b20cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:26.766495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d939d4d-c08c-416e-bd8c-b9d24b0b20cf admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:26.773851 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d939d4d-c08c-416e-bd8c-b9d24b0b20cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:26.773851 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d939d4d-c08c-416e-bd8c-b9d24b0b20cf admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:26.773851 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d939d4d-c08c-416e-bd8c-b9d24b0b20cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:26.773851 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d939d4d-c08c-416e-bd8c-b9d24b0b20cf admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:26.781763 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 965/1934] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:57:26 2022] POST /identity/v3/projects => generated 376 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:57:26.783146 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1423118-deab-4f67-913f-842878e99157 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:26.862102 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 970/1935] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:57:26 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:57:26.863281 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d939d4d-c08c-416e-bd8c-b9d24b0b20cf admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:26.873971 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d939d4d-c08c-416e-bd8c-b9d24b0b20cf admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:26.888832 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1423118-deab-4f67-913f-842878e99157 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:26.893714 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c24b8f1-6d76-4504-a420-c1a6e1ad8006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:26.894389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24b8f1-6d76-4504-a420-c1a6e1ad8006 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:26.894676 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24b8f1-6d76-4504-a420-c1a6e1ad8006 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:26.894953 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24b8f1-6d76-4504-a420-c1a6e1ad8006 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:26.895645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c24b8f1-6d76-4504-a420-c1a6e1ad8006 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:26.897758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c24b8f1-6d76-4504-a420-c1a6e1ad8006 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:26.925145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ecad3-31a4-4bbf-acfc-73bb2bda1dd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:26.925804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ecad3-31a4-4bbf-acfc-73bb2bda1dd5 service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:26.926095 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ecad3-31a4-4bbf-acfc-73bb2bda1dd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:26.926383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ecad3-31a4-4bbf-acfc-73bb2bda1dd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:26.928838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b47ecad3-31a4-4bbf-acfc-73bb2bda1dd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:26.982620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 966/1936] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:57:26 2022] POST /identity/v3/users => generated 295 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:57:26.982620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c24b8f1-6d76-4504-a420-c1a6e1ad8006 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:26.987922 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ecad3-31a4-4bbf-acfc-73bb2bda1dd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:26.989400 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ecad3-31a4-4bbf-acfc-73bb2bda1dd5 service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:26.991202 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c24b8f1-6d76-4504-a420-c1a6e1ad8006 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:26.996681 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940c10f-7206-4da0-a579-d9351bff37e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:26.997350 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940c10f-7206-4da0-a579-d9351bff37e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:26.997670 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940c10f-7206-4da0-a579-d9351bff37e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:26.997954 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940c10f-7206-4da0-a579-d9351bff37e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:26.998689 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940c10f-7206-4da0-a579-d9351bff37e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:26.998972 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 971/1937] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:57:26.999757 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ecad3-31a4-4bbf-acfc-73bb2bda1dd5 service cinder] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:27.000551 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940c10f-7206-4da0-a579-d9351bff37e6 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:27.011990 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ecad3-31a4-4bbf-acfc-73bb2bda1dd5 service cinder] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:27.012845 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 967/1938] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:26 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:57:27.017098 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940c10f-7206-4da0-a579-d9351bff37e6 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:27.018194 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c246e-aaf9-44a4-b79a-fb80d3e86205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:27.018900 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c246e-aaf9-44a4-b79a-fb80d3e86205 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:27.019191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c246e-aaf9-44a4-b79a-fb80d3e86205 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:27.019507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c246e-aaf9-44a4-b79a-fb80d3e86205 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:27.020273 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c246e-aaf9-44a4-b79a-fb80d3e86205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:27.021930 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c246e-aaf9-44a4-b79a-fb80d3e86205 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:27.028300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940c10f-7206-4da0-a579-d9351bff37e6 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:27.032769 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 972/1939] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:26 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:57:27.032933 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007d772-8c6e-48f0-8e50-034c9ec0e917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:27.033599 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007d772-8c6e-48f0-8e50-034c9ec0e917 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:27.033887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007d772-8c6e-48f0-8e50-034c9ec0e917 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:27.034168 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007d772-8c6e-48f0-8e50-034c9ec0e917 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:27.034893 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007d772-8c6e-48f0-8e50-034c9ec0e917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:27.036579 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007d772-8c6e-48f0-8e50-034c9ec0e917 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:27.036793 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c246e-aaf9-44a4-b79a-fb80d3e86205 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:27.047346 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c246e-aaf9-44a4-b79a-fb80d3e86205 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:27.048862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 968/1940] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:27 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:57:27.052064 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c832f5-1a7f-421f-8f8f-e0d4ea24887c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:27.053314 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007d772-8c6e-48f0-8e50-034c9ec0e917 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:27.053704 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c832f5-1a7f-421f-8f8f-e0d4ea24887c admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:27.053997 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c832f5-1a7f-421f-8f8f-e0d4ea24887c admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:27.054294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c832f5-1a7f-421f-8f8f-e0d4ea24887c admin admin] PATH_INFO: `/v3/projects/35a94d22ddf645a189ad0c10a2687a15/users/3c635ec88f5a4ae6b235ae410d482613/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:27.064356 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007d772-8c6e-48f0-8e50-034c9ec0e917 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:27.072401 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c832f5-1a7f-421f-8f8f-e0d4ea24887c admin admin] RBAC: Authorizing `identity:create_grant(project_id=35a94d22ddf645a189ad0c10a2687a15, user_id=3c635ec88f5a4ae6b235ae410d482613, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:27.073809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14233fc2-338e-4eea-8885-9686b53ea657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:27.074717 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14233fc2-338e-4eea-8885-9686b53ea657 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:27.075004 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14233fc2-338e-4eea-8885-9686b53ea657 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:27.075119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c832f5-1a7f-421f-8f8f-e0d4ea24887c admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:27.075285 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14233fc2-338e-4eea-8885-9686b53ea657 admin admin] PATH_INFO: `/v3/projects/742f4b1647df4002804de715966ef8f9/users/e3438fa080d341e5849d110c29ea4527/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:27.078944 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:27.093215 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14233fc2-338e-4eea-8885-9686b53ea657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=742f4b1647df4002804de715966ef8f9, user_id=e3438fa080d341e5849d110c29ea4527, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:27.095968 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14233fc2-338e-4eea-8885-9686b53ea657 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:27.145545 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 973/1941] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:57:27 2022] PUT /identity/v3/projects/35a94d22ddf645a189ad0c10a2687a15/users/3c635ec88f5a4ae6b235ae410d482613/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:27.149421 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c832f5-1a7f-421f-8f8f-e0d4ea24887c admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:27.173672 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 969/1942] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:57:27 2022] PUT /identity/v3/projects/742f4b1647df4002804de715966ef8f9/users/e3438fa080d341e5849d110c29ea4527/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:57:27.187250 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891098d-4db3-4a85-a62c-f15261bfbd65 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:27.187544 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891098d-4db3-4a85-a62c-f15261bfbd65 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:27.187822 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891098d-4db3-4a85-a62c-f15261bfbd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:27.214522 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c832f5-1a7f-421f-8f8f-e0d4ea24887c admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:27.215072 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-9891098d-4db3-4a85-a62c-f15261bfbd65 None None] MFA Rules not processed for user `e3438fa080d341e5849d110c29ea4527`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:27.215876 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-9891098d-4db3-4a85-a62c-f15261bfbd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:27.274957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa418d7-5ab6-4a9d-ad9c-4b67d5f3ef90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:27.275647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa418d7-5ab6-4a9d-ad9c-4b67d5f3ef90 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:27.275942 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa418d7-5ab6-4a9d-ad9c-4b67d5f3ef90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:27.276260 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa418d7-5ab6-4a9d-ad9c-4b67d5f3ef90 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:27.276956 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:27.277209 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa418d7-5ab6-4a9d-ad9c-4b67d5f3ef90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:27.278875 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa418d7-5ab6-4a9d-ad9c-4b67d5f3ef90 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:27.285817 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 970/1943] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:57:27.289998 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 974/1944] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:27 2022] GET /identity/v3/roles => generated 1427 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:57:27.294267 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891098d-4db3-4a85-a62c-f15261bfbd65 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:27.297918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa418d7-5ab6-4a9d-ad9c-4b67d5f3ef90 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:27.299703 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-baa418d7-5ab6-4a9d-ad9c-4b67d5f3ef90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:27.306502 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891098d-4db3-4a85-a62c-f15261bfbd65 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:27.311146 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864cb0b-a4cb-46cc-884b-05fc4a8c2423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:27.312177 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864cb0b-a4cb-46cc-884b-05fc4a8c2423 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:27.312461 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864cb0b-a4cb-46cc-884b-05fc4a8c2423 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:27.312743 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864cb0b-a4cb-46cc-884b-05fc4a8c2423 admin admin] PATH_INFO: `/v3/projects/35a94d22ddf645a189ad0c10a2687a15/users/3c635ec88f5a4ae6b235ae410d482613/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:27.314940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864cb0b-a4cb-46cc-884b-05fc4a8c2423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35a94d22ddf645a189ad0c10a2687a15, user_id=3c635ec88f5a4ae6b235ae410d482613, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:27.317591 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864cb0b-a4cb-46cc-884b-05fc4a8c2423 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:27.327968 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 971/1945] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:57:27 2022] PUT /identity/v3/projects/35a94d22ddf645a189ad0c10a2687a15/users/3c635ec88f5a4ae6b235ae410d482613/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:27.340541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10072e-8986-4e3c-98bb-1c8786575d95 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:27.340838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10072e-8986-4e3c-98bb-1c8786575d95 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:27.341117 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10072e-8986-4e3c-98bb-1c8786575d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:27.360284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa418d7-5ab6-4a9d-ad9c-4b67d5f3ef90 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:27.370273 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-5c10072e-8986-4e3c-98bb-1c8786575d95 None None] MFA Rules not processed for user `3c635ec88f5a4ae6b235ae410d482613`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:27.374717 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-5c10072e-8986-4e3c-98bb-1c8786575d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:27.417053 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8b443-3000-47fc-863a-b349e41cbe90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:27.417682 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8b443-3000-47fc-863a-b349e41cbe90 service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:27.417970 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8b443-3000-47fc-863a-b349e41cbe90 service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:27.418247 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8b443-3000-47fc-863a-b349e41cbe90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:27.426784 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:27.443756 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 972/1946] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:27.478431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8b443-3000-47fc-863a-b349e41cbe90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:27.479863 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8b443-3000-47fc-863a-b349e41cbe90 service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:27.489076 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 975/1947] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:57:27.688425 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10072e-8986-4e3c-98bb-1c8786575d95 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:27.699169 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10072e-8986-4e3c-98bb-1c8786575d95 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:27.703080 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd75f76-50d7-4ef5-b793-05f41e6daa0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:27.703740 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd75f76-50d7-4ef5-b793-05f41e6daa0e service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:27.704027 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd75f76-50d7-4ef5-b793-05f41e6daa0e service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:27.704341 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd75f76-50d7-4ef5-b793-05f41e6daa0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:27.706086 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-ecd75f76-50d7-4ef5-b793-05f41e6daa0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:27.779574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd75f76-50d7-4ef5-b793-05f41e6daa0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:27.781349 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd75f76-50d7-4ef5-b793-05f41e6daa0e service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:27.793281 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 973/1948] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:57:31.147636 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8b443-3000-47fc-863a-b349e41cbe90 service cinder] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:31.156427 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8b443-3000-47fc-863a-b349e41cbe90 service cinder] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:31.160025 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92b042-7616-4e08-909d-401dda67ac1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:31.160739 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92b042-7616-4e08-909d-401dda67ac1c service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:31.161048 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92b042-7616-4e08-909d-401dda67ac1c service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:31.161331 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92b042-7616-4e08-909d-401dda67ac1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:31.219844 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92b042-7616-4e08-909d-401dda67ac1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:31.221322 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92b042-7616-4e08-909d-401dda67ac1c service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:31.230824 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 976/1949] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:57:31.828471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd75f76-50d7-4ef5-b793-05f41e6daa0e service cinder] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:31.934117 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd75f76-50d7-4ef5-b793-05f41e6daa0e service cinder] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:31.934117 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7576a-1ac7-4c7c-9576-e1292643cac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:31.934658 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7576a-1ac7-4c7c-9576-e1292643cac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:31.936013 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7576a-1ac7-4c7c-9576-e1292643cac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:31.939163 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7576a-1ac7-4c7c-9576-e1292643cac1 admin admin] PATH_INFO: `/v3/users/0b43e0ce1d6d4951b7fa9bb4db013c42` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:31.941014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7576a-1ac7-4c7c-9576-e1292643cac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b43e0ce1d6d4951b7fa9bb4db013c42)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:31.943237 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7576a-1ac7-4c7c-9576-e1292643cac1 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:31.953518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:32.341785 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-96c7576a-1ac7-4c7c-9576-e1292643cac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b43e0ce1d6d4951b7fa9bb4db013c42'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:32.342644 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-96c7576a-1ac7-4c7c-9576-e1292643cac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b43e0ce1d6d4951b7fa9bb4db013c42'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:32.373995 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-96c7576a-1ac7-4c7c-9576-e1292643cac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b43e0ce1d6d4951b7fa9bb4db013c42'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:32.385965 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-96c7576a-1ac7-4c7c-9576-e1292643cac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b43e0ce1d6d4951b7fa9bb4db013c42'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:32.386312 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-96c7576a-1ac7-4c7c-9576-e1292643cac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b43e0ce1d6d4951b7fa9bb4db013c42'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:32.477670 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 974/1950] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:57:31 2022] DELETE /identity/v3/users/0b43e0ce1d6d4951b7fa9bb4db013c42 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:32.482794 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b48371-2164-4d30-8690-47155f468e2b None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:32.483253 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b48371-2164-4d30-8690-47155f468e2b None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:32.483348 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b48371-2164-4d30-8690-47155f468e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:32.501724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-17b48371-2164-4d30-8690-47155f468e2b None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:32.502956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-17b48371-2164-4d30-8690-47155f468e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:32.578253 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 977/1951] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:32.588551 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7576a-1ac7-4c7c-9576-e1292643cac1 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:32.590036 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-96c7576a-1ac7-4c7c-9576-e1292643cac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:32.654132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7576a-1ac7-4c7c-9576-e1292643cac1 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:32.658524 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198ecef-993d-45f9-8693-f1534a539e27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:32.659192 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198ecef-993d-45f9-8693-f1534a539e27 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:32.659513 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198ecef-993d-45f9-8693-f1534a539e27 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:32.659801 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198ecef-993d-45f9-8693-f1534a539e27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:32.675097 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8198ecef-993d-45f9-8693-f1534a539e27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:32.676723 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8198ecef-993d-45f9-8693-f1534a539e27 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:32.687768 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 975/1952] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:57:33.242141 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b48371-2164-4d30-8690-47155f468e2b None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:33.245644 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-17b48371-2164-4d30-8690-47155f468e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:33.263944 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b48371-2164-4d30-8690-47155f468e2b None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:33.275509 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959f30e-c880-4445-aded-dde89736a8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:33.276456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959f30e-c880-4445-aded-dde89736a8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:33.276845 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959f30e-c880-4445-aded-dde89736a8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:33.277135 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959f30e-c880-4445-aded-dde89736a8c3 admin admin] PATH_INFO: `/v3/projects/47408942ea1f4c6d88fe78463737d4d0` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:33.278376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959f30e-c880-4445-aded-dde89736a8c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47408942ea1f4c6d88fe78463737d4d0)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:33.280332 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959f30e-c880-4445-aded-dde89736a8c3 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:33.471337 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:33.475551 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-0959f30e-c880-4445-aded-dde89736a8c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47408942ea1f4c6d88fe78463737d4d0', 'request_id': 'req-0959f30e-c880-4445-aded-dde89736a8c3'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:33.492885 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-0959f30e-c880-4445-aded-dde89736a8c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47408942ea1f4c6d88fe78463737d4d0', 'request_id': 'req-0959f30e-c880-4445-aded-dde89736a8c3'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:33.642745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198ecef-993d-45f9-8693-f1534a539e27 service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:33.644279 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-8198ecef-993d-45f9-8693-f1534a539e27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:33.681926 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-0959f30e-c880-4445-aded-dde89736a8c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47408942ea1f4c6d88fe78463737d4d0', 'request_id': 'req-0959f30e-c880-4445-aded-dde89736a8c3'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:33.696884 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-0959f30e-c880-4445-aded-dde89736a8c3 admin admin] The token cache is being invalidate because project 47408942ea1f4c6d88fe78463737d4d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:57:33.697183 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-0959f30e-c880-4445-aded-dde89736a8c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:33.698026 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-0959f30e-c880-4445-aded-dde89736a8c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:33.699995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 978/1953] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:57:33 2022] DELETE /identity/v3/projects/47408942ea1f4c6d88fe78463737d4d0 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:33.703596 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959f30e-c880-4445-aded-dde89736a8c3 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:33.704903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-0959f30e-c880-4445-aded-dde89736a8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:33.712918 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198ecef-993d-45f9-8693-f1534a539e27 service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:33.758409 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:33.765904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ae3c5-4009-492b-b373-ac9e3228b816 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:33.767426 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ae3c5-4009-492b-b373-ac9e3228b816 service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:33.767426 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ae3c5-4009-492b-b373-ac9e3228b816 service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:33.767426 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ae3c5-4009-492b-b373-ac9e3228b816 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:33.769014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f75ae3c5-4009-492b-b373-ac9e3228b816 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:33.779176 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959f30e-c880-4445-aded-dde89736a8c3 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:33.783930 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51dc3af-811c-4a34-b092-842bd41f379d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:33.784949 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51dc3af-811c-4a34-b092-842bd41f379d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:33.785304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51dc3af-811c-4a34-b092-842bd41f379d admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:33.785684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51dc3af-811c-4a34-b092-842bd41f379d admin admin] PATH_INFO: `/v3/users/06e33b5d0eb84ff496717f56cc562a14` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:33.787246 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51dc3af-811c-4a34-b092-842bd41f379d admin admin] RBAC: Authorizing `identity:delete_user(user_id=06e33b5d0eb84ff496717f56cc562a14)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:33.793348 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51dc3af-811c-4a34-b092-842bd41f379d admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:33.842991 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ae3c5-4009-492b-b373-ac9e3228b816 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:33.844393 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ae3c5-4009-492b-b373-ac9e3228b816 service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:33.856054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 976/1954] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:57:34.011499 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-f51dc3af-811c-4a34-b092-842bd41f379d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06e33b5d0eb84ff496717f56cc562a14'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:34.024581 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-f51dc3af-811c-4a34-b092-842bd41f379d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06e33b5d0eb84ff496717f56cc562a14'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:34.031388 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-f51dc3af-811c-4a34-b092-842bd41f379d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06e33b5d0eb84ff496717f56cc562a14'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:34.032123 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-f51dc3af-811c-4a34-b092-842bd41f379d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06e33b5d0eb84ff496717f56cc562a14'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:34.134585 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-f51dc3af-811c-4a34-b092-842bd41f379d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06e33b5d0eb84ff496717f56cc562a14'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:34.141657 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 979/1955] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:57:33 2022] DELETE /identity/v3/users/06e33b5d0eb84ff496717f56cc562a14 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:57:34.684137 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ae3c5-4009-492b-b373-ac9e3228b816 service cinder] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:34.698498 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ae3c5-4009-492b-b373-ac9e3228b816 service cinder] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:34.765296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d564a-850b-4e6b-9697-549e7a18b9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:34.767912 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d564a-850b-4e6b-9697-549e7a18b9e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:34.767912 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d564a-850b-4e6b-9697-549e7a18b9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:34.767912 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d564a-850b-4e6b-9697-549e7a18b9e9 admin admin] PATH_INFO: `/v3/projects/59c300e847f3446ca28e8343334caa7e` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:34.768296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d564a-850b-4e6b-9697-549e7a18b9e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59c300e847f3446ca28e8343334caa7e)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:34.770216 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d564a-850b-4e6b-9697-549e7a18b9e9 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:34.935167 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-639d564a-850b-4e6b-9697-549e7a18b9e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59c300e847f3446ca28e8343334caa7e', 'request_id': 'req-639d564a-850b-4e6b-9697-549e7a18b9e9'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:34.942740 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-639d564a-850b-4e6b-9697-549e7a18b9e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59c300e847f3446ca28e8343334caa7e', 'request_id': 'req-639d564a-850b-4e6b-9697-549e7a18b9e9'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:34.950993 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-639d564a-850b-4e6b-9697-549e7a18b9e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59c300e847f3446ca28e8343334caa7e', 'request_id': 'req-639d564a-850b-4e6b-9697-549e7a18b9e9'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:35.074820 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-639d564a-850b-4e6b-9697-549e7a18b9e9 admin admin] The token cache is being invalidate because project 59c300e847f3446ca28e8343334caa7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:57:35.075115 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-639d564a-850b-4e6b-9697-549e7a18b9e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:35.075750 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-639d564a-850b-4e6b-9697-549e7a18b9e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:35.077359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 977/1956] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:57:34 2022] DELETE /identity/v3/projects/59c300e847f3446ca28e8343334caa7e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:35.082238 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7288b6-c549-449e-990c-4ece7c4802d5 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:35.083000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7288b6-c549-449e-990c-4ece7c4802d5 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:35.083092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7288b6-c549-449e-990c-4ece7c4802d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:35.100875 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-6a7288b6-c549-449e-990c-4ece7c4802d5 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:35.102090 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-6a7288b6-c549-449e-990c-4ece7c4802d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:35.148353 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:35.162394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 980/1957] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:35.170009 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d031c-08f2-4aeb-acb9-5e6df4c63525 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:35.170459 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d031c-08f2-4aeb-acb9-5e6df4c63525 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:35.170747 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d031c-08f2-4aeb-acb9-5e6df4c63525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:35.191144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-9f8d031c-08f2-4aeb-acb9-5e6df4c63525 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:35.192463 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-9f8d031c-08f2-4aeb-acb9-5e6df4c63525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:35.201583 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 978/1958] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:35.208525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7288b6-c549-449e-990c-4ece7c4802d5 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:35.218278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7288b6-c549-449e-990c-4ece7c4802d5 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:35.222823 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f73647-f6c4-4529-96cd-c436a47cedab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:35.223472 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f73647-f6c4-4529-96cd-c436a47cedab admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:35.223761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f73647-f6c4-4529-96cd-c436a47cedab admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:35.224043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f73647-f6c4-4529-96cd-c436a47cedab admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:35.224909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f73647-f6c4-4529-96cd-c436a47cedab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:57:35.225221 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f73647-f6c4-4529-96cd-c436a47cedab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:35.227101 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f73647-f6c4-4529-96cd-c436a47cedab admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:35.238720 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 981/1959] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:57:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:57:35.243344 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d031c-08f2-4aeb-acb9-5e6df4c63525 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:35.252570 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d031c-08f2-4aeb-acb9-5e6df4c63525 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:35.257851 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b9c9e-bc9e-4977-957a-2b08ac8488c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:35.258512 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b9c9e-bc9e-4977-957a-2b08ac8488c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:35.258804 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b9c9e-bc9e-4977-957a-2b08ac8488c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:35.259095 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b9c9e-bc9e-4977-957a-2b08ac8488c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:35.259797 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b9c9e-bc9e-4977-957a-2b08ac8488c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:35.261792 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b9c9e-bc9e-4977-957a-2b08ac8488c2 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:35.368486 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 979/1960] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:57:35 2022] POST /identity/v3/projects => generated 374 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:57:35.372979 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f73647-f6c4-4529-96cd-c436a47cedab admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:35.383549 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f73647-f6c4-4529-96cd-c436a47cedab admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:35.440958 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb114a5-e6c3-469f-afce-2422102ee0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:35.441563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb114a5-e6c3-469f-afce-2422102ee0ef admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:35.441854 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb114a5-e6c3-469f-afce-2422102ee0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:35.442136 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb114a5-e6c3-469f-afce-2422102ee0ef admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:35.443000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb114a5-e6c3-469f-afce-2422102ee0ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:35.444905 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb114a5-e6c3-469f-afce-2422102ee0ef admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:35.574374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 982/1961] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:57:35 2022] POST /identity/v3/users => generated 288 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:57:35.578609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b9c9e-bc9e-4977-957a-2b08ac8488c2 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:35.591795 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b9c9e-bc9e-4977-957a-2b08ac8488c2 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:35.596444 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc5d31-066a-41ef-bb19-677c69250a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:35.597116 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc5d31-066a-41ef-bb19-677c69250a3c admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:35.597414 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc5d31-066a-41ef-bb19-677c69250a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:35.597680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc5d31-066a-41ef-bb19-677c69250a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:35.598438 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc5d31-066a-41ef-bb19-677c69250a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:35.601066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc5d31-066a-41ef-bb19-677c69250a3c admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:35.604891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:35.618606 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 980/1962] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:35 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:57:35.619788 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb114a5-e6c3-469f-afce-2422102ee0ef admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:35.630328 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb114a5-e6c3-469f-afce-2422102ee0ef admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:35.635209 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf357824-9f9c-4cf2-abee-6f98fcfc393c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:35.635884 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf357824-9f9c-4cf2-abee-6f98fcfc393c admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:35.636211 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf357824-9f9c-4cf2-abee-6f98fcfc393c admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:35.636494 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf357824-9f9c-4cf2-abee-6f98fcfc393c admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:35.637228 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf357824-9f9c-4cf2-abee-6f98fcfc393c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:35.638867 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf357824-9f9c-4cf2-abee-6f98fcfc393c admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:35.649469 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 983/1963] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:35 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:57:35.656340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc5d31-066a-41ef-bb19-677c69250a3c admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:35.667132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc5d31-066a-41ef-bb19-677c69250a3c admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:35.671973 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39946bba-2357-44f7-bcf1-41fcf4aaf834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:35.672918 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39946bba-2357-44f7-bcf1-41fcf4aaf834 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:35.673198 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39946bba-2357-44f7-bcf1-41fcf4aaf834 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:35.673477 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39946bba-2357-44f7-bcf1-41fcf4aaf834 admin admin] PATH_INFO: `/v3/projects/83b84b0523f3451580c79f68abc43ab4/users/ec0a199a02b04198809294577eeea967/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:35.689704 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39946bba-2357-44f7-bcf1-41fcf4aaf834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83b84b0523f3451580c79f68abc43ab4, user_id=ec0a199a02b04198809294577eeea967, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:35.692449 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39946bba-2357-44f7-bcf1-41fcf4aaf834 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:35.812713 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 981/1964] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:57:35 2022] PUT /identity/v3/projects/83b84b0523f3451580c79f68abc43ab4/users/ec0a199a02b04198809294577eeea967/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:57:35.823354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc92a4-db40-4fa3-8fac-2db379d4d060 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:35.827000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc92a4-db40-4fa3-8fac-2db379d4d060 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:35.827000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc92a4-db40-4fa3-8fac-2db379d4d060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:35.852233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-04cc92a4-db40-4fa3-8fac-2db379d4d060 None None] MFA Rules not processed for user `ec0a199a02b04198809294577eeea967`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:35.853442 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-04cc92a4-db40-4fa3-8fac-2db379d4d060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:35.924484 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 984/1965] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:35.935454 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39946bba-2357-44f7-bcf1-41fcf4aaf834 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:35.937190 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-39946bba-2357-44f7-bcf1-41fcf4aaf834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:36.029515 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39946bba-2357-44f7-bcf1-41fcf4aaf834 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:36.033676 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac4360-c99d-4c29-826e-11337bbf8786 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:36.037774 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac4360-c99d-4c29-826e-11337bbf8786 service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:36.037774 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac4360-c99d-4c29-826e-11337bbf8786 service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:36.037774 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac4360-c99d-4c29-826e-11337bbf8786 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:36.046635 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac4360-c99d-4c29-826e-11337bbf8786 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:36.048034 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac4360-c99d-4c29-826e-11337bbf8786 service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:36.057927 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 982/1966] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:57:36.081734 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc92a4-db40-4fa3-8fac-2db379d4d060 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:36.134746 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:36.150909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc92a4-db40-4fa3-8fac-2db379d4d060 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:36.155455 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898b07c-c161-47c0-92e4-7fd2b312135c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:36.156388 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898b07c-c161-47c0-92e4-7fd2b312135c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:36.156682 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898b07c-c161-47c0-92e4-7fd2b312135c admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:36.156957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898b07c-c161-47c0-92e4-7fd2b312135c admin admin] PATH_INFO: `/v3/users/ec0a199a02b04198809294577eeea967` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:36.158183 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898b07c-c161-47c0-92e4-7fd2b312135c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec0a199a02b04198809294577eeea967)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:36.160124 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898b07c-c161-47c0-92e4-7fd2b312135c admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:36.416388 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-d898b07c-c161-47c0-92e4-7fd2b312135c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec0a199a02b04198809294577eeea967'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:36.428622 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-d898b07c-c161-47c0-92e4-7fd2b312135c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec0a199a02b04198809294577eeea967'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:36.435633 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-d898b07c-c161-47c0-92e4-7fd2b312135c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec0a199a02b04198809294577eeea967'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:36.436374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-d898b07c-c161-47c0-92e4-7fd2b312135c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec0a199a02b04198809294577eeea967'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:36.579156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-d898b07c-c161-47c0-92e4-7fd2b312135c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec0a199a02b04198809294577eeea967'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:36.586599 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 985/1967] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:57:36 2022] DELETE /identity/v3/users/ec0a199a02b04198809294577eeea967 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:36.591136 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cb30a-5c2b-44d2-b4c9-d2421483273a None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:36.591432 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cb30a-5c2b-44d2-b4c9-d2421483273a None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:36.591713 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cb30a-5c2b-44d2-b4c9-d2421483273a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:36.609395 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-ed8cb30a-5c2b-44d2-b4c9-d2421483273a None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:36.610595 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-ed8cb30a-5c2b-44d2-b4c9-d2421483273a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:36.669693 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 983/1968] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:36.680003 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898b07c-c161-47c0-92e4-7fd2b312135c admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:36.681456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-d898b07c-c161-47c0-92e4-7fd2b312135c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:36.745852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898b07c-c161-47c0-92e4-7fd2b312135c admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:36.749722 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c4258-1324-44be-b3a5-9c264aeac6f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:36.750387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c4258-1324-44be-b3a5-9c264aeac6f1 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:36.750666 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c4258-1324-44be-b3a5-9c264aeac6f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:36.751366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c4258-1324-44be-b3a5-9c264aeac6f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:36.761429 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c4258-1324-44be-b3a5-9c264aeac6f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:36.762865 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c4258-1324-44be-b3a5-9c264aeac6f1 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:36.772983 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 986/1969] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:57:37.677302 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cb30a-5c2b-44d2-b4c9-d2421483273a None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:37.678914 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-ed8cb30a-5c2b-44d2-b4c9-d2421483273a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:37.691168 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cb30a-5c2b-44d2-b4c9-d2421483273a None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:37.696710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1666c-ec05-4712-8d4a-5e26c9edfd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:37.697618 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1666c-ec05-4712-8d4a-5e26c9edfd19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:37.697909 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1666c-ec05-4712-8d4a-5e26c9edfd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:37.698189 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1666c-ec05-4712-8d4a-5e26c9edfd19 admin admin] PATH_INFO: `/v3/projects/83b84b0523f3451580c79f68abc43ab4` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:37.699401 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1666c-ec05-4712-8d4a-5e26c9edfd19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83b84b0523f3451580c79f68abc43ab4)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:37.701326 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1666c-ec05-4712-8d4a-5e26c9edfd19 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:37.862150 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-fcc1666c-ec05-4712-8d4a-5e26c9edfd19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83b84b0523f3451580c79f68abc43ab4', 'request_id': 'req-fcc1666c-ec05-4712-8d4a-5e26c9edfd19'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:37.874086 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-fcc1666c-ec05-4712-8d4a-5e26c9edfd19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83b84b0523f3451580c79f68abc43ab4', 'request_id': 'req-fcc1666c-ec05-4712-8d4a-5e26c9edfd19'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:37.878769 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:37.881551 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-fcc1666c-ec05-4712-8d4a-5e26c9edfd19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83b84b0523f3451580c79f68abc43ab4', 'request_id': 'req-fcc1666c-ec05-4712-8d4a-5e26c9edfd19'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:38.012881 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-fcc1666c-ec05-4712-8d4a-5e26c9edfd19 admin admin] The token cache is being invalidate because project 83b84b0523f3451580c79f68abc43ab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:57:38.013257 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-fcc1666c-ec05-4712-8d4a-5e26c9edfd19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:38.013990 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-fcc1666c-ec05-4712-8d4a-5e26c9edfd19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:38.015816 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 984/1970] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:57:37 2022] DELETE /identity/v3/projects/83b84b0523f3451580c79f68abc43ab4 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:38.020930 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73db3ab-971c-4cf0-9d56-3e05207c8e5b None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:38.020930 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73db3ab-971c-4cf0-9d56-3e05207c8e5b None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:38.021616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73db3ab-971c-4cf0-9d56-3e05207c8e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:38.046384 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-e73db3ab-971c-4cf0-9d56-3e05207c8e5b None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:38.047718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-e73db3ab-971c-4cf0-9d56-3e05207c8e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:38.123605 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 987/1971] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:38.132539 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7830d-1ed9-49d3-9257-fb1b4a8fc8bb None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:38.132836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7830d-1ed9-49d3-9257-fb1b4a8fc8bb None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:38.133120 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7830d-1ed9-49d3-9257-fb1b4a8fc8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:38.155530 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-71b7830d-1ed9-49d3-9257-fb1b4a8fc8bb None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:38.156784 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-71b7830d-1ed9-49d3-9257-fb1b4a8fc8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:38.169362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 985/1972] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:38.170613 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73db3ab-971c-4cf0-9d56-3e05207c8e5b None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:38.182263 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73db3ab-971c-4cf0-9d56-3e05207c8e5b None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:38.187412 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac9dcd-5f6f-4de1-979e-9b74b1c4c671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:38.188085 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac9dcd-5f6f-4de1-979e-9b74b1c4c671 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:38.190891 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac9dcd-5f6f-4de1-979e-9b74b1c4c671 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:38.190891 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac9dcd-5f6f-4de1-979e-9b74b1c4c671 admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:38.190891 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac9dcd-5f6f-4de1-979e-9b74b1c4c671 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:57:38.190891 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac9dcd-5f6f-4de1-979e-9b74b1c4c671 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:38.191907 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac9dcd-5f6f-4de1-979e-9b74b1c4c671 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:38.195061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:38.204882 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 988/1973] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:57:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:57:38.211608 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7830d-1ed9-49d3-9257-fb1b4a8fc8bb None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:38.227240 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7830d-1ed9-49d3-9257-fb1b4a8fc8bb None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:38.233300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd666349-9114-402d-93ff-90b9b8cfa2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:38.234311 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd666349-9114-402d-93ff-90b9b8cfa2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:38.234619 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd666349-9114-402d-93ff-90b9b8cfa2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:38.234891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd666349-9114-402d-93ff-90b9b8cfa2a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:38.235752 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd666349-9114-402d-93ff-90b9b8cfa2a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:38.237708 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd666349-9114-402d-93ff-90b9b8cfa2a3 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:38.391414 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 986/1974] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:57:38 2022] POST /identity/v3/projects => generated 378 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:57:38.392706 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac9dcd-5f6f-4de1-979e-9b74b1c4c671 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:38.403513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac9dcd-5f6f-4de1-979e-9b74b1c4c671 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:38.465359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575e5bf-34f8-4c4e-85aa-5c74f3f21cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:38.466118 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575e5bf-34f8-4c4e-85aa-5c74f3f21cab admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:38.466403 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575e5bf-34f8-4c4e-85aa-5c74f3f21cab admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:38.466686 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575e5bf-34f8-4c4e-85aa-5c74f3f21cab admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:38.467401 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575e5bf-34f8-4c4e-85aa-5c74f3f21cab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:38.469633 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575e5bf-34f8-4c4e-85aa-5c74f3f21cab admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:38.628682 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 989/1975] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:57:38 2022] POST /identity/v3/users => generated 290 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:57:38.630001 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd666349-9114-402d-93ff-90b9b8cfa2a3 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:38.643112 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd666349-9114-402d-93ff-90b9b8cfa2a3 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:38.648638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ebffb-bd9e-4ee8-a3dd-9f13370cd678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:38.649310 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ebffb-bd9e-4ee8-a3dd-9f13370cd678 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:38.649595 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ebffb-bd9e-4ee8-a3dd-9f13370cd678 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:38.649898 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ebffb-bd9e-4ee8-a3dd-9f13370cd678 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:38.650605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ebffb-bd9e-4ee8-a3dd-9f13370cd678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:38.653013 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ebffb-bd9e-4ee8-a3dd-9f13370cd678 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:38.666523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 987/1976] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:38 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:57:38.670584 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575e5bf-34f8-4c4e-85aa-5c74f3f21cab admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:38.682509 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575e5bf-34f8-4c4e-85aa-5c74f3f21cab admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:38.687551 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ea2f7-d6e7-442d-938f-e8e8a595d926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:38.688255 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ea2f7-d6e7-442d-938f-e8e8a595d926 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:38.688542 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ea2f7-d6e7-442d-938f-e8e8a595d926 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:38.688821 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ea2f7-d6e7-442d-938f-e8e8a595d926 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:38.689643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ea2f7-d6e7-442d-938f-e8e8a595d926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:38.691139 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ea2f7-d6e7-442d-938f-e8e8a595d926 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:38.706374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 990/1977] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:38 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:57:38.708403 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ebffb-bd9e-4ee8-a3dd-9f13370cd678 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:38.727898 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ebffb-bd9e-4ee8-a3dd-9f13370cd678 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:38.734850 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f2ba5-19ef-47e5-beec-7bd2b5fb3f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:38.736387 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f2ba5-19ef-47e5-beec-7bd2b5fb3f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:38.736786 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f2ba5-19ef-47e5-beec-7bd2b5fb3f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:38.737171 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f2ba5-19ef-47e5-beec-7bd2b5fb3f5f admin admin] PATH_INFO: `/v3/projects/a8f1e43b65db496f8a3c17dd058e2ec7/users/cdc27e4fad0c4846bfc2a0001f5b3608/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:38.753727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f2ba5-19ef-47e5-beec-7bd2b5fb3f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f1e43b65db496f8a3c17dd058e2ec7, user_id=cdc27e4fad0c4846bfc2a0001f5b3608, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:38.757095 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f2ba5-19ef-47e5-beec-7bd2b5fb3f5f admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:38.831609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 988/1978] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:57:38 2022] PUT /identity/v3/projects/a8f1e43b65db496f8a3c17dd058e2ec7/users/cdc27e4fad0c4846bfc2a0001f5b3608/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:38.843233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a5294-48be-43e7-a99f-0b64ad64a525 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:38.843526 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a5294-48be-43e7-a99f-0b64ad64a525 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:38.843808 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a5294-48be-43e7-a99f-0b64ad64a525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:38.872421 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-b60a5294-48be-43e7-a99f-0b64ad64a525 None None] MFA Rules not processed for user `cdc27e4fad0c4846bfc2a0001f5b3608`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:38.873636 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b60a5294-48be-43e7-a99f-0b64ad64a525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:38.938594 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 991/1979] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:38.949433 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f2ba5-19ef-47e5-beec-7bd2b5fb3f5f admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:38.951152 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-470f2ba5-19ef-47e5-beec-7bd2b5fb3f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:39.045104 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f2ba5-19ef-47e5-beec-7bd2b5fb3f5f admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:39.049048 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b47dc-4faa-4a11-8999-646571dd9aa7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b236c66c184d3ca40c2069dc316664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:39.049706 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b47dc-4faa-4a11-8999-646571dd9aa7 service glance] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:39.049991 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b47dc-4faa-4a11-8999-646571dd9aa7 service glance] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:39.050271 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b47dc-4faa-4a11-8999-646571dd9aa7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:39.062177 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b47dc-4faa-4a11-8999-646571dd9aa7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:39.063634 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b47dc-4faa-4a11-8999-646571dd9aa7 service glance] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:39.081247 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 989/1980] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:57:48.937370 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=68,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:48.972820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a5294-48be-43e7-a99f-0b64ad64a525 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:48.974607 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b60a5294-48be-43e7-a99f-0b64ad64a525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:49.068970 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:DELETE=2,keystone:SELECT=65,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:49.099700 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a5294-48be-43e7-a99f-0b64ad64a525 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:49.105734 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ca795-a18d-4776-b6cb-ee628bf105c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:49.106798 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ca795-a18d-4776-b6cb-ee628bf105c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:49.107171 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ca795-a18d-4776-b6cb-ee628bf105c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:49.107732 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ca795-a18d-4776-b6cb-ee628bf105c0 admin admin] PATH_INFO: `/v3/users/fb0a3c78e2be4ad7b1cc3ff1b3421c93` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:49.108939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ca795-a18d-4776-b6cb-ee628bf105c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb0a3c78e2be4ad7b1cc3ff1b3421c93)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:49.111003 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ca795-a18d-4776-b6cb-ee628bf105c0 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:49.382154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-239ca795-a18d-4776-b6cb-ee628bf105c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb0a3c78e2be4ad7b1cc3ff1b3421c93'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:49.393973 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-239ca795-a18d-4776-b6cb-ee628bf105c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb0a3c78e2be4ad7b1cc3ff1b3421c93'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:49.401787 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-239ca795-a18d-4776-b6cb-ee628bf105c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb0a3c78e2be4ad7b1cc3ff1b3421c93'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:49.402638 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-239ca795-a18d-4776-b6cb-ee628bf105c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb0a3c78e2be4ad7b1cc3ff1b3421c93'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:49.523049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-239ca795-a18d-4776-b6cb-ee628bf105c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb0a3c78e2be4ad7b1cc3ff1b3421c93'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:49.529769 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 992/1981] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:57:48 2022] DELETE /identity/v3/users/fb0a3c78e2be4ad7b1cc3ff1b3421c93 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:49.534399 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9462df7-253c-4535-b982-75cdeb8ea07c None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:49.534743 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9462df7-253c-4535-b982-75cdeb8ea07c None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:49.534969 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9462df7-253c-4535-b982-75cdeb8ea07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:49.554105 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-f9462df7-253c-4535-b982-75cdeb8ea07c None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:49.555464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f9462df7-253c-4535-b982-75cdeb8ea07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:49.617085 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 990/1982] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:49.627706 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ca795-a18d-4776-b6cb-ee628bf105c0 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:49.629147 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-239ca795-a18d-4776-b6cb-ee628bf105c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:49.688977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ca795-a18d-4776-b6cb-ee628bf105c0 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:49.694803 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82a13d-d93b-461e-b260-8aec6006790e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:49.697376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82a13d-d93b-461e-b260-8aec6006790e service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:49.700375 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82a13d-d93b-461e-b260-8aec6006790e service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:49.700375 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82a13d-d93b-461e-b260-8aec6006790e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:49.713260 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82a13d-d93b-461e-b260-8aec6006790e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:49.714846 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82a13d-d93b-461e-b260-8aec6006790e service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:49.744333 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 993/1983] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:57:50.904492 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9462df7-253c-4535-b982-75cdeb8ea07c None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:50.906050 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f9462df7-253c-4535-b982-75cdeb8ea07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:50.918702 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9462df7-253c-4535-b982-75cdeb8ea07c None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:50.923319 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62a58b-56e9-404d-9c85-9ac3d50c0c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:50.924229 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62a58b-56e9-404d-9c85-9ac3d50c0c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:50.924523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62a58b-56e9-404d-9c85-9ac3d50c0c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:50.924803 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62a58b-56e9-404d-9c85-9ac3d50c0c37 admin admin] PATH_INFO: `/v3/projects/110ed54c7490407ca67b5e01fc492858` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:50.925999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62a58b-56e9-404d-9c85-9ac3d50c0c37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=110ed54c7490407ca67b5e01fc492858)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:50.927897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62a58b-56e9-404d-9c85-9ac3d50c0c37 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:51.097169 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-ee62a58b-56e9-404d-9c85-9ac3d50c0c37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '110ed54c7490407ca67b5e01fc492858', 'request_id': 'req-ee62a58b-56e9-404d-9c85-9ac3d50c0c37'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:51.104769 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-ee62a58b-56e9-404d-9c85-9ac3d50c0c37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '110ed54c7490407ca67b5e01fc492858', 'request_id': 'req-ee62a58b-56e9-404d-9c85-9ac3d50c0c37'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:51.110964 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-ee62a58b-56e9-404d-9c85-9ac3d50c0c37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '110ed54c7490407ca67b5e01fc492858', 'request_id': 'req-ee62a58b-56e9-404d-9c85-9ac3d50c0c37'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:51.214536 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-ee62a58b-56e9-404d-9c85-9ac3d50c0c37 admin admin] The token cache is being invalidate because project 110ed54c7490407ca67b5e01fc492858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:57:51.214835 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-ee62a58b-56e9-404d-9c85-9ac3d50c0c37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:51.215460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-ee62a58b-56e9-404d-9c85-9ac3d50c0c37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:51.217097 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 991/1984] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:57:50 2022] DELETE /identity/v3/projects/110ed54c7490407ca67b5e01fc492858 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:51.220985 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82a13d-d93b-461e-b260-8aec6006790e service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:51.231250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82a13d-d93b-461e-b260-8aec6006790e service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:51.250572 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:51.290440 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6f9aa-0521-4579-8b5b-3e3117eaf121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:51.291387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6f9aa-0521-4579-8b5b-3e3117eaf121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:51.291688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6f9aa-0521-4579-8b5b-3e3117eaf121 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:51.291951 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6f9aa-0521-4579-8b5b-3e3117eaf121 admin admin] PATH_INFO: `/v3/users/5968c582570d46bb91a5af00cb530819` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:51.293182 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6f9aa-0521-4579-8b5b-3e3117eaf121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5968c582570d46bb91a5af00cb530819)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:51.295189 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6f9aa-0521-4579-8b5b-3e3117eaf121 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:51.532124 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-bfa6f9aa-0521-4579-8b5b-3e3117eaf121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5968c582570d46bb91a5af00cb530819'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:51.546386 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-bfa6f9aa-0521-4579-8b5b-3e3117eaf121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5968c582570d46bb91a5af00cb530819'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:51.555053 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-bfa6f9aa-0521-4579-8b5b-3e3117eaf121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5968c582570d46bb91a5af00cb530819'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:51.555832 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-bfa6f9aa-0521-4579-8b5b-3e3117eaf121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5968c582570d46bb91a5af00cb530819'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:51.625912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-bfa6f9aa-0521-4579-8b5b-3e3117eaf121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5968c582570d46bb91a5af00cb530819'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:51.635828 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 994/1985] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:57:51 2022] DELETE /identity/v3/users/5968c582570d46bb91a5af00cb530819 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:52.267771 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62a58b-56e9-404d-9c85-9ac3d50c0c37 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:52.269418 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-ee62a58b-56e9-404d-9c85-9ac3d50c0c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:52.283562 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62a58b-56e9-404d-9c85-9ac3d50c0c37 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:52.360861 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bebac-0f7b-4bbd-875e-656176e7d1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:52.361813 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bebac-0f7b-4bbd-875e-656176e7d1cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:52.362109 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bebac-0f7b-4bbd-875e-656176e7d1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:52.362398 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bebac-0f7b-4bbd-875e-656176e7d1cf admin admin] PATH_INFO: `/v3/projects/325392c1cd5643a791cb510c48a0c4be` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:52.364330 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7bebac-0f7b-4bbd-875e-656176e7d1cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=325392c1cd5643a791cb510c48a0c4be)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:52.368318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7bebac-0f7b-4bbd-875e-656176e7d1cf admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:52.494041 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:52.518424 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-eb7bebac-0f7b-4bbd-875e-656176e7d1cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '325392c1cd5643a791cb510c48a0c4be', 'request_id': 'req-eb7bebac-0f7b-4bbd-875e-656176e7d1cf'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:52.525932 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-eb7bebac-0f7b-4bbd-875e-656176e7d1cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '325392c1cd5643a791cb510c48a0c4be', 'request_id': 'req-eb7bebac-0f7b-4bbd-875e-656176e7d1cf'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:52.531610 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-eb7bebac-0f7b-4bbd-875e-656176e7d1cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '325392c1cd5643a791cb510c48a0c4be', 'request_id': 'req-eb7bebac-0f7b-4bbd-875e-656176e7d1cf'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:52.624562 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-eb7bebac-0f7b-4bbd-875e-656176e7d1cf admin admin] The token cache is being invalidate because project 325392c1cd5643a791cb510c48a0c4be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:57:52.624972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-eb7bebac-0f7b-4bbd-875e-656176e7d1cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:52.625856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-eb7bebac-0f7b-4bbd-875e-656176e7d1cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:52.628199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 992/1986] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:57:52 2022] DELETE /identity/v3/projects/325392c1cd5643a791cb510c48a0c4be => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:52.633076 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6f9aa-0521-4579-8b5b-3e3117eaf121 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:52.634582 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-bfa6f9aa-0521-4579-8b5b-3e3117eaf121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:52.648244 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6f9aa-0521-4579-8b5b-3e3117eaf121 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:52.707231 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659b92a-5237-4f64-bc54-04693aeac2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:52.708419 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659b92a-5237-4f64-bc54-04693aeac2c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:52.709237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659b92a-5237-4f64-bc54-04693aeac2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:52.709606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659b92a-5237-4f64-bc54-04693aeac2c8 admin admin] PATH_INFO: `/v3/users/3c635ec88f5a4ae6b235ae410d482613` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:52.710823 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659b92a-5237-4f64-bc54-04693aeac2c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c635ec88f5a4ae6b235ae410d482613)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:52.712778 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659b92a-5237-4f64-bc54-04693aeac2c8 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:52.943659 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:52.946282 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-1659b92a-5237-4f64-bc54-04693aeac2c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c635ec88f5a4ae6b235ae410d482613'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:52.959403 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-1659b92a-5237-4f64-bc54-04693aeac2c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c635ec88f5a4ae6b235ae410d482613'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:52.966292 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-1659b92a-5237-4f64-bc54-04693aeac2c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c635ec88f5a4ae6b235ae410d482613'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:52.967204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-1659b92a-5237-4f64-bc54-04693aeac2c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c635ec88f5a4ae6b235ae410d482613'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:53.064993 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-1659b92a-5237-4f64-bc54-04693aeac2c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c635ec88f5a4ae6b235ae410d482613'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:53.071526 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 995/1987] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:57:52 2022] DELETE /identity/v3/users/3c635ec88f5a4ae6b235ae410d482613 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:53.539667 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bebac-0f7b-4bbd-875e-656176e7d1cf admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:53.541321 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-eb7bebac-0f7b-4bbd-875e-656176e7d1cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:53.561107 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bebac-0f7b-4bbd-875e-656176e7d1cf admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:53.622852 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d217ed0-2276-44f9-935f-4a56216bdd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:53.623732 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d217ed0-2276-44f9-935f-4a56216bdd5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:53.624018 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d217ed0-2276-44f9-935f-4a56216bdd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:53.624333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d217ed0-2276-44f9-935f-4a56216bdd5f admin admin] PATH_INFO: `/v3/projects/35a94d22ddf645a189ad0c10a2687a15` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:53.625523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d217ed0-2276-44f9-935f-4a56216bdd5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=35a94d22ddf645a189ad0c10a2687a15)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:53.627430 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d217ed0-2276-44f9-935f-4a56216bdd5f admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:53.738074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9d217ed0-2276-44f9-935f-4a56216bdd5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35a94d22ddf645a189ad0c10a2687a15', 'request_id': 'req-9d217ed0-2276-44f9-935f-4a56216bdd5f'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:53.744792 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9d217ed0-2276-44f9-935f-4a56216bdd5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35a94d22ddf645a189ad0c10a2687a15', 'request_id': 'req-9d217ed0-2276-44f9-935f-4a56216bdd5f'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:53.750328 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9d217ed0-2276-44f9-935f-4a56216bdd5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35a94d22ddf645a189ad0c10a2687a15', 'request_id': 'req-9d217ed0-2276-44f9-935f-4a56216bdd5f'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:53.847721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9d217ed0-2276-44f9-935f-4a56216bdd5f admin admin] The token cache is being invalidate because project 35a94d22ddf645a189ad0c10a2687a15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:57:53.848011 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9d217ed0-2276-44f9-935f-4a56216bdd5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:53.848646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9d217ed0-2276-44f9-935f-4a56216bdd5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:57:53.850863 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 993/1988] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:57:53 2022] DELETE /identity/v3/projects/35a94d22ddf645a189ad0c10a2687a15 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:53.856261 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5152f28-c7ad-4c17-87d5-9ec5de31c1b6 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:53.857055 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5152f28-c7ad-4c17-87d5-9ec5de31c1b6 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:53.857055 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5152f28-c7ad-4c17-87d5-9ec5de31c1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:53.876995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-b5152f28-c7ad-4c17-87d5-9ec5de31c1b6 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:53.878214 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b5152f28-c7ad-4c17-87d5-9ec5de31c1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:53.949927 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 996/1989] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:53.958243 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc73d5f-4c46-471f-8ea0-76883a50ab66 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:53.959442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc73d5f-4c46-471f-8ea0-76883a50ab66 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:53.959751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc73d5f-4c46-471f-8ea0-76883a50ab66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:53.979755 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-abc73d5f-4c46-471f-8ea0-76883a50ab66 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:53.981000 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-abc73d5f-4c46-471f-8ea0-76883a50ab66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:53.992887 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 994/1990] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:53.995828 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5152f28-c7ad-4c17-87d5-9ec5de31c1b6 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:54.005962 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5152f28-c7ad-4c17-87d5-9ec5de31c1b6 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:54.010714 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9a7e5-c30a-4836-a051-f59672da90a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:54.011388 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9a7e5-c30a-4836-a051-f59672da90a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:54.011678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9a7e5-c30a-4836-a051-f59672da90a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:54.011961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9a7e5-c30a-4836-a051-f59672da90a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:54.012927 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9a7e5-c30a-4836-a051-f59672da90a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:57:54.013247 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9a7e5-c30a-4836-a051-f59672da90a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:54.014848 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9a7e5-c30a-4836-a051-f59672da90a3 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:54.031353 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 997/1991] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:57:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:57:54.041746 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc73d5f-4c46-471f-8ea0-76883a50ab66 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:54.051224 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc73d5f-4c46-471f-8ea0-76883a50ab66 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:54.059751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788056e6-10e4-4b93-9bc1-0024811e13a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:54.060599 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788056e6-10e4-4b93-9bc1-0024811e13a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:54.060951 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788056e6-10e4-4b93-9bc1-0024811e13a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:54.061293 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788056e6-10e4-4b93-9bc1-0024811e13a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:54.062081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788056e6-10e4-4b93-9bc1-0024811e13a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:54.064135 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788056e6-10e4-4b93-9bc1-0024811e13a8 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:54.183796 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 995/1992] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:57:54 2022] POST /identity/v3/projects => generated 374 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:57:54.187575 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9a7e5-c30a-4836-a051-f59672da90a3 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:54.199747 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9a7e5-c30a-4836-a051-f59672da90a3 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:54.263657 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26940235-052f-4b90-b121-29a5c201afae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:54.264290 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26940235-052f-4b90-b121-29a5c201afae admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:54.264577 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26940235-052f-4b90-b121-29a5c201afae admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:54.264857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26940235-052f-4b90-b121-29a5c201afae admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:54.265555 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26940235-052f-4b90-b121-29a5c201afae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:54.267511 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26940235-052f-4b90-b121-29a5c201afae admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:54.356989 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 998/1993] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:57:54 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:57:54.361298 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788056e6-10e4-4b93-9bc1-0024811e13a8 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:54.371889 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788056e6-10e4-4b93-9bc1-0024811e13a8 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:54.376583 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491242a8-ec11-4a67-a102-de3fa61d26ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:54.377248 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491242a8-ec11-4a67-a102-de3fa61d26ef admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:54.377534 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491242a8-ec11-4a67-a102-de3fa61d26ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:54.377872 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491242a8-ec11-4a67-a102-de3fa61d26ef admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:54.378610 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491242a8-ec11-4a67-a102-de3fa61d26ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:54.380252 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491242a8-ec11-4a67-a102-de3fa61d26ef admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:54.391916 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 996/1994] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:54 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:57:54.395791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26940235-052f-4b90-b121-29a5c201afae admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:54.406517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26940235-052f-4b90-b121-29a5c201afae admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:54.411002 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cfa2d-6aed-468d-9328-6aaba9b7c203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:54.411742 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cfa2d-6aed-468d-9328-6aaba9b7c203 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:54.412143 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cfa2d-6aed-468d-9328-6aaba9b7c203 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:54.412430 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cfa2d-6aed-468d-9328-6aaba9b7c203 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:54.413156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cfa2d-6aed-468d-9328-6aaba9b7c203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:54.414732 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cfa2d-6aed-468d-9328-6aaba9b7c203 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:54.424772 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 999/1995] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:57:54 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:57:54.429210 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491242a8-ec11-4a67-a102-de3fa61d26ef admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:54.435704 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:54.439430 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491242a8-ec11-4a67-a102-de3fa61d26ef admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:54.444594 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69cc7c-4b92-47d8-b03e-8876c46c33f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:54.445472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69cc7c-4b92-47d8-b03e-8876c46c33f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:54.445760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69cc7c-4b92-47d8-b03e-8876c46c33f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:54.446039 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69cc7c-4b92-47d8-b03e-8876c46c33f7 admin admin] PATH_INFO: `/v3/projects/cbdae82cb97b48b7a541a22084bc111f/users/6a713d55889246049668bdb4e221c998/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:54.461386 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69cc7c-4b92-47d8-b03e-8876c46c33f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbdae82cb97b48b7a541a22084bc111f, user_id=6a713d55889246049668bdb4e221c998, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:54.464034 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69cc7c-4b92-47d8-b03e-8876c46c33f7 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:54.556253 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 997/1996] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:57:54 2022] PUT /identity/v3/projects/cbdae82cb97b48b7a541a22084bc111f/users/6a713d55889246049668bdb4e221c998/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:57:54.561316 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d11fb8-a8b6-48cd-8c1a-b15a78fa2123 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:54.561614 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d11fb8-a8b6-48cd-8c1a-b15a78fa2123 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:54.561902 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d11fb8-a8b6-48cd-8c1a-b15a78fa2123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:54.580460 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-85d11fb8-a8b6-48cd-8c1a-b15a78fa2123 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:54.581663 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-85d11fb8-a8b6-48cd-8c1a-b15a78fa2123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:54.601969 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:54.643010 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1000/1997] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:54.668892 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69cc7c-4b92-47d8-b03e-8876c46c33f7 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:54.671159 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-6f69cc7c-4b92-47d8-b03e-8876c46c33f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:54.737950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69cc7c-4b92-47d8-b03e-8876c46c33f7 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:54.743305 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5edf3-ba13-4d05-835a-204e5efd92df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:54.744119 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5edf3-ba13-4d05-835a-204e5efd92df service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:54.744513 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5edf3-ba13-4d05-835a-204e5efd92df service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:54.744800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5edf3-ba13-4d05-835a-204e5efd92df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:54.755339 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5edf3-ba13-4d05-835a-204e5efd92df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:54.757509 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5edf3-ba13-4d05-835a-204e5efd92df service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:54.767934 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 998/1998] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:57:56.140464 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83879d2a-18d9-429e-8d77-374d646c6606 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:56.141358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83879d2a-18d9-429e-8d77-374d646c6606 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:56.142058 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83879d2a-18d9-429e-8d77-374d646c6606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:56.179786 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-83879d2a-18d9-429e-8d77-374d646c6606 None None] MFA Rules not processed for user `6a713d55889246049668bdb4e221c998`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:57:56.181264 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-83879d2a-18d9-429e-8d77-374d646c6606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:56.273581 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1001/1999] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:57:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:57:56.328061 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5edf3-ba13-4d05-835a-204e5efd92df service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:56.329560 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-2bd5edf3-ba13-4d05-835a-204e5efd92df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:56.399787 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5edf3-ba13-4d05-835a-204e5efd92df service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:56.403820 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf10a76-b22a-4ed9-bfdc-8c1c573b18a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:56.404711 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf10a76-b22a-4ed9-bfdc-8c1c573b18a1 service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:56.405006 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf10a76-b22a-4ed9-bfdc-8c1c573b18a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:56.405290 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf10a76-b22a-4ed9-bfdc-8c1c573b18a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:56.418101 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf10a76-b22a-4ed9-bfdc-8c1c573b18a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:56.419700 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf10a76-b22a-4ed9-bfdc-8c1c573b18a1 service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:56.432731 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 999/2000] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:57:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:58:03.632393 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6d04d-d99d-4275-829c-e7fc1005910a None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:03.632893 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6d04d-d99d-4275-829c-e7fc1005910a None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:03.632982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6d04d-d99d-4275-829c-e7fc1005910a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:03.651331 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-d7a6d04d-d99d-4275-829c-e7fc1005910a None None] MFA Rules not processed for user `6a713d55889246049668bdb4e221c998`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:03.652616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-d7a6d04d-d99d-4275-829c-e7fc1005910a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:03.664064 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1002/2001] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:05.450690 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf10a76-b22a-4ed9-bfdc-8c1c573b18a1 service cinder] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:05.452174 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-dcf10a76-b22a-4ed9-bfdc-8c1c573b18a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:05.468031 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf10a76-b22a-4ed9-bfdc-8c1c573b18a1 service cinder] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:05.472655 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db244e-d2b7-4c77-9718-0748169f6a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:05.474230 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db244e-d2b7-4c77-9718-0748169f6a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:05.474230 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db244e-d2b7-4c77-9718-0748169f6a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:05.474230 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db244e-d2b7-4c77-9718-0748169f6a26 admin admin] PATH_INFO: `/v3/users/f2ccc50dbc904e679d7de3bc9f211e16` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:05.476031 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db244e-d2b7-4c77-9718-0748169f6a26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2ccc50dbc904e679d7de3bc9f211e16)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:05.478002 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db244e-d2b7-4c77-9718-0748169f6a26 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:05.738876 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-f7db244e-d2b7-4c77-9718-0748169f6a26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2ccc50dbc904e679d7de3bc9f211e16'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:05.739613 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-f7db244e-d2b7-4c77-9718-0748169f6a26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2ccc50dbc904e679d7de3bc9f211e16'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:05.760873 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-f7db244e-d2b7-4c77-9718-0748169f6a26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2ccc50dbc904e679d7de3bc9f211e16'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:05.773771 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-f7db244e-d2b7-4c77-9718-0748169f6a26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2ccc50dbc904e679d7de3bc9f211e16'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:05.774536 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-f7db244e-d2b7-4c77-9718-0748169f6a26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2ccc50dbc904e679d7de3bc9f211e16'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:05.895176 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:05.902364 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1000/2002] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:58:05 2022] DELETE /identity/v3/users/f2ccc50dbc904e679d7de3bc9f211e16 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:05.906149 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c64b9-446f-48fd-9b90-9472dfed0ccc None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:05.906619 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c64b9-446f-48fd-9b90-9472dfed0ccc None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:05.906720 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c64b9-446f-48fd-9b90-9472dfed0ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:05.925056 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-b31c64b9-446f-48fd-9b90-9472dfed0ccc None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:05.926182 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b31c64b9-446f-48fd-9b90-9472dfed0ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:05.996986 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1003/2003] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:06.006591 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db244e-d2b7-4c77-9718-0748169f6a26 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:06.008053 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f7db244e-d2b7-4c77-9718-0748169f6a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:06.070262 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db244e-d2b7-4c77-9718-0748169f6a26 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:06.074127 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff861548-c5bd-4cde-bfde-a56817500f6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:06.074786 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff861548-c5bd-4cde-bfde-a56817500f6b service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:06.075094 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff861548-c5bd-4cde-bfde-a56817500f6b service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:06.075375 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff861548-c5bd-4cde-bfde-a56817500f6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:06.086872 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff861548-c5bd-4cde-bfde-a56817500f6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:06.089165 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff861548-c5bd-4cde-bfde-a56817500f6b service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:06.100888 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1001/2004] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:58:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:58:06.604047 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c64b9-446f-48fd-9b90-9472dfed0ccc None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:06.605544 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b31c64b9-446f-48fd-9b90-9472dfed0ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:06.618890 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c64b9-446f-48fd-9b90-9472dfed0ccc None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:06.623828 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41698635-4aa2-42f2-9c63-ff24021d0fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:06.624660 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41698635-4aa2-42f2-9c63-ff24021d0fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:06.624952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41698635-4aa2-42f2-9c63-ff24021d0fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:06.625236 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41698635-4aa2-42f2-9c63-ff24021d0fe9 admin admin] PATH_INFO: `/v3/projects/64dd9277c418451d9318a595d7f23970` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:06.626448 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41698635-4aa2-42f2-9c63-ff24021d0fe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64dd9277c418451d9318a595d7f23970)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:06.628524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41698635-4aa2-42f2-9c63-ff24021d0fe9 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:06.761941 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:06.764790 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-41698635-4aa2-42f2-9c63-ff24021d0fe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64dd9277c418451d9318a595d7f23970', 'request_id': 'req-41698635-4aa2-42f2-9c63-ff24021d0fe9'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:06.771117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-41698635-4aa2-42f2-9c63-ff24021d0fe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64dd9277c418451d9318a595d7f23970', 'request_id': 'req-41698635-4aa2-42f2-9c63-ff24021d0fe9'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:06.859504 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-41698635-4aa2-42f2-9c63-ff24021d0fe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64dd9277c418451d9318a595d7f23970', 'request_id': 'req-41698635-4aa2-42f2-9c63-ff24021d0fe9'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:06.872731 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-41698635-4aa2-42f2-9c63-ff24021d0fe9 admin admin] The token cache is being invalidate because project 64dd9277c418451d9318a595d7f23970 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:58:06.873031 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-41698635-4aa2-42f2-9c63-ff24021d0fe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:06.873861 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-41698635-4aa2-42f2-9c63-ff24021d0fe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:06.875540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1004/2005] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:58:06 2022] DELETE /identity/v3/projects/64dd9277c418451d9318a595d7f23970 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:06.879459 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff861548-c5bd-4cde-bfde-a56817500f6b service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:06.890257 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff861548-c5bd-4cde-bfde-a56817500f6b service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:06.949710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb89dc-c009-4fb1-bef8-7b83bad46e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:06.950606 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb89dc-c009-4fb1-bef8-7b83bad46e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:06.950893 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb89dc-c009-4fb1-bef8-7b83bad46e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:06.951178 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb89dc-c009-4fb1-bef8-7b83bad46e97 admin admin] PATH_INFO: `/v3/users/e6088a5ea71d4014845e1419a68bf7ec` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:06.952497 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb89dc-c009-4fb1-bef8-7b83bad46e97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6088a5ea71d4014845e1419a68bf7ec)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:06.954535 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb89dc-c009-4fb1-bef8-7b83bad46e97 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:07.290521 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-dadb89dc-c009-4fb1-bef8-7b83bad46e97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6088a5ea71d4014845e1419a68bf7ec'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:07.291173 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-dadb89dc-c009-4fb1-bef8-7b83bad46e97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6088a5ea71d4014845e1419a68bf7ec'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:07.303480 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-dadb89dc-c009-4fb1-bef8-7b83bad46e97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6088a5ea71d4014845e1419a68bf7ec'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:07.311021 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-dadb89dc-c009-4fb1-bef8-7b83bad46e97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6088a5ea71d4014845e1419a68bf7ec'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:07.311740 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-dadb89dc-c009-4fb1-bef8-7b83bad46e97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6088a5ea71d4014845e1419a68bf7ec'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:07.403832 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1002/2006] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:58:06 2022] DELETE /identity/v3/users/e6088a5ea71d4014845e1419a68bf7ec => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:08.061340 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41698635-4aa2-42f2-9c63-ff24021d0fe9 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:08.067555 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-41698635-4aa2-42f2-9c63-ff24021d0fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:08.084840 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41698635-4aa2-42f2-9c63-ff24021d0fe9 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:08.168521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c648b8-f978-42db-a5c4-547829358ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:08.169962 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c648b8-f978-42db-a5c4-547829358ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:08.170993 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c648b8-f978-42db-a5c4-547829358ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:08.170993 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c648b8-f978-42db-a5c4-547829358ff8 admin admin] PATH_INFO: `/v3/projects/ac736efe42fa4b4ab15898f4bb4e6504` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:08.174127 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c648b8-f978-42db-a5c4-547829358ff8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac736efe42fa4b4ab15898f4bb4e6504)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:08.174240 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c648b8-f978-42db-a5c4-547829358ff8 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:08.330881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c8c648b8-f978-42db-a5c4-547829358ff8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac736efe42fa4b4ab15898f4bb4e6504', 'request_id': 'req-c8c648b8-f978-42db-a5c4-547829358ff8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:08.340280 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c8c648b8-f978-42db-a5c4-547829358ff8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac736efe42fa4b4ab15898f4bb4e6504', 'request_id': 'req-c8c648b8-f978-42db-a5c4-547829358ff8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:08.477121 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c8c648b8-f978-42db-a5c4-547829358ff8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac736efe42fa4b4ab15898f4bb4e6504', 'request_id': 'req-c8c648b8-f978-42db-a5c4-547829358ff8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:08.489413 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c8c648b8-f978-42db-a5c4-547829358ff8 admin admin] The token cache is being invalidate because project ac736efe42fa4b4ab15898f4bb4e6504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:58:08.489773 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c8c648b8-f978-42db-a5c4-547829358ff8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:08.491056 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c8c648b8-f978-42db-a5c4-547829358ff8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:08.492735 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1005/2007] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:58:08 2022] DELETE /identity/v3/projects/ac736efe42fa4b4ab15898f4bb4e6504 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:08.498591 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f9f29-d5d4-4b39-8869-1075256cc4b4 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:08.499074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f9f29-d5d4-4b39-8869-1075256cc4b4 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:08.499369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f9f29-d5d4-4b39-8869-1075256cc4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:08.520519 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-358f9f29-d5d4-4b39-8869-1075256cc4b4 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:08.522528 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-358f9f29-d5d4-4b39-8869-1075256cc4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:08.538185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:08.589334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1003/2008] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:08.598342 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb28b1-efa4-40a6-88bf-1c04a5ab2030 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:08.607225 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb28b1-efa4-40a6-88bf-1c04a5ab2030 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:08.607594 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb28b1-efa4-40a6-88bf-1c04a5ab2030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:08.649442 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-7bbb28b1-efa4-40a6-88bf-1c04a5ab2030 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:08.651217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-7bbb28b1-efa4-40a6-88bf-1c04a5ab2030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:08.669867 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1006/2009] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:08.673842 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f9f29-d5d4-4b39-8869-1075256cc4b4 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:08.684428 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f9f29-d5d4-4b39-8869-1075256cc4b4 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:08.690005 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236c17d-422f-4de9-8c5e-c4bd738c7f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:08.690686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236c17d-422f-4de9-8c5e-c4bd738c7f88 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:08.690976 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236c17d-422f-4de9-8c5e-c4bd738c7f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:08.691261 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236c17d-422f-4de9-8c5e-c4bd738c7f88 admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:08.692245 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236c17d-422f-4de9-8c5e-c4bd738c7f88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:58:08.692565 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236c17d-422f-4de9-8c5e-c4bd738c7f88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:08.695044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236c17d-422f-4de9-8c5e-c4bd738c7f88 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:08.707817 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1004/2010] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:58:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:58:08.713621 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb28b1-efa4-40a6-88bf-1c04a5ab2030 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:08.723140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb28b1-efa4-40a6-88bf-1c04a5ab2030 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:08.728560 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287c19c-66b9-4f20-8d82-5f78a7003751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:08.729211 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287c19c-66b9-4f20-8d82-5f78a7003751 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:08.729498 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287c19c-66b9-4f20-8d82-5f78a7003751 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:08.729777 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287c19c-66b9-4f20-8d82-5f78a7003751 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:08.730467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287c19c-66b9-4f20-8d82-5f78a7003751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:08.732408 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287c19c-66b9-4f20-8d82-5f78a7003751 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:08.893953 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1007/2011] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:58:08 2022] POST /identity/v3/projects => generated 386 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:58:08.895456 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236c17d-422f-4de9-8c5e-c4bd738c7f88 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:08.907075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236c17d-422f-4de9-8c5e-c4bd738c7f88 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:08.984949 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91bfc4-1a31-4f67-9673-f922611f2977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:08.985961 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91bfc4-1a31-4f67-9673-f922611f2977 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:08.986261 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91bfc4-1a31-4f67-9673-f922611f2977 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:08.986629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91bfc4-1a31-4f67-9673-f922611f2977 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:08.987745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91bfc4-1a31-4f67-9673-f922611f2977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:08.991233 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91bfc4-1a31-4f67-9673-f922611f2977 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:09.110068 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1005/2012] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:58:08 2022] POST /identity/v3/users => generated 294 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:58:09.114697 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287c19c-66b9-4f20-8d82-5f78a7003751 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:09.128085 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287c19c-66b9-4f20-8d82-5f78a7003751 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:09.134388 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0eaac2-c378-44fa-adeb-caf701bb9837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:09.135234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0eaac2-c378-44fa-adeb-caf701bb9837 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:09.135635 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0eaac2-c378-44fa-adeb-caf701bb9837 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:09.135971 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0eaac2-c378-44fa-adeb-caf701bb9837 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:09.136867 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0eaac2-c378-44fa-adeb-caf701bb9837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:09.142727 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0eaac2-c378-44fa-adeb-caf701bb9837 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:09.153198 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1008/2013] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:09 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:58:09.157127 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91bfc4-1a31-4f67-9673-f922611f2977 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:09.174828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91bfc4-1a31-4f67-9673-f922611f2977 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:09.180574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe0781-681e-4f57-92c7-d40813225f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:09.181414 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe0781-681e-4f57-92c7-d40813225f4d admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:09.181758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe0781-681e-4f57-92c7-d40813225f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:09.182133 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe0781-681e-4f57-92c7-d40813225f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:09.183051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe0781-681e-4f57-92c7-d40813225f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:09.185048 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe0781-681e-4f57-92c7-d40813225f4d admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:09.202597 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1006/2014] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:09 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:58:09.206669 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0eaac2-c378-44fa-adeb-caf701bb9837 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:09.220023 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0eaac2-c378-44fa-adeb-caf701bb9837 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:09.225522 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666e272-bcb7-4efb-bdc8-f604f51117c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:09.227403 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666e272-bcb7-4efb-bdc8-f604f51117c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:09.227829 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666e272-bcb7-4efb-bdc8-f604f51117c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:09.227991 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666e272-bcb7-4efb-bdc8-f604f51117c2 admin admin] PATH_INFO: `/v3/projects/b3afaa82844648adbd8beec95e151c93/users/c95cf3f9a29c43e59e6b6a806481aaf3/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:09.248842 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666e272-bcb7-4efb-bdc8-f604f51117c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3afaa82844648adbd8beec95e151c93, user_id=c95cf3f9a29c43e59e6b6a806481aaf3, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:09.251576 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666e272-bcb7-4efb-bdc8-f604f51117c2 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:09.345711 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:09.351080 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1009/2015] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:58:09 2022] PUT /identity/v3/projects/b3afaa82844648adbd8beec95e151c93/users/c95cf3f9a29c43e59e6b6a806481aaf3/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:09.361427 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16135197-3032-4cee-9c4a-5af65ebe55a3 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:09.361730 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16135197-3032-4cee-9c4a-5af65ebe55a3 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:09.362019 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16135197-3032-4cee-9c4a-5af65ebe55a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:09.390399 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-16135197-3032-4cee-9c4a-5af65ebe55a3 None None] MFA Rules not processed for user `c95cf3f9a29c43e59e6b6a806481aaf3`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:09.391656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-16135197-3032-4cee-9c4a-5af65ebe55a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:09.463634 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1007/2016] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:09.468494 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666e272-bcb7-4efb-bdc8-f604f51117c2 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:09.538228 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666e272-bcb7-4efb-bdc8-f604f51117c2 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:09.548330 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04348303-1361-4e4f-8391-d7283e5ac7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:09.549189 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04348303-1361-4e4f-8391-d7283e5ac7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:09.549485 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04348303-1361-4e4f-8391-d7283e5ac7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:09.549957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04348303-1361-4e4f-8391-d7283e5ac7d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:09.550514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04348303-1361-4e4f-8391-d7283e5ac7d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:09.553835 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04348303-1361-4e4f-8391-d7283e5ac7d9 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:09.652300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1010/2017] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:58:09 2022] POST /identity/v3/projects => generated 386 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:58:09.656846 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16135197-3032-4cee-9c4a-5af65ebe55a3 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:09.671673 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16135197-3032-4cee-9c4a-5af65ebe55a3 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:09.685263 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:09.737784 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564348ba-4ec7-4556-b8b3-f5395a0417f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:09.738538 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564348ba-4ec7-4556-b8b3-f5395a0417f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:09.738830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564348ba-4ec7-4556-b8b3-f5395a0417f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:09.739144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564348ba-4ec7-4556-b8b3-f5395a0417f9 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:09.739850 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564348ba-4ec7-4556-b8b3-f5395a0417f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:09.742036 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564348ba-4ec7-4556-b8b3-f5395a0417f9 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:09.818405 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04348303-1361-4e4f-8391-d7283e5ac7d9 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:09.820198 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-04348303-1361-4e4f-8391-d7283e5ac7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:09.834228 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04348303-1361-4e4f-8391-d7283e5ac7d9 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:09.839406 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42116d42-5f9d-46da-a599-9335a623a31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:09.840337 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42116d42-5f9d-46da-a599-9335a623a31a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:09.840655 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42116d42-5f9d-46da-a599-9335a623a31a admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:09.840938 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42116d42-5f9d-46da-a599-9335a623a31a admin admin] PATH_INFO: `/v3/users/e3438fa080d341e5849d110c29ea4527` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:09.842171 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42116d42-5f9d-46da-a599-9335a623a31a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3438fa080d341e5849d110c29ea4527)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:09.844122 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42116d42-5f9d-46da-a599-9335a623a31a admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:09.877679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1008/2018] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:58:09 2022] POST /identity/v3/users => generated 300 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:58:09.879510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564348ba-4ec7-4556-b8b3-f5395a0417f9 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:09.889779 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564348ba-4ec7-4556-b8b3-f5395a0417f9 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:09.894642 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ca908-e722-4103-8109-32daf725a5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:09.895313 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ca908-e722-4103-8109-32daf725a5ef admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:09.895602 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ca908-e722-4103-8109-32daf725a5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:09.895886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ca908-e722-4103-8109-32daf725a5ef admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:09.897194 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ca908-e722-4103-8109-32daf725a5ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:09.898960 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ca908-e722-4103-8109-32daf725a5ef admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:09.909732 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1009/2019] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:09 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:58:09.915641 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ca908-e722-4103-8109-32daf725a5ef admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:09.925556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ca908-e722-4103-8109-32daf725a5ef admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:09.930634 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3193c-0632-4573-af68-2dd2ba996c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:09.931526 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3193c-0632-4573-af68-2dd2ba996c9b admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:09.931809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3193c-0632-4573-af68-2dd2ba996c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:09.932086 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3193c-0632-4573-af68-2dd2ba996c9b admin admin] PATH_INFO: `/v3/projects/9046e2aad30a42409b0e213ef53711d9/users/3e3bf9e99880400eaf854d763dd2affe/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:09.952039 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3193c-0632-4573-af68-2dd2ba996c9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9046e2aad30a42409b0e213ef53711d9, user_id=3e3bf9e99880400eaf854d763dd2affe, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:09.954854 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3193c-0632-4573-af68-2dd2ba996c9b admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:10.054936 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1010/2020] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:58:09 2022] PUT /identity/v3/projects/9046e2aad30a42409b0e213ef53711d9/users/3e3bf9e99880400eaf854d763dd2affe/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:10.059216 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3193c-0632-4573-af68-2dd2ba996c9b admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:10.103389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-42116d42-5f9d-46da-a599-9335a623a31a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3438fa080d341e5849d110c29ea4527'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:10.118062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-42116d42-5f9d-46da-a599-9335a623a31a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3438fa080d341e5849d110c29ea4527'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:10.126920 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-42116d42-5f9d-46da-a599-9335a623a31a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3438fa080d341e5849d110c29ea4527'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:10.127667 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-42116d42-5f9d-46da-a599-9335a623a31a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3438fa080d341e5849d110c29ea4527'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:10.159220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3193c-0632-4573-af68-2dd2ba996c9b admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:10.164408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46988d-8e12-4113-a239-3506c9be23a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:10.165065 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46988d-8e12-4113-a239-3506c9be23a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:10.165354 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46988d-8e12-4113-a239-3506c9be23a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:10.165635 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46988d-8e12-4113-a239-3506c9be23a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:10.166461 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46988d-8e12-4113-a239-3506c9be23a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:10.168063 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46988d-8e12-4113-a239-3506c9be23a1 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:10.179908 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1011/2021] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:10 2022] GET /identity/v3/roles => generated 1427 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:58:10.187546 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46988d-8e12-4113-a239-3506c9be23a1 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:10.190540 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-4c46988d-8e12-4113-a239-3506c9be23a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:10.191550 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-42116d42-5f9d-46da-a599-9335a623a31a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3438fa080d341e5849d110c29ea4527'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:10.202825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1011/2022] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:58:09 2022] DELETE /identity/v3/users/e3438fa080d341e5849d110c29ea4527 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:58:10.204767 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e2c4e-f897-45be-8c8b-8e6a65537205 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:10.205066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e2c4e-f897-45be-8c8b-8e6a65537205 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:10.205554 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e2c4e-f897-45be-8c8b-8e6a65537205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:10.216520 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46988d-8e12-4113-a239-3506c9be23a1 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:10.232514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-084e2c4e-f897-45be-8c8b-8e6a65537205 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:10.236840 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-084e2c4e-f897-45be-8c8b-8e6a65537205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:10.300355 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9da8a-f5e3-4a01-a1ca-9145344a6cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:10.301277 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9da8a-f5e3-4a01-a1ca-9145344a6cd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:10.301569 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9da8a-f5e3-4a01-a1ca-9145344a6cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:10.301850 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9da8a-f5e3-4a01-a1ca-9145344a6cd2 admin admin] PATH_INFO: `/v3/projects/9046e2aad30a42409b0e213ef53711d9/users/3e3bf9e99880400eaf854d763dd2affe/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:10.305048 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9da8a-f5e3-4a01-a1ca-9145344a6cd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9046e2aad30a42409b0e213ef53711d9, user_id=3e3bf9e99880400eaf854d763dd2affe, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:10.308281 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9da8a-f5e3-4a01-a1ca-9145344a6cd2 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:10.312337 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:10.317416 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:10.331924 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1012/2023] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:58:10 2022] PUT /identity/v3/projects/9046e2aad30a42409b0e213ef53711d9/users/3e3bf9e99880400eaf854d763dd2affe/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:10.335399 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9a3b8-9297-4c0c-9659-2278f0a343b2 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:10.336295 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9a3b8-9297-4c0c-9659-2278f0a343b2 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:10.336753 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9a3b8-9297-4c0c-9659-2278f0a343b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:10.342406 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1012/2024] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:58:10.356038 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e2c4e-f897-45be-8c8b-8e6a65537205 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:10.357741 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-084e2c4e-f897-45be-8c8b-8e6a65537205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:10.370755 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-22e9a3b8-9297-4c0c-9659-2278f0a343b2 None None] MFA Rules not processed for user `3e3bf9e99880400eaf854d763dd2affe`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:10.372255 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-22e9a3b8-9297-4c0c-9659-2278f0a343b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:10.440689 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e2c4e-f897-45be-8c8b-8e6a65537205 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:10.452923 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1013/2025] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:10.466070 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9a3b8-9297-4c0c-9659-2278f0a343b2 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:10.467542 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-22e9a3b8-9297-4c0c-9659-2278f0a343b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:10.494026 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7c927-229c-4656-868f-0584c1378f15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:10.496287 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7c927-229c-4656-868f-0584c1378f15 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:10.496586 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7c927-229c-4656-868f-0584c1378f15 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:10.496876 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7c927-229c-4656-868f-0584c1378f15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:10.529163 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9a3b8-9297-4c0c-9659-2278f0a343b2 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:10.533000 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b976bf-a112-4f8f-92ba-e2a5732da35c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:10.533809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b976bf-a112-4f8f-92ba-e2a5732da35c service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:10.534329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b976bf-a112-4f8f-92ba-e2a5732da35c service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:10.535382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b976bf-a112-4f8f-92ba-e2a5732da35c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:10.549782 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b976bf-a112-4f8f-92ba-e2a5732da35c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:10.551319 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b976bf-a112-4f8f-92ba-e2a5732da35c service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:10.562882 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1014/2026] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:58:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:58:10.578117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7c927-229c-4656-868f-0584c1378f15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:10.579596 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7c927-229c-4656-868f-0584c1378f15 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:10.591372 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1013/2027] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:58:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:58:10.593496 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b976bf-a112-4f8f-92ba-e2a5732da35c service cinder] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:10.606725 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b976bf-a112-4f8f-92ba-e2a5732da35c service cinder] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:10.611350 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bcbe6-ad6b-4b51-993d-675734ed6f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:10.612283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bcbe6-ad6b-4b51-993d-675734ed6f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:10.612568 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bcbe6-ad6b-4b51-993d-675734ed6f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:10.612843 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bcbe6-ad6b-4b51-993d-675734ed6f08 admin admin] PATH_INFO: `/v3/users/c95cf3f9a29c43e59e6b6a806481aaf3` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:10.614044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bcbe6-ad6b-4b51-993d-675734ed6f08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c95cf3f9a29c43e59e6b6a806481aaf3)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:10.616263 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bcbe6-ad6b-4b51-993d-675734ed6f08 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:10.880287 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-6b3bcbe6-ad6b-4b51-993d-675734ed6f08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c95cf3f9a29c43e59e6b6a806481aaf3'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:10.882220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-6b3bcbe6-ad6b-4b51-993d-675734ed6f08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c95cf3f9a29c43e59e6b6a806481aaf3'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:10.895646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-6b3bcbe6-ad6b-4b51-993d-675734ed6f08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c95cf3f9a29c43e59e6b6a806481aaf3'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:10.903277 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-6b3bcbe6-ad6b-4b51-993d-675734ed6f08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c95cf3f9a29c43e59e6b6a806481aaf3'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:10.903972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-6b3bcbe6-ad6b-4b51-993d-675734ed6f08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c95cf3f9a29c43e59e6b6a806481aaf3'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:11.079111 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:11.084435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1015/2028] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:58:10 2022] DELETE /identity/v3/users/c95cf3f9a29c43e59e6b6a806481aaf3 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:11.089486 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db373d-b545-4776-ae52-d6464eb30e63 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:11.090039 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db373d-b545-4776-ae52-d6464eb30e63 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:11.090304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db373d-b545-4776-ae52-d6464eb30e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:11.108553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-c7db373d-b545-4776-ae52-d6464eb30e63 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:11.109825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-c7db373d-b545-4776-ae52-d6464eb30e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:11.161053 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bcbe6-ad6b-4b51-993d-675734ed6f08 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:11.163784 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-6b3bcbe6-ad6b-4b51-993d-675734ed6f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:11.180715 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1014/2029] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:11.191916 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db373d-b545-4776-ae52-d6464eb30e63 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:11.193645 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-c7db373d-b545-4776-ae52-d6464eb30e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:11.200882 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:11.258881 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bcbe6-ad6b-4b51-993d-675734ed6f08 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:11.265186 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecaf2d-02f7-45b0-9852-9a7709206b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:11.266238 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecaf2d-02f7-45b0-9852-9a7709206b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:11.267202 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecaf2d-02f7-45b0-9852-9a7709206b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:11.267468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db373d-b545-4776-ae52-d6464eb30e63 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:11.267579 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecaf2d-02f7-45b0-9852-9a7709206b70 admin admin] PATH_INFO: `/v3/projects/742f4b1647df4002804de715966ef8f9` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:11.268745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baecaf2d-02f7-45b0-9852-9a7709206b70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=742f4b1647df4002804de715966ef8f9)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:11.270801 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baecaf2d-02f7-45b0-9852-9a7709206b70 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:11.272144 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe1582-a8c2-422c-8d3f-cffbffa9dd48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:11.273143 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe1582-a8c2-422c-8d3f-cffbffa9dd48 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:11.273480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe1582-a8c2-422c-8d3f-cffbffa9dd48 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:11.273919 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe1582-a8c2-422c-8d3f-cffbffa9dd48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:11.296121 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe1582-a8c2-422c-8d3f-cffbffa9dd48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:11.297744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe1582-a8c2-422c-8d3f-cffbffa9dd48 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:11.310968 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1015/2030] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:58:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:58:11.393679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-baecaf2d-02f7-45b0-9852-9a7709206b70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '742f4b1647df4002804de715966ef8f9', 'request_id': 'req-baecaf2d-02f7-45b0-9852-9a7709206b70'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:11.400833 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-baecaf2d-02f7-45b0-9852-9a7709206b70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '742f4b1647df4002804de715966ef8f9', 'request_id': 'req-baecaf2d-02f7-45b0-9852-9a7709206b70'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:11.407971 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-baecaf2d-02f7-45b0-9852-9a7709206b70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '742f4b1647df4002804de715966ef8f9', 'request_id': 'req-baecaf2d-02f7-45b0-9852-9a7709206b70'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:11.506540 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-baecaf2d-02f7-45b0-9852-9a7709206b70 admin admin] The token cache is being invalidate because project 742f4b1647df4002804de715966ef8f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:58:11.512191 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-baecaf2d-02f7-45b0-9852-9a7709206b70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:11.512191 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-baecaf2d-02f7-45b0-9852-9a7709206b70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:11.512191 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1016/2031] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:58:11 2022] DELETE /identity/v3/projects/742f4b1647df4002804de715966ef8f9 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:58:11.519647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c1941-98b5-4610-a749-aa9a27c776c0 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:11.519752 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c1941-98b5-4610-a749-aa9a27c776c0 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:11.520172 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c1941-98b5-4610-a749-aa9a27c776c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:11.540738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-e50c1941-98b5-4610-a749-aa9a27c776c0 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:11.541795 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-e50c1941-98b5-4610-a749-aa9a27c776c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:11.632618 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1016/2032] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:11.634723 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe16f9-aaa8-48da-b164-abc7ced9a093 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:11.635252 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe16f9-aaa8-48da-b164-abc7ced9a093 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:11.635653 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe16f9-aaa8-48da-b164-abc7ced9a093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:11.657087 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-70fe16f9-aaa8-48da-b164-abc7ced9a093 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:11.663939 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-70fe16f9-aaa8-48da-b164-abc7ced9a093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:11.674598 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1017/2033] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:11.682315 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c1941-98b5-4610-a749-aa9a27c776c0 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:11.690630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c1941-98b5-4610-a749-aa9a27c776c0 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:11.695739 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c4779-27d5-420d-a1ea-3aba95aeab4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:11.696478 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c4779-27d5-420d-a1ea-3aba95aeab4b admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:11.696786 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c4779-27d5-420d-a1ea-3aba95aeab4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:11.697063 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c4779-27d5-420d-a1ea-3aba95aeab4b admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:11.697902 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c4779-27d5-420d-a1ea-3aba95aeab4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:58:11.698211 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c4779-27d5-420d-a1ea-3aba95aeab4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:11.699900 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c4779-27d5-420d-a1ea-3aba95aeab4b admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:11.712574 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1017/2034] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:58:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:58:11.717163 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe16f9-aaa8-48da-b164-abc7ced9a093 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:11.727851 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe16f9-aaa8-48da-b164-abc7ced9a093 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:11.732602 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03db1a-7036-426a-83a6-12561b2e63ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:11.733306 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03db1a-7036-426a-83a6-12561b2e63ca admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:11.733595 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03db1a-7036-426a-83a6-12561b2e63ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:11.733881 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03db1a-7036-426a-83a6-12561b2e63ca admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:11.734586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b03db1a-7036-426a-83a6-12561b2e63ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:11.736541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b03db1a-7036-426a-83a6-12561b2e63ca admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:11.861822 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1018/2035] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:58:11 2022] POST /identity/v3/projects => generated 374 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:58:11.866226 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c4779-27d5-420d-a1ea-3aba95aeab4b admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:11.876539 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c4779-27d5-420d-a1ea-3aba95aeab4b admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:11.899870 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03db1a-7036-426a-83a6-12561b2e63ca admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:11.901770 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-4b03db1a-7036-426a-83a6-12561b2e63ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:11.941836 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bec37-7e43-44a2-b4a4-ec73c0ada60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:11.942523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bec37-7e43-44a2-b4a4-ec73c0ada60d admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:11.942810 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bec37-7e43-44a2-b4a4-ec73c0ada60d admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:11.943186 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bec37-7e43-44a2-b4a4-ec73c0ada60d admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:11.943925 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10bec37-7e43-44a2-b4a4-ec73c0ada60d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:11.945902 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10bec37-7e43-44a2-b4a4-ec73c0ada60d admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:11.980559 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03db1a-7036-426a-83a6-12561b2e63ca admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:11.985460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bb174-3402-483f-90ef-a50eb89240e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:11.986335 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bb174-3402-483f-90ef-a50eb89240e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:11.986624 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bb174-3402-483f-90ef-a50eb89240e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:11.986903 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bb174-3402-483f-90ef-a50eb89240e8 admin admin] PATH_INFO: `/v3/projects/b3afaa82844648adbd8beec95e151c93` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:11.988209 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7bb174-3402-483f-90ef-a50eb89240e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3afaa82844648adbd8beec95e151c93)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:11.990657 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7bb174-3402-483f-90ef-a50eb89240e8 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:11.993052 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:12.054971 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1018/2036] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:58:11 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:58:12.059119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bec37-7e43-44a2-b4a4-ec73c0ada60d admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:12.069635 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bec37-7e43-44a2-b4a4-ec73c0ada60d admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:12.074385 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d136ca-8c84-46c2-8161-63b56a81f258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:12.075146 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d136ca-8c84-46c2-8161-63b56a81f258 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:12.076765 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d136ca-8c84-46c2-8161-63b56a81f258 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:12.076765 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d136ca-8c84-46c2-8161-63b56a81f258 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:12.076962 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d136ca-8c84-46c2-8161-63b56a81f258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:12.078761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d136ca-8c84-46c2-8161-63b56a81f258 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:12.093867 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1019/2037] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:12 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:58:12.096544 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d136ca-8c84-46c2-8161-63b56a81f258 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:12.107787 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d136ca-8c84-46c2-8161-63b56a81f258 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:12.112598 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f1bc2-4df4-4b9f-9ea2-bc19ef395177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:12.113259 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f1bc2-4df4-4b9f-9ea2-bc19ef395177 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:12.113552 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f1bc2-4df4-4b9f-9ea2-bc19ef395177 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:12.113838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f1bc2-4df4-4b9f-9ea2-bc19ef395177 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:12.114553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f1bc2-4df4-4b9f-9ea2-bc19ef395177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:12.116694 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f1bc2-4df4-4b9f-9ea2-bc19ef395177 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:12.129046 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1020/2038] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:12 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:58:12.133232 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f1bc2-4df4-4b9f-9ea2-bc19ef395177 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:12.145906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:12.146032 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-ff7bb174-3402-483f-90ef-a50eb89240e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3afaa82844648adbd8beec95e151c93', 'request_id': 'req-ff7bb174-3402-483f-90ef-a50eb89240e8'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:12.146731 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f1bc2-4df4-4b9f-9ea2-bc19ef395177 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:12.148199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-ff7bb174-3402-483f-90ef-a50eb89240e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3afaa82844648adbd8beec95e151c93', 'request_id': 'req-ff7bb174-3402-483f-90ef-a50eb89240e8'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:12.154659 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-ff7bb174-3402-483f-90ef-a50eb89240e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3afaa82844648adbd8beec95e151c93', 'request_id': 'req-ff7bb174-3402-483f-90ef-a50eb89240e8'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:12.213465 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278eb32f-4dfb-4323-b778-b82635fa5d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:12.214456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278eb32f-4dfb-4323-b778-b82635fa5d24 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:12.214753 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278eb32f-4dfb-4323-b778-b82635fa5d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:12.216434 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278eb32f-4dfb-4323-b778-b82635fa5d24 admin admin] PATH_INFO: `/v3/projects/283896b4f9da40edbc6a0e88e897f61a/users/b451e78629894deda0827a59c3544cd4/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:12.232226 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278eb32f-4dfb-4323-b778-b82635fa5d24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=283896b4f9da40edbc6a0e88e897f61a, user_id=b451e78629894deda0827a59c3544cd4, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:12.235024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278eb32f-4dfb-4323-b778-b82635fa5d24 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:12.245563 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-ff7bb174-3402-483f-90ef-a50eb89240e8 admin admin] The token cache is being invalidate because project b3afaa82844648adbd8beec95e151c93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:58:12.245862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-ff7bb174-3402-483f-90ef-a50eb89240e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:12.246507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-ff7bb174-3402-483f-90ef-a50eb89240e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:12.248085 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1019/2039] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:58:11 2022] DELETE /identity/v3/projects/b3afaa82844648adbd8beec95e151c93 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:58:12.251968 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bb174-3402-483f-90ef-a50eb89240e8 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:12.253333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-ff7bb174-3402-483f-90ef-a50eb89240e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:12.266557 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bb174-3402-483f-90ef-a50eb89240e8 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:12.272038 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309ec33-63ad-4f59-891a-f89e10e3dbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:12.272986 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309ec33-63ad-4f59-891a-f89e10e3dbb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:12.278854 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309ec33-63ad-4f59-891a-f89e10e3dbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:12.278854 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309ec33-63ad-4f59-891a-f89e10e3dbb0 admin admin] PATH_INFO: `/v3/users/3e3bf9e99880400eaf854d763dd2affe` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:12.278854 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309ec33-63ad-4f59-891a-f89e10e3dbb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e3bf9e99880400eaf854d763dd2affe)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:12.278854 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309ec33-63ad-4f59-891a-f89e10e3dbb0 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:12.363192 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1021/2040] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:58:12 2022] PUT /identity/v3/projects/283896b4f9da40edbc6a0e88e897f61a/users/b451e78629894deda0827a59c3544cd4/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:58:12.374128 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd3e8e-761d-44d6-8962-adb120fd2019 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:12.374441 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd3e8e-761d-44d6-8962-adb120fd2019 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:12.374762 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd3e8e-761d-44d6-8962-adb120fd2019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:12.403919 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-2afd3e8e-761d-44d6-8962-adb120fd2019 None None] MFA Rules not processed for user `b451e78629894deda0827a59c3544cd4`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:12.405202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-2afd3e8e-761d-44d6-8962-adb120fd2019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:12.507383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1022/2041] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:58:12.520878 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd3e8e-761d-44d6-8962-adb120fd2019 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:12.523171 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-2afd3e8e-761d-44d6-8962-adb120fd2019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:12.557090 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9309ec33-63ad-4f59-891a-f89e10e3dbb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e3bf9e99880400eaf854d763dd2affe'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:12.557952 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9309ec33-63ad-4f59-891a-f89e10e3dbb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e3bf9e99880400eaf854d763dd2affe'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:12.580040 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9309ec33-63ad-4f59-891a-f89e10e3dbb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e3bf9e99880400eaf854d763dd2affe'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:12.590468 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9309ec33-63ad-4f59-891a-f89e10e3dbb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e3bf9e99880400eaf854d763dd2affe'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:12.591329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9309ec33-63ad-4f59-891a-f89e10e3dbb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e3bf9e99880400eaf854d763dd2affe'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:12.608825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd3e8e-761d-44d6-8962-adb120fd2019 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:12.613481 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28645b71-f74c-45ab-b9ea-350ed5d94f21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:12.613481 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28645b71-f74c-45ab-b9ea-350ed5d94f21 service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:12.613683 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28645b71-f74c-45ab-b9ea-350ed5d94f21 service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:12.613825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28645b71-f74c-45ab-b9ea-350ed5d94f21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:12.616603 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-28645b71-f74c-45ab-b9ea-350ed5d94f21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:12.627921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28645b71-f74c-45ab-b9ea-350ed5d94f21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:12.629462 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28645b71-f74c-45ab-b9ea-350ed5d94f21 service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:12.639404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1023/2042] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:58:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:58:12.694171 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1020/2043] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:58:12 2022] DELETE /identity/v3/users/3e3bf9e99880400eaf854d763dd2affe => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:58:13.252798 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28645b71-f74c-45ab-b9ea-350ed5d94f21 service cinder] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:13.254284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-28645b71-f74c-45ab-b9ea-350ed5d94f21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:13.323212 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:13.396582 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28645b71-f74c-45ab-b9ea-350ed5d94f21 service cinder] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:13.469367 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005a834-ca78-45d2-97d4-65b046f298a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:13.470330 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005a834-ca78-45d2-97d4-65b046f298a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:13.470783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005a834-ca78-45d2-97d4-65b046f298a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:13.471059 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005a834-ca78-45d2-97d4-65b046f298a7 admin admin] PATH_INFO: `/v3/projects/9046e2aad30a42409b0e213ef53711d9` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:13.472554 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005a834-ca78-45d2-97d4-65b046f298a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9046e2aad30a42409b0e213ef53711d9)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:13.475039 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005a834-ca78-45d2-97d4-65b046f298a7 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:13.620529 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-5005a834-ca78-45d2-97d4-65b046f298a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9046e2aad30a42409b0e213ef53711d9', 'request_id': 'req-5005a834-ca78-45d2-97d4-65b046f298a7'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:13.629400 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-5005a834-ca78-45d2-97d4-65b046f298a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9046e2aad30a42409b0e213ef53711d9', 'request_id': 'req-5005a834-ca78-45d2-97d4-65b046f298a7'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:13.740163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-5005a834-ca78-45d2-97d4-65b046f298a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9046e2aad30a42409b0e213ef53711d9', 'request_id': 'req-5005a834-ca78-45d2-97d4-65b046f298a7'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:13.752486 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-5005a834-ca78-45d2-97d4-65b046f298a7 admin admin] The token cache is being invalidate because project 9046e2aad30a42409b0e213ef53711d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:58:13.752783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-5005a834-ca78-45d2-97d4-65b046f298a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:13.753787 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-5005a834-ca78-45d2-97d4-65b046f298a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:13.756573 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1024/2044] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:58:13 2022] DELETE /identity/v3/projects/9046e2aad30a42409b0e213ef53711d9 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:13.763081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c28a6-5c4d-4cc6-90c2-83a46accbb0c None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:13.763855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c28a6-5c4d-4cc6-90c2-83a46accbb0c None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:13.763855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c28a6-5c4d-4cc6-90c2-83a46accbb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:13.785843 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-f46c28a6-5c4d-4cc6-90c2-83a46accbb0c None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:13.787475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f46c28a6-5c4d-4cc6-90c2-83a46accbb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:13.862497 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1021/2045] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:13.875090 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45e8eb-73b9-4df3-a94c-e429bf5db555 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:13.875407 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45e8eb-73b9-4df3-a94c-e429bf5db555 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:13.875692 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45e8eb-73b9-4df3-a94c-e429bf5db555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:13.897984 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-7d45e8eb-73b9-4df3-a94c-e429bf5db555 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:13.899235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-7d45e8eb-73b9-4df3-a94c-e429bf5db555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:13.907774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1025/2046] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:13.912892 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c28a6-5c4d-4cc6-90c2-83a46accbb0c None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:13.920541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:13.926719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c28a6-5c4d-4cc6-90c2-83a46accbb0c None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:13.933978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587eecf8-5f26-47f7-800f-d3a200bf2558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:13.934782 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587eecf8-5f26-47f7-800f-d3a200bf2558 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:13.935122 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587eecf8-5f26-47f7-800f-d3a200bf2558 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:13.935478 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587eecf8-5f26-47f7-800f-d3a200bf2558 admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:13.936326 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587eecf8-5f26-47f7-800f-d3a200bf2558 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:58:13.936729 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587eecf8-5f26-47f7-800f-d3a200bf2558 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:13.938475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587eecf8-5f26-47f7-800f-d3a200bf2558 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:13.953562 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1022/2047] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:58:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:58:13.957995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45e8eb-73b9-4df3-a94c-e429bf5db555 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:13.969826 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45e8eb-73b9-4df3-a94c-e429bf5db555 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:13.976093 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc6135-8656-4e66-bfeb-26e834411359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:13.976809 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc6135-8656-4e66-bfeb-26e834411359 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:13.977099 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc6135-8656-4e66-bfeb-26e834411359 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:13.977381 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc6135-8656-4e66-bfeb-26e834411359 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:13.978221 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc6135-8656-4e66-bfeb-26e834411359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:13.980291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc6135-8656-4e66-bfeb-26e834411359 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:14.102365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1026/2048] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:58:13 2022] POST /identity/v3/projects => generated 386 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:58:14.107025 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587eecf8-5f26-47f7-800f-d3a200bf2558 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:14.118949 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587eecf8-5f26-47f7-800f-d3a200bf2558 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:14.195255 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf654ae-fe37-45da-995f-019935db0cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:14.196452 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf654ae-fe37-45da-995f-019935db0cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:14.196978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf654ae-fe37-45da-995f-019935db0cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:14.197501 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf654ae-fe37-45da-995f-019935db0cc8 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:14.198243 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf654ae-fe37-45da-995f-019935db0cc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:14.200216 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf654ae-fe37-45da-995f-019935db0cc8 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:14.311721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1023/2049] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:58:14 2022] POST /identity/v3/users => generated 294 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:58:14.315920 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc6135-8656-4e66-bfeb-26e834411359 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:14.327470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc6135-8656-4e66-bfeb-26e834411359 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:14.332590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c38db-62d8-418e-bdb1-309bdb62e19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:14.333680 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c38db-62d8-418e-bdb1-309bdb62e19f admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:14.334146 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c38db-62d8-418e-bdb1-309bdb62e19f admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:14.334504 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c38db-62d8-418e-bdb1-309bdb62e19f admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:14.335247 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c38db-62d8-418e-bdb1-309bdb62e19f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:14.337073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c38db-62d8-418e-bdb1-309bdb62e19f admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:14.348968 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1027/2050] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:14 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:58:14.353220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf654ae-fe37-45da-995f-019935db0cc8 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:14.364352 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf654ae-fe37-45da-995f-019935db0cc8 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:14.370408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfde4bc-267d-4aca-8491-f40873cdd6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:14.371364 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfde4bc-267d-4aca-8491-f40873cdd6fe admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:14.371483 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfde4bc-267d-4aca-8491-f40873cdd6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:14.371766 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfde4bc-267d-4aca-8491-f40873cdd6fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:14.372644 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfde4bc-267d-4aca-8491-f40873cdd6fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:14.374374 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfde4bc-267d-4aca-8491-f40873cdd6fe admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:14.386049 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1024/2051] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:14 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:58:14.393262 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c38db-62d8-418e-bdb1-309bdb62e19f admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:14.401737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c38db-62d8-418e-bdb1-309bdb62e19f admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:14.406577 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ff3c6-379f-40dd-8e2a-c7b142c9414f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:14.407705 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ff3c6-379f-40dd-8e2a-c7b142c9414f admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:14.408058 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ff3c6-379f-40dd-8e2a-c7b142c9414f admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:14.408445 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ff3c6-379f-40dd-8e2a-c7b142c9414f admin admin] PATH_INFO: `/v3/projects/c4c738f5e6504dba91457e467bfe7ca8/users/d39ebe5fef2c4fc89d19b7cea06ebba1/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:14.425210 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:14.429116 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ff3c6-379f-40dd-8e2a-c7b142c9414f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4c738f5e6504dba91457e467bfe7ca8, user_id=d39ebe5fef2c4fc89d19b7cea06ebba1, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:14.431786 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ff3c6-379f-40dd-8e2a-c7b142c9414f admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:14.541665 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1028/2052] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:58:14 2022] PUT /identity/v3/projects/c4c738f5e6504dba91457e467bfe7ca8/users/d39ebe5fef2c4fc89d19b7cea06ebba1/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:14.553703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e2265-ca6d-480e-9b6d-74452a5916a0 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:14.554096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e2265-ca6d-480e-9b6d-74452a5916a0 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:14.554394 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e2265-ca6d-480e-9b6d-74452a5916a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:14.586442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-001e2265-ca6d-480e-9b6d-74452a5916a0 None None] MFA Rules not processed for user `d39ebe5fef2c4fc89d19b7cea06ebba1`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:14.587802 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-001e2265-ca6d-480e-9b6d-74452a5916a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:14.658417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1025/2053] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:14.663651 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ff3c6-379f-40dd-8e2a-c7b142c9414f admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:14.731567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ff3c6-379f-40dd-8e2a-c7b142c9414f admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:14.736604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a399bfd-71c6-4c60-9cf9-cd01de8f8940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:14.737277 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a399bfd-71c6-4c60-9cf9-cd01de8f8940 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:14.737592 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a399bfd-71c6-4c60-9cf9-cd01de8f8940 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:14.737905 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a399bfd-71c6-4c60-9cf9-cd01de8f8940 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:14.738617 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a399bfd-71c6-4c60-9cf9-cd01de8f8940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:14.740628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a399bfd-71c6-4c60-9cf9-cd01de8f8940 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:14.865699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1029/2054] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:58:14 2022] POST /identity/v3/projects => generated 388 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:58:14.870357 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e2265-ca6d-480e-9b6d-74452a5916a0 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:14.883434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e2265-ca6d-480e-9b6d-74452a5916a0 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:14.952334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22988a21-d2f2-4b89-bd68-741f0c3c851b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:14.953133 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22988a21-d2f2-4b89-bd68-741f0c3c851b admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:14.953527 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22988a21-d2f2-4b89-bd68-741f0c3c851b admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:14.953810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22988a21-d2f2-4b89-bd68-741f0c3c851b admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:14.954707 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22988a21-d2f2-4b89-bd68-741f0c3c851b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:14.957092 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22988a21-d2f2-4b89-bd68-741f0c3c851b admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:14.965834 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:15.036560 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1026/2055] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:58:14 2022] POST /identity/v3/users => generated 295 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:58:15.041173 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a399bfd-71c6-4c60-9cf9-cd01de8f8940 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:15.051275 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a399bfd-71c6-4c60-9cf9-cd01de8f8940 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:15.055961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d035636-eafd-4d00-a4c9-a224d3f89ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:15.056884 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d035636-eafd-4d00-a4c9-a224d3f89ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:15.062277 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d035636-eafd-4d00-a4c9-a224d3f89ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:15.062277 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d035636-eafd-4d00-a4c9-a224d3f89ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:15.062277 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d035636-eafd-4d00-a4c9-a224d3f89ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:15.062277 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d035636-eafd-4d00-a4c9-a224d3f89ab1 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:15.070863 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1030/2056] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:15 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:58:15.075125 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22988a21-d2f2-4b89-bd68-741f0c3c851b admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:15.086444 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22988a21-d2f2-4b89-bd68-741f0c3c851b admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:15.091096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052a04b-cbf8-44f0-bbbe-eed91b6aaefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:15.091759 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052a04b-cbf8-44f0-bbbe-eed91b6aaefb admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:15.092044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052a04b-cbf8-44f0-bbbe-eed91b6aaefb admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:15.092355 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052a04b-cbf8-44f0-bbbe-eed91b6aaefb admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:15.093085 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052a04b-cbf8-44f0-bbbe-eed91b6aaefb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:15.094699 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052a04b-cbf8-44f0-bbbe-eed91b6aaefb admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:15.109300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1027/2057] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:15 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:58:15.110398 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d035636-eafd-4d00-a4c9-a224d3f89ab1 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:15.120604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d035636-eafd-4d00-a4c9-a224d3f89ab1 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:15.125203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208fca0-401c-4847-a441-7995dcead93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:15.126087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208fca0-401c-4847-a441-7995dcead93a admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:15.126372 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208fca0-401c-4847-a441-7995dcead93a admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:15.126707 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208fca0-401c-4847-a441-7995dcead93a admin admin] PATH_INFO: `/v3/projects/dd4e3c2dc3d64d6fb4b95013a46f1a16/users/e35bc94e45e74c3288832e2d9e39184c/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:15.141799 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208fca0-401c-4847-a441-7995dcead93a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd4e3c2dc3d64d6fb4b95013a46f1a16, user_id=e35bc94e45e74c3288832e2d9e39184c, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:15.144601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208fca0-401c-4847-a441-7995dcead93a admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:15.223655 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1031/2058] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:58:15 2022] PUT /identity/v3/projects/dd4e3c2dc3d64d6fb4b95013a46f1a16/users/e35bc94e45e74c3288832e2d9e39184c/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:15.235226 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed693d57-ccea-45f7-9e1c-91287b2f6bbe None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:15.235622 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed693d57-ccea-45f7-9e1c-91287b2f6bbe None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:15.236619 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed693d57-ccea-45f7-9e1c-91287b2f6bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:15.267823 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-ed693d57-ccea-45f7-9e1c-91287b2f6bbe None None] MFA Rules not processed for user `e35bc94e45e74c3288832e2d9e39184c`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:15.269145 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-ed693d57-ccea-45f7-9e1c-91287b2f6bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:15.347008 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1028/2059] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:15.355174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208fca0-401c-4847-a441-7995dcead93a admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:15.453871 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208fca0-401c-4847-a441-7995dcead93a admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:15.460003 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e8e2e-2408-4567-8978-14a07fb45900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:15.460804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e8e2e-2408-4567-8978-14a07fb45900 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:15.461160 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e8e2e-2408-4567-8978-14a07fb45900 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:15.461530 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e8e2e-2408-4567-8978-14a07fb45900 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:15.462293 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e8e2e-2408-4567-8978-14a07fb45900 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:15.464346 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e8e2e-2408-4567-8978-14a07fb45900 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:15.705082 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1032/2060] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:58:15 2022] POST /identity/v3/projects => generated 388 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:58:15.711467 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed693d57-ccea-45f7-9e1c-91287b2f6bbe None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:15.723982 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed693d57-ccea-45f7-9e1c-91287b2f6bbe None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:15.792453 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bf3df-1a7a-4a33-a9a4-c2c8997ac071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:15.793154 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bf3df-1a7a-4a33-a9a4-c2c8997ac071 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:15.793477 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bf3df-1a7a-4a33-a9a4-c2c8997ac071 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:15.793828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bf3df-1a7a-4a33-a9a4-c2c8997ac071 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:15.794760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bf3df-1a7a-4a33-a9a4-c2c8997ac071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:15.797204 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bf3df-1a7a-4a33-a9a4-c2c8997ac071 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:15.918319 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1029/2061] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:58:15 2022] POST /identity/v3/users => generated 301 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:58:15.922433 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e8e2e-2408-4567-8978-14a07fb45900 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:15.933534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e8e2e-2408-4567-8978-14a07fb45900 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:15.940015 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816618a-78f3-42eb-b969-e57a03107799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:15.940015 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816618a-78f3-42eb-b969-e57a03107799 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:15.948437 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816618a-78f3-42eb-b969-e57a03107799 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:15.948437 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816618a-78f3-42eb-b969-e57a03107799 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:15.948437 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816618a-78f3-42eb-b969-e57a03107799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:15.948437 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816618a-78f3-42eb-b969-e57a03107799 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:15.955190 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1033/2062] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:15 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:58:15.960403 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bf3df-1a7a-4a33-a9a4-c2c8997ac071 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:15.971523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bf3df-1a7a-4a33-a9a4-c2c8997ac071 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:15.977914 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b102c28-8c5a-4358-abe1-14e3baa0b12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:15.979022 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b102c28-8c5a-4358-abe1-14e3baa0b12f admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:15.979422 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b102c28-8c5a-4358-abe1-14e3baa0b12f admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:15.979796 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b102c28-8c5a-4358-abe1-14e3baa0b12f admin admin] PATH_INFO: `/v3/projects/4ea110ff31194311967e8a6877eb7476/users/1944a7992a2246bfbbd482136b2fc57b/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:15.998359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b102c28-8c5a-4358-abe1-14e3baa0b12f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ea110ff31194311967e8a6877eb7476, user_id=1944a7992a2246bfbbd482136b2fc57b, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:16.001660 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b102c28-8c5a-4358-abe1-14e3baa0b12f admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:16.117703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1030/2063] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:58:15 2022] PUT /identity/v3/projects/4ea110ff31194311967e8a6877eb7476/users/1944a7992a2246bfbbd482136b2fc57b/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:16.122356 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816618a-78f3-42eb-b969-e57a03107799 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:16.133339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816618a-78f3-42eb-b969-e57a03107799 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:16.149690 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:16.208806 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6fe11-03c6-4a67-98fc-0e4a7c3d354f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:16.209590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6fe11-03c6-4a67-98fc-0e4a7c3d354f admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:16.210171 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6fe11-03c6-4a67-98fc-0e4a7c3d354f admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:16.210461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6fe11-03c6-4a67-98fc-0e4a7c3d354f admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:16.211315 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6fe11-03c6-4a67-98fc-0e4a7c3d354f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:16.212984 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6fe11-03c6-4a67-98fc-0e4a7c3d354f admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:16.224304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1034/2064] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:16 2022] GET /identity/v3/roles => generated 1427 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:58:16.229891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b102c28-8c5a-4358-abe1-14e3baa0b12f admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:16.244328 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b102c28-8c5a-4358-abe1-14e3baa0b12f admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:16.255593 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584074a-f451-4727-a6ae-33b282898bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:16.255593 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584074a-f451-4727-a6ae-33b282898bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:16.255593 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584074a-f451-4727-a6ae-33b282898bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:16.255593 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584074a-f451-4727-a6ae-33b282898bfb admin admin] PATH_INFO: `/v3/projects/4ea110ff31194311967e8a6877eb7476/users/1944a7992a2246bfbbd482136b2fc57b/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:16.256625 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584074a-f451-4727-a6ae-33b282898bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ea110ff31194311967e8a6877eb7476, user_id=1944a7992a2246bfbbd482136b2fc57b, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:16.257497 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584074a-f451-4727-a6ae-33b282898bfb admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:16.269320 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1031/2065] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:58:16 2022] PUT /identity/v3/projects/4ea110ff31194311967e8a6877eb7476/users/1944a7992a2246bfbbd482136b2fc57b/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:16.280057 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb3854-26ca-4b9c-ada4-9f9c4345c114 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:16.280423 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb3854-26ca-4b9c-ada4-9f9c4345c114 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:16.280959 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb3854-26ca-4b9c-ada4-9f9c4345c114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:16.311507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-36cb3854-26ca-4b9c-ada4-9f9c4345c114 None None] MFA Rules not processed for user `1944a7992a2246bfbbd482136b2fc57b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:16.312995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-36cb3854-26ca-4b9c-ada4-9f9c4345c114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:16.414180 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1035/2066] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:16 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:16.421650 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584074a-f451-4727-a6ae-33b282898bfb admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:16.423735 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-0584074a-f451-4727-a6ae-33b282898bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:16.452937 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:16.502777 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584074a-f451-4727-a6ae-33b282898bfb admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:16.507390 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d198c7-0169-49d4-9450-196b1b92ceb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:16.508195 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d198c7-0169-49d4-9450-196b1b92ceb3 service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:16.508678 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d198c7-0169-49d4-9450-196b1b92ceb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:16.509355 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d198c7-0169-49d4-9450-196b1b92ceb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:16.522399 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d198c7-0169-49d4-9450-196b1b92ceb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:16.524171 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d198c7-0169-49d4-9450-196b1b92ceb3 service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:16.534639 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1032/2067] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:58:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:58:18.040763 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb3854-26ca-4b9c-ada4-9f9c4345c114 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:18.050464 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb3854-26ca-4b9c-ada4-9f9c4345c114 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:18.054509 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a14db3-b713-4182-8af7-44b7862be471 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:18.055163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a14db3-b713-4182-8af7-44b7862be471 service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:18.055456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a14db3-b713-4182-8af7-44b7862be471 service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:18.055849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a14db3-b713-4182-8af7-44b7862be471 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:18.124815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a14db3-b713-4182-8af7-44b7862be471 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:18.126472 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a14db3-b713-4182-8af7-44b7862be471 service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:18.137535 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1036/2068] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:58:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:58:18.407400 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d198c7-0169-49d4-9450-196b1b92ceb3 service cinder] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:18.409066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-29d198c7-0169-49d4-9450-196b1b92ceb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:18.491585 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d198c7-0169-49d4-9450-196b1b92ceb3 service cinder] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:18.499197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c1a33-53cb-4602-94b2-f30e32a8aa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:18.500123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c1a33-53cb-4602-94b2-f30e32a8aa2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:18.500531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c1a33-53cb-4602-94b2-f30e32a8aa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:18.500724 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c1a33-53cb-4602-94b2-f30e32a8aa2e admin admin] PATH_INFO: `/v3/users/b451e78629894deda0827a59c3544cd4` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:18.502349 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c1a33-53cb-4602-94b2-f30e32a8aa2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b451e78629894deda0827a59c3544cd4)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:18.504583 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c1a33-53cb-4602-94b2-f30e32a8aa2e admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:18.767175 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-2e8c1a33-53cb-4602-94b2-f30e32a8aa2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b451e78629894deda0827a59c3544cd4'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:18.767872 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-2e8c1a33-53cb-4602-94b2-f30e32a8aa2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b451e78629894deda0827a59c3544cd4'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:18.790186 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-2e8c1a33-53cb-4602-94b2-f30e32a8aa2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b451e78629894deda0827a59c3544cd4'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:18.797916 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-2e8c1a33-53cb-4602-94b2-f30e32a8aa2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b451e78629894deda0827a59c3544cd4'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:18.798710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-2e8c1a33-53cb-4602-94b2-f30e32a8aa2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b451e78629894deda0827a59c3544cd4'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:18.906173 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1033/2069] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:58:18 2022] DELETE /identity/v3/users/b451e78629894deda0827a59c3544cd4 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:18.911004 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8158a-7c27-4850-b251-ef72f18f7bd2 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:18.911346 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8158a-7c27-4850-b251-ef72f18f7bd2 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:18.911641 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8158a-7c27-4850-b251-ef72f18f7bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:18.932922 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-77b8158a-7c27-4850-b251-ef72f18f7bd2 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:18.934128 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-77b8158a-7c27-4850-b251-ef72f18f7bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:18.964378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:18.993884 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1037/2070] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:19.003617 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c1a33-53cb-4602-94b2-f30e32a8aa2e admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:19.005042 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-2e8c1a33-53cb-4602-94b2-f30e32a8aa2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:19.053481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:19.064999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c1a33-53cb-4602-94b2-f30e32a8aa2e admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:19.069654 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572220f-8325-48d7-8276-95d12dd64661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:19.070306 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572220f-8325-48d7-8276-95d12dd64661 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:19.070594 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572220f-8325-48d7-8276-95d12dd64661 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:19.070877 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572220f-8325-48d7-8276-95d12dd64661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:19.079712 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572220f-8325-48d7-8276-95d12dd64661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:19.081270 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572220f-8325-48d7-8276-95d12dd64661 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:19.091935 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1034/2071] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:58:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:58:19.513139 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8158a-7c27-4850-b251-ef72f18f7bd2 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:19.516060 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-77b8158a-7c27-4850-b251-ef72f18f7bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:19.529635 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8158a-7c27-4850-b251-ef72f18f7bd2 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:19.534837 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8f140-d6fc-445e-8299-c52608a9888a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:19.535707 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8f140-d6fc-445e-8299-c52608a9888a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:19.535982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8f140-d6fc-445e-8299-c52608a9888a admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:19.536305 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8f140-d6fc-445e-8299-c52608a9888a admin admin] PATH_INFO: `/v3/projects/283896b4f9da40edbc6a0e88e897f61a` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:19.538193 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8f140-d6fc-445e-8299-c52608a9888a admin admin] RBAC: Authorizing `identity:delete_project(project_id=283896b4f9da40edbc6a0e88e897f61a)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:19.540160 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8f140-d6fc-445e-8299-c52608a9888a admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:19.672808 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-60a8f140-d6fc-445e-8299-c52608a9888a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '283896b4f9da40edbc6a0e88e897f61a', 'request_id': 'req-60a8f140-d6fc-445e-8299-c52608a9888a'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:19.679221 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-60a8f140-d6fc-445e-8299-c52608a9888a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '283896b4f9da40edbc6a0e88e897f61a', 'request_id': 'req-60a8f140-d6fc-445e-8299-c52608a9888a'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:19.745489 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-60a8f140-d6fc-445e-8299-c52608a9888a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '283896b4f9da40edbc6a0e88e897f61a', 'request_id': 'req-60a8f140-d6fc-445e-8299-c52608a9888a'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:19.761560 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-60a8f140-d6fc-445e-8299-c52608a9888a admin admin] The token cache is being invalidate because project 283896b4f9da40edbc6a0e88e897f61a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:58:19.762186 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-60a8f140-d6fc-445e-8299-c52608a9888a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:19.763168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-60a8f140-d6fc-445e-8299-c52608a9888a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:19.765158 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1038/2072] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:58:19 2022] DELETE /identity/v3/projects/283896b4f9da40edbc6a0e88e897f61a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:25.685024 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572220f-8325-48d7-8276-95d12dd64661 service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:25.685024 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-3572220f-8325-48d7-8276-95d12dd64661 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:25.723830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572220f-8325-48d7-8276-95d12dd64661 service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:25.784614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4fb98-904f-4946-997f-486ca2336e1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:25.785510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4fb98-904f-4946-997f-486ca2336e1b service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:25.785863 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4fb98-904f-4946-997f-486ca2336e1b service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:25.786026 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4fb98-904f-4946-997f-486ca2336e1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:25.788587 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-6ff4fb98-904f-4946-997f-486ca2336e1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:25.861334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4fb98-904f-4946-997f-486ca2336e1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:25.863101 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4fb98-904f-4946-997f-486ca2336e1b service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:25.873704 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1035/2073] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:58:25 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:58:28.592997 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8f140-d6fc-445e-8299-c52608a9888a admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:28.594568 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-60a8f140-d6fc-445e-8299-c52608a9888a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:28.661021 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8f140-d6fc-445e-8299-c52608a9888a admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:28.666791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50583ef9-6ae2-40af-8e94-7801a4277e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:28.667672 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50583ef9-6ae2-40af-8e94-7801a4277e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:28.667962 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50583ef9-6ae2-40af-8e94-7801a4277e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:28.668293 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50583ef9-6ae2-40af-8e94-7801a4277e2d admin admin] PATH_INFO: `/v3/users/cdc27e4fad0c4846bfc2a0001f5b3608` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:28.669492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50583ef9-6ae2-40af-8e94-7801a4277e2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdc27e4fad0c4846bfc2a0001f5b3608)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:28.671425 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50583ef9-6ae2-40af-8e94-7801a4277e2d admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:28.858121 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-50583ef9-6ae2-40af-8e94-7801a4277e2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdc27e4fad0c4846bfc2a0001f5b3608'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:28.885684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:28.888934 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-50583ef9-6ae2-40af-8e94-7801a4277e2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdc27e4fad0c4846bfc2a0001f5b3608'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:28.897772 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-50583ef9-6ae2-40af-8e94-7801a4277e2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdc27e4fad0c4846bfc2a0001f5b3608'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:28.898673 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-50583ef9-6ae2-40af-8e94-7801a4277e2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdc27e4fad0c4846bfc2a0001f5b3608'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:28.991765 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-50583ef9-6ae2-40af-8e94-7801a4277e2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdc27e4fad0c4846bfc2a0001f5b3608'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:28.999045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1039/2074] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:58:28 2022] DELETE /identity/v3/users/cdc27e4fad0c4846bfc2a0001f5b3608 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:29.003260 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49c15c-7429-4894-8a9c-8379a6924c2e None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:29.003747 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49c15c-7429-4894-8a9c-8379a6924c2e None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:29.004140 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49c15c-7429-4894-8a9c-8379a6924c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:29.030283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-ee49c15c-7429-4894-8a9c-8379a6924c2e None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:29.030283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-ee49c15c-7429-4894-8a9c-8379a6924c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:29.104753 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:29.119529 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1036/2075] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:29.136627 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50583ef9-6ae2-40af-8e94-7801a4277e2d admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:29.138575 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-50583ef9-6ae2-40af-8e94-7801a4277e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:29.202692 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50583ef9-6ae2-40af-8e94-7801a4277e2d admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:29.206361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e733c-ab79-436f-b17f-ad46b9e16c83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:29.207022 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e733c-ab79-436f-b17f-ad46b9e16c83 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:29.207531 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e733c-ab79-436f-b17f-ad46b9e16c83 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:29.207673 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e733c-ab79-436f-b17f-ad46b9e16c83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:29.218438 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e733c-ab79-436f-b17f-ad46b9e16c83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:29.219869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e733c-ab79-436f-b17f-ad46b9e16c83 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:29.233167 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1040/2076] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:58:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:58:29.940431 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49c15c-7429-4894-8a9c-8379a6924c2e None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:29.943894 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-ee49c15c-7429-4894-8a9c-8379a6924c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:29.957570 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49c15c-7429-4894-8a9c-8379a6924c2e None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:29.981807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e7145-0016-41c3-b19c-d95f5098f100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:29.984312 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e7145-0016-41c3-b19c-d95f5098f100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:29.984986 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e7145-0016-41c3-b19c-d95f5098f100 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:29.986026 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e7145-0016-41c3-b19c-d95f5098f100 admin admin] PATH_INFO: `/v3/projects/a8f1e43b65db496f8a3c17dd058e2ec7` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:29.987870 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e7145-0016-41c3-b19c-d95f5098f100 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8f1e43b65db496f8a3c17dd058e2ec7)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:29.991466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e7145-0016-41c3-b19c-d95f5098f100 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:30.155057 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-432e7145-0016-41c3-b19c-d95f5098f100 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8f1e43b65db496f8a3c17dd058e2ec7', 'request_id': 'req-432e7145-0016-41c3-b19c-d95f5098f100'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:30.162915 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-432e7145-0016-41c3-b19c-d95f5098f100 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8f1e43b65db496f8a3c17dd058e2ec7', 'request_id': 'req-432e7145-0016-41c3-b19c-d95f5098f100'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:30.182097 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-432e7145-0016-41c3-b19c-d95f5098f100 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8f1e43b65db496f8a3c17dd058e2ec7', 'request_id': 'req-432e7145-0016-41c3-b19c-d95f5098f100'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:30.321653 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-432e7145-0016-41c3-b19c-d95f5098f100 admin admin] The token cache is being invalidate because project a8f1e43b65db496f8a3c17dd058e2ec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:58:30.322570 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-432e7145-0016-41c3-b19c-d95f5098f100 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:30.323440 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-432e7145-0016-41c3-b19c-d95f5098f100 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:30.325319 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1037/2077] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:58:29 2022] DELETE /identity/v3/projects/a8f1e43b65db496f8a3c17dd058e2ec7 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:30.330333 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38aa005-775d-4256-93b0-00ad58803fc5 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:30.331210 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38aa005-775d-4256-93b0-00ad58803fc5 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:30.331491 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38aa005-775d-4256-93b0-00ad58803fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:30.352291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-a38aa005-775d-4256-93b0-00ad58803fc5 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:30.353615 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-a38aa005-775d-4256-93b0-00ad58803fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:30.439370 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1041/2078] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:30.450235 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b239c-a89e-4f77-8ccc-fad01e4f43b1 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:30.459029 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b239c-a89e-4f77-8ccc-fad01e4f43b1 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:30.459389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b239c-a89e-4f77-8ccc-fad01e4f43b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:30.481586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-094b239c-a89e-4f77-8ccc-fad01e4f43b1 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:30.482826 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-094b239c-a89e-4f77-8ccc-fad01e4f43b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:30.501426 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1038/2079] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:30.501657 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38aa005-775d-4256-93b0-00ad58803fc5 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:30.509600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38aa005-775d-4256-93b0-00ad58803fc5 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:30.519179 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71f604-fd2f-4444-9037-41ef7ade99ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:30.519870 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71f604-fd2f-4444-9037-41ef7ade99ec admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:30.520270 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71f604-fd2f-4444-9037-41ef7ade99ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:30.520561 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71f604-fd2f-4444-9037-41ef7ade99ec admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:30.526234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71f604-fd2f-4444-9037-41ef7ade99ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:58:30.526234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71f604-fd2f-4444-9037-41ef7ade99ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:30.526234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71f604-fd2f-4444-9037-41ef7ade99ec admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:30.539680 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1042/2080] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:58:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:58:30.543679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b239c-a89e-4f77-8ccc-fad01e4f43b1 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:30.554529 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b239c-a89e-4f77-8ccc-fad01e4f43b1 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:30.559429 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b62af-4b9a-48a0-a0c8-b34a1dedf274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:30.561718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b62af-4b9a-48a0-a0c8-b34a1dedf274 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:30.561718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b62af-4b9a-48a0-a0c8-b34a1dedf274 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:30.561718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b62af-4b9a-48a0-a0c8-b34a1dedf274 admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:30.561718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b62af-4b9a-48a0-a0c8-b34a1dedf274 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:30.563368 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b62af-4b9a-48a0-a0c8-b34a1dedf274 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:30.665712 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71f604-fd2f-4444-9037-41ef7ade99ec admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:30.667512 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-ad71f604-fd2f-4444-9037-41ef7ade99ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:30.681339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71f604-fd2f-4444-9037-41ef7ade99ec admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:30.686010 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27bf62-1d4a-4a6b-959c-837bc6c1c7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:30.687029 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27bf62-1d4a-4a6b-959c-837bc6c1c7e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:30.687342 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27bf62-1d4a-4a6b-959c-837bc6c1c7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:30.687621 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27bf62-1d4a-4a6b-959c-837bc6c1c7e3 admin admin] PATH_INFO: `/v3/users/d39ebe5fef2c4fc89d19b7cea06ebba1` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:30.688885 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27bf62-1d4a-4a6b-959c-837bc6c1c7e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d39ebe5fef2c4fc89d19b7cea06ebba1)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:30.691086 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27bf62-1d4a-4a6b-959c-837bc6c1c7e3 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:30.698548 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1039/2081] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:58:30 2022] POST /identity/v3/projects => generated 386 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:58:30.702510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b62af-4b9a-48a0-a0c8-b34a1dedf274 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:30.777235 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b62af-4b9a-48a0-a0c8-b34a1dedf274 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:30.782221 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f9fe3-7f9f-455a-9aaa-bbb22079fc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:30.783042 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f9fe3-7f9f-455a-9aaa-bbb22079fc2c admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:30.783433 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f9fe3-7f9f-455a-9aaa-bbb22079fc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:30.783992 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f9fe3-7f9f-455a-9aaa-bbb22079fc2c admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:30.790025 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f9fe3-7f9f-455a-9aaa-bbb22079fc2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:30.790025 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f9fe3-7f9f-455a-9aaa-bbb22079fc2c admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:30.911284 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1040/2082] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:58:30 2022] POST /identity/v3/users => generated 294 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:58:30.918951 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f9fe3-7f9f-455a-9aaa-bbb22079fc2c admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:30.933047 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f9fe3-7f9f-455a-9aaa-bbb22079fc2c admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:30.939335 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4baea-5a11-49a7-986f-308e3f77b78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:30.940159 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4baea-5a11-49a7-986f-308e3f77b78b admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:30.940553 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4baea-5a11-49a7-986f-308e3f77b78b admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:30.940932 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4baea-5a11-49a7-986f-308e3f77b78b admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:30.941773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4baea-5a11-49a7-986f-308e3f77b78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:30.943671 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4baea-5a11-49a7-986f-308e3f77b78b admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:30.956995 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1041/2083] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:30 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:58:30.963271 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4baea-5a11-49a7-986f-308e3f77b78b admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:30.974116 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-cb27bf62-1d4a-4a6b-959c-837bc6c1c7e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd39ebe5fef2c4fc89d19b7cea06ebba1'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:30.984395 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4baea-5a11-49a7-986f-308e3f77b78b admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:30.989855 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:30.992307 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42482e56-99e5-4eb7-a4b7-e35992cd43fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:30.992998 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42482e56-99e5-4eb7-a4b7-e35992cd43fb admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:30.993388 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42482e56-99e5-4eb7-a4b7-e35992cd43fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:30.993766 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42482e56-99e5-4eb7-a4b7-e35992cd43fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:30.994124 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-cb27bf62-1d4a-4a6b-959c-837bc6c1c7e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd39ebe5fef2c4fc89d19b7cea06ebba1'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:30.995469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42482e56-99e5-4eb7-a4b7-e35992cd43fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:30.998828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42482e56-99e5-4eb7-a4b7-e35992cd43fb admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:31.005005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-cb27bf62-1d4a-4a6b-959c-837bc6c1c7e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd39ebe5fef2c4fc89d19b7cea06ebba1'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:31.007044 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-cb27bf62-1d4a-4a6b-959c-837bc6c1c7e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd39ebe5fef2c4fc89d19b7cea06ebba1'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:31.015633 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1042/2084] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:30 2022] GET /identity/v3/roles => generated 1427 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:58:31.016826 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42482e56-99e5-4eb7-a4b7-e35992cd43fb admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:31.018730 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-42482e56-99e5-4eb7-a4b7-e35992cd43fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:31.033218 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42482e56-99e5-4eb7-a4b7-e35992cd43fb admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:31.040526 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9ba2d-dd5d-4b9f-b09f-dfd27621974c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:31.041577 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9ba2d-dd5d-4b9f-b09f-dfd27621974c admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:31.041929 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9ba2d-dd5d-4b9f-b09f-dfd27621974c admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:31.042278 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9ba2d-dd5d-4b9f-b09f-dfd27621974c admin admin] PATH_INFO: `/v3/projects/0b6984aaf8784b25a41e5bb144fe19e5/users/b2c85857ad78416dab8f65e7ccd8d8e3/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:31.059617 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9ba2d-dd5d-4b9f-b09f-dfd27621974c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b6984aaf8784b25a41e5bb144fe19e5, user_id=b2c85857ad78416dab8f65e7ccd8d8e3, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:31.062431 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9ba2d-dd5d-4b9f-b09f-dfd27621974c admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:31.064915 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:31.069873 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-cb27bf62-1d4a-4a6b-959c-837bc6c1c7e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd39ebe5fef2c4fc89d19b7cea06ebba1'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:31.076991 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1043/2085] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:58:30 2022] DELETE /identity/v3/users/d39ebe5fef2c4fc89d19b7cea06ebba1 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:58:31.081495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953b344-adcc-46f6-bdb6-c6944aa3f559 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:31.081791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953b344-adcc-46f6-bdb6-c6944aa3f559 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:31.082075 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953b344-adcc-46f6-bdb6-c6944aa3f559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:31.101435 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-1953b344-adcc-46f6-bdb6-c6944aa3f559 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:31.102690 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-1953b344-adcc-46f6-bdb6-c6944aa3f559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:31.170729 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1043/2086] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:58:31 2022] PUT /identity/v3/projects/0b6984aaf8784b25a41e5bb144fe19e5/users/b2c85857ad78416dab8f65e7ccd8d8e3/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:31.181939 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd70f1b-3138-4ce5-8be5-75a21145b0e9 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:31.182237 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd70f1b-3138-4ce5-8be5-75a21145b0e9 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:31.182522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd70f1b-3138-4ce5-8be5-75a21145b0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:31.183562 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1044/2087] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:58:31.199305 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953b344-adcc-46f6-bdb6-c6944aa3f559 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:31.207057 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-1953b344-adcc-46f6-bdb6-c6944aa3f559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:31.223067 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-ccd70f1b-3138-4ce5-8be5-75a21145b0e9 None None] MFA Rules not processed for user `b2c85857ad78416dab8f65e7ccd8d8e3`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:31.224927 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-ccd70f1b-3138-4ce5-8be5-75a21145b0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:31.316068 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953b344-adcc-46f6-bdb6-c6944aa3f559 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:31.350613 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1044/2088] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:31.351674 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd70f1b-3138-4ce5-8be5-75a21145b0e9 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:31.357241 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-ccd70f1b-3138-4ce5-8be5-75a21145b0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:31.368607 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743b4bf-25aa-4884-9ced-238ca15348d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:31.369276 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743b4bf-25aa-4884-9ced-238ca15348d2 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:31.369563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743b4bf-25aa-4884-9ced-238ca15348d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:31.369846 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743b4bf-25aa-4884-9ced-238ca15348d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:31.468093 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743b4bf-25aa-4884-9ced-238ca15348d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:31.469921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743b4bf-25aa-4884-9ced-238ca15348d2 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:31.486552 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd70f1b-3138-4ce5-8be5-75a21145b0e9 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:31.492321 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1045/2089] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:58:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:58:31.497200 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93caf89-d784-4532-adfb-fb35f72609b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:31.497889 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93caf89-d784-4532-adfb-fb35f72609b2 service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:31.498501 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93caf89-d784-4532-adfb-fb35f72609b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:31.498798 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93caf89-d784-4532-adfb-fb35f72609b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:31.513124 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93caf89-d784-4532-adfb-fb35f72609b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:31.514499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93caf89-d784-4532-adfb-fb35f72609b2 service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:31.539468 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1045/2090] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:58:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:58:31.833658 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:31.999677 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743b4bf-25aa-4884-9ced-238ca15348d2 service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:32.001097 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-3743b4bf-25aa-4884-9ced-238ca15348d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:32.015482 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743b4bf-25aa-4884-9ced-238ca15348d2 service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:32.025825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2006865-2d70-403c-90e1-7d4ca845d178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:32.026723 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2006865-2d70-403c-90e1-7d4ca845d178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:32.030808 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2006865-2d70-403c-90e1-7d4ca845d178 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:32.030808 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2006865-2d70-403c-90e1-7d4ca845d178 admin admin] PATH_INFO: `/v3/projects/c4c738f5e6504dba91457e467bfe7ca8` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:32.030808 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2006865-2d70-403c-90e1-7d4ca845d178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4c738f5e6504dba91457e467bfe7ca8)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:32.032349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2006865-2d70-403c-90e1-7d4ca845d178 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:32.153230 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-d2006865-2d70-403c-90e1-7d4ca845d178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4c738f5e6504dba91457e467bfe7ca8', 'request_id': 'req-d2006865-2d70-403c-90e1-7d4ca845d178'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:32.159820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-d2006865-2d70-403c-90e1-7d4ca845d178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4c738f5e6504dba91457e467bfe7ca8', 'request_id': 'req-d2006865-2d70-403c-90e1-7d4ca845d178'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:32.282843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-d2006865-2d70-403c-90e1-7d4ca845d178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4c738f5e6504dba91457e467bfe7ca8', 'request_id': 'req-d2006865-2d70-403c-90e1-7d4ca845d178'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:32.303629 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-d2006865-2d70-403c-90e1-7d4ca845d178 admin admin] The token cache is being invalidate because project c4c738f5e6504dba91457e467bfe7ca8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:58:32.304010 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-d2006865-2d70-403c-90e1-7d4ca845d178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:32.304781 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-d2006865-2d70-403c-90e1-7d4ca845d178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:32.306614 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1046/2091] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:58:31 2022] DELETE /identity/v3/projects/c4c738f5e6504dba91457e467bfe7ca8 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:32.310654 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93caf89-d784-4532-adfb-fb35f72609b2 service cinder] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:32.340293 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93caf89-d784-4532-adfb-fb35f72609b2 service cinder] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:32.423915 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a56e6e-3074-4ee6-9d8c-a60ff0637f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:32.424933 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a56e6e-3074-4ee6-9d8c-a60ff0637f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:32.425207 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a56e6e-3074-4ee6-9d8c-a60ff0637f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:32.425490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a56e6e-3074-4ee6-9d8c-a60ff0637f37 admin admin] PATH_INFO: `/v3/users/e35bc94e45e74c3288832e2d9e39184c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:32.426685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a56e6e-3074-4ee6-9d8c-a60ff0637f37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e35bc94e45e74c3288832e2d9e39184c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:32.428907 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a56e6e-3074-4ee6-9d8c-a60ff0637f37 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:32.631164 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:INSERT=1,keystone:SELECT=94,keystone:DELETE=5 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:32.766713 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-00a56e6e-3074-4ee6-9d8c-a60ff0637f37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e35bc94e45e74c3288832e2d9e39184c'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:32.767501 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-00a56e6e-3074-4ee6-9d8c-a60ff0637f37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e35bc94e45e74c3288832e2d9e39184c'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:32.782709 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-00a56e6e-3074-4ee6-9d8c-a60ff0637f37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e35bc94e45e74c3288832e2d9e39184c'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:32.794709 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-00a56e6e-3074-4ee6-9d8c-a60ff0637f37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e35bc94e45e74c3288832e2d9e39184c'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:32.795358 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-00a56e6e-3074-4ee6-9d8c-a60ff0637f37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e35bc94e45e74c3288832e2d9e39184c'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:32.934233 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1046/2092] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:58:32 2022] DELETE /identity/v3/users/e35bc94e45e74c3288832e2d9e39184c => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:33.609712 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2006865-2d70-403c-90e1-7d4ca845d178 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:33.611946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-d2006865-2d70-403c-90e1-7d4ca845d178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:33.634811 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2006865-2d70-403c-90e1-7d4ca845d178 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:33.699240 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64774f-5e2b-4fb4-bd82-fd030cf5c4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:33.700137 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64774f-5e2b-4fb4-bd82-fd030cf5c4a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:33.700431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64774f-5e2b-4fb4-bd82-fd030cf5c4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:33.700709 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64774f-5e2b-4fb4-bd82-fd030cf5c4a8 admin admin] PATH_INFO: `/v3/projects/dd4e3c2dc3d64d6fb4b95013a46f1a16` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:33.701903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64774f-5e2b-4fb4-bd82-fd030cf5c4a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd4e3c2dc3d64d6fb4b95013a46f1a16)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:33.703799 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64774f-5e2b-4fb4-bd82-fd030cf5c4a8 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:33.745839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a56e6e-3074-4ee6-9d8c-a60ff0637f37 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:33.747427 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-00a56e6e-3074-4ee6-9d8c-a60ff0637f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:33.760717 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a56e6e-3074-4ee6-9d8c-a60ff0637f37 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:33.766043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6dcd4-732f-4e43-9c27-aa62deb8c118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:33.766924 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6dcd4-732f-4e43-9c27-aa62deb8c118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:33.767213 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6dcd4-732f-4e43-9c27-aa62deb8c118 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:33.767496 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6dcd4-732f-4e43-9c27-aa62deb8c118 admin admin] PATH_INFO: `/v3/users/9d152595f433420f9cd0b7d45a4cb6da` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:33.768781 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6dcd4-732f-4e43-9c27-aa62deb8c118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d152595f433420f9cd0b7d45a4cb6da)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:33.770760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6dcd4-732f-4e43-9c27-aa62deb8c118 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:33.833117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-5d64774f-5e2b-4fb4-bd82-fd030cf5c4a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd4e3c2dc3d64d6fb4b95013a46f1a16', 'request_id': 'req-5d64774f-5e2b-4fb4-bd82-fd030cf5c4a8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:33.840623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-5d64774f-5e2b-4fb4-bd82-fd030cf5c4a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd4e3c2dc3d64d6fb4b95013a46f1a16', 'request_id': 'req-5d64774f-5e2b-4fb4-bd82-fd030cf5c4a8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:33.986139 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-5d64774f-5e2b-4fb4-bd82-fd030cf5c4a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd4e3c2dc3d64d6fb4b95013a46f1a16', 'request_id': 'req-5d64774f-5e2b-4fb4-bd82-fd030cf5c4a8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:33.996608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:34.000869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-5d64774f-5e2b-4fb4-bd82-fd030cf5c4a8 admin admin] The token cache is being invalidate because project dd4e3c2dc3d64d6fb4b95013a46f1a16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:58:34.001134 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-5d64774f-5e2b-4fb4-bd82-fd030cf5c4a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:34.001792 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-5d64774f-5e2b-4fb4-bd82-fd030cf5c4a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:34.003594 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1047/2093] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:58:33 2022] DELETE /identity/v3/projects/dd4e3c2dc3d64d6fb4b95013a46f1a16 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:34.007756 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64774f-5e2b-4fb4-bd82-fd030cf5c4a8 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:34.009362 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-5d64774f-5e2b-4fb4-bd82-fd030cf5c4a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:34.032553 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-43f6dcd4-732f-4e43-9c27-aa62deb8c118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d152595f433420f9cd0b7d45a4cb6da'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:34.033296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-43f6dcd4-732f-4e43-9c27-aa62deb8c118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d152595f433420f9cd0b7d45a4cb6da'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:34.046305 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-43f6dcd4-732f-4e43-9c27-aa62deb8c118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d152595f433420f9cd0b7d45a4cb6da'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:34.053508 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-43f6dcd4-732f-4e43-9c27-aa62deb8c118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d152595f433420f9cd0b7d45a4cb6da'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:34.054227 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-43f6dcd4-732f-4e43-9c27-aa62deb8c118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d152595f433420f9cd0b7d45a4cb6da'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:34.080687 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64774f-5e2b-4fb4-bd82-fd030cf5c4a8 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:34.086710 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c20669-4d68-4b32-b8af-e47a35847299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:34.087237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c20669-4d68-4b32-b8af-e47a35847299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:34.087523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c20669-4d68-4b32-b8af-e47a35847299 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:34.087805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c20669-4d68-4b32-b8af-e47a35847299 admin admin] PATH_INFO: `/v3/users/1944a7992a2246bfbbd482136b2fc57b` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:34.089197 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c20669-4d68-4b32-b8af-e47a35847299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1944a7992a2246bfbbd482136b2fc57b)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:34.091325 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c20669-4d68-4b32-b8af-e47a35847299 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:34.135420 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1047/2094] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:58:33 2022] DELETE /identity/v3/users/9d152595f433420f9cd0b7d45a4cb6da => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:58:34.260855 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-b1c20669-4d68-4b32-b8af-e47a35847299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1944a7992a2246bfbbd482136b2fc57b'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:34.273946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-b1c20669-4d68-4b32-b8af-e47a35847299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1944a7992a2246bfbbd482136b2fc57b'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:34.283336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-b1c20669-4d68-4b32-b8af-e47a35847299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1944a7992a2246bfbbd482136b2fc57b'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:34.284192 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-b1c20669-4d68-4b32-b8af-e47a35847299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1944a7992a2246bfbbd482136b2fc57b'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:34.380582 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ebf198-6185-42ea-8c5d-f03d7242ef08 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:34.381476 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ebf198-6185-42ea-8c5d-f03d7242ef08 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:34.381997 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ebf198-6185-42ea-8c5d-f03d7242ef08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:34.384047 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-b1c20669-4d68-4b32-b8af-e47a35847299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1944a7992a2246bfbbd482136b2fc57b'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:34.391418 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1048/2095] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:58:34 2022] DELETE /identity/v3/users/1944a7992a2246bfbbd482136b2fc57b => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:58:34.396263 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c20669-4d68-4b32-b8af-e47a35847299 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:34.397446 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b1c20669-4d68-4b32-b8af-e47a35847299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:34.402537 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-36ebf198-6185-42ea-8c5d-f03d7242ef08 None None] MFA Rules not processed for user `6a713d55889246049668bdb4e221c998`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:34.403747 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-36ebf198-6185-42ea-8c5d-f03d7242ef08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:34.481111 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c20669-4d68-4b32-b8af-e47a35847299 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:34.487806 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b310643-e722-4f88-b8f0-a9f087b68fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:34.488743 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b310643-e722-4f88-b8f0-a9f087b68fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:34.489029 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b310643-e722-4f88-b8f0-a9f087b68fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:34.489338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b310643-e722-4f88-b8f0-a9f087b68fc8 admin admin] PATH_INFO: `/v3/projects/337009c5341c4de4a64823371566766c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:34.491585 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b310643-e722-4f88-b8f0-a9f087b68fc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=337009c5341c4de4a64823371566766c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:34.493320 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1048/2096] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:58:34.500548 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b310643-e722-4f88-b8f0-a9f087b68fc8 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:34.655134 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:34.703550 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-3b310643-e722-4f88-b8f0-a9f087b68fc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '337009c5341c4de4a64823371566766c', 'request_id': 'req-3b310643-e722-4f88-b8f0-a9f087b68fc8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:34.711091 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-3b310643-e722-4f88-b8f0-a9f087b68fc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '337009c5341c4de4a64823371566766c', 'request_id': 'req-3b310643-e722-4f88-b8f0-a9f087b68fc8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:34.808710 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-3b310643-e722-4f88-b8f0-a9f087b68fc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '337009c5341c4de4a64823371566766c', 'request_id': 'req-3b310643-e722-4f88-b8f0-a9f087b68fc8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:34.822545 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-3b310643-e722-4f88-b8f0-a9f087b68fc8 admin admin] The token cache is being invalidate because project 337009c5341c4de4a64823371566766c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:58:34.822917 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-3b310643-e722-4f88-b8f0-a9f087b68fc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:34.823701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-3b310643-e722-4f88-b8f0-a9f087b68fc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:34.828571 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1049/2097] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:58:34 2022] DELETE /identity/v3/projects/337009c5341c4de4a64823371566766c => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:58:34.830284 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509d8c4-3172-4c84-a1cf-65b0bd3005e3 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:34.830810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509d8c4-3172-4c84-a1cf-65b0bd3005e3 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:34.830898 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509d8c4-3172-4c84-a1cf-65b0bd3005e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:34.872245 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-e509d8c4-3172-4c84-a1cf-65b0bd3005e3 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:34.872245 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-e509d8c4-3172-4c84-a1cf-65b0bd3005e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:34.890048 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:34.946830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1049/2098] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:34.954946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e5adc-c5f0-4327-8e42-61b758984ccc None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:34.955248 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e5adc-c5f0-4327-8e42-61b758984ccc None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:34.955552 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e5adc-c5f0-4327-8e42-61b758984ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:34.975482 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-362e5adc-c5f0-4327-8e42-61b758984ccc None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:34.976717 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-362e5adc-c5f0-4327-8e42-61b758984ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:34.984950 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1050/2099] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:34.989611 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509d8c4-3172-4c84-a1cf-65b0bd3005e3 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:34.999604 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509d8c4-3172-4c84-a1cf-65b0bd3005e3 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:35.004547 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb78eb9-3929-4b7b-af3c-416f5cd2fcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:35.005351 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb78eb9-3929-4b7b-af3c-416f5cd2fcd4 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:35.005632 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb78eb9-3929-4b7b-af3c-416f5cd2fcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:35.009328 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb78eb9-3929-4b7b-af3c-416f5cd2fcd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:35.009328 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb78eb9-3929-4b7b-af3c-416f5cd2fcd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:58:35.009328 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb78eb9-3929-4b7b-af3c-416f5cd2fcd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:35.009844 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb78eb9-3929-4b7b-af3c-416f5cd2fcd4 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:35.022811 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1050/2100] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:58:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:58:35.027396 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e5adc-c5f0-4327-8e42-61b758984ccc None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:35.038035 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e5adc-c5f0-4327-8e42-61b758984ccc None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:35.043903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25cf01-8259-4ada-b864-e43d83ec376b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:35.043903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25cf01-8259-4ada-b864-e43d83ec376b admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:35.044159 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25cf01-8259-4ada-b864-e43d83ec376b admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:35.044348 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25cf01-8259-4ada-b864-e43d83ec376b admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:35.045210 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25cf01-8259-4ada-b864-e43d83ec376b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:35.047248 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25cf01-8259-4ada-b864-e43d83ec376b admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:35.080206 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb78eb9-3929-4b7b-af3c-416f5cd2fcd4 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:35.084849 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-9bb78eb9-3929-4b7b-af3c-416f5cd2fcd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:35.109911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb78eb9-3929-4b7b-af3c-416f5cd2fcd4 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:35.116201 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1e189-7e02-4a5f-b98c-eb4238f64762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:35.117000 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1e189-7e02-4a5f-b98c-eb4238f64762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:35.117293 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1e189-7e02-4a5f-b98c-eb4238f64762 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:35.117576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1e189-7e02-4a5f-b98c-eb4238f64762 admin admin] PATH_INFO: `/v3/projects/4ea110ff31194311967e8a6877eb7476` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:35.118791 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1e189-7e02-4a5f-b98c-eb4238f64762 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ea110ff31194311967e8a6877eb7476)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:35.120872 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1e189-7e02-4a5f-b98c-eb4238f64762 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:35.194125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1051/2101] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:58:35 2022] POST /identity/v3/projects => generated 380 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:58:35.199529 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25cf01-8259-4ada-b864-e43d83ec376b admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:35.267380 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25cf01-8259-4ada-b864-e43d83ec376b admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:35.273009 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d992b-ae40-4a19-87c3-7c0a2e48f218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:35.273687 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d992b-ae40-4a19-87c3-7c0a2e48f218 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:35.273973 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d992b-ae40-4a19-87c3-7c0a2e48f218 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:35.274250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d992b-ae40-4a19-87c3-7c0a2e48f218 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:35.274944 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d992b-ae40-4a19-87c3-7c0a2e48f218 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:35.277059 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d992b-ae40-4a19-87c3-7c0a2e48f218 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:35.373883 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5fd1e189-7e02-4a5f-b98c-eb4238f64762 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ea110ff31194311967e8a6877eb7476', 'request_id': 'req-5fd1e189-7e02-4a5f-b98c-eb4238f64762'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:35.380466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5fd1e189-7e02-4a5f-b98c-eb4238f64762 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ea110ff31194311967e8a6877eb7476', 'request_id': 'req-5fd1e189-7e02-4a5f-b98c-eb4238f64762'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:35.386133 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5fd1e189-7e02-4a5f-b98c-eb4238f64762 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ea110ff31194311967e8a6877eb7476', 'request_id': 'req-5fd1e189-7e02-4a5f-b98c-eb4238f64762'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:35.523829 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1052/2102] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:58:35 2022] POST /identity/v3/users => generated 291 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:58:35.528064 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d992b-ae40-4a19-87c3-7c0a2e48f218 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:35.537987 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d992b-ae40-4a19-87c3-7c0a2e48f218 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:35.585816 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5fd1e189-7e02-4a5f-b98c-eb4238f64762 admin admin] The token cache is being invalidate because project 4ea110ff31194311967e8a6877eb7476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:58:35.586591 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5fd1e189-7e02-4a5f-b98c-eb4238f64762 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:35.587353 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5fd1e189-7e02-4a5f-b98c-eb4238f64762 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:35.589313 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1051/2103] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:58:35 2022] DELETE /identity/v3/projects/4ea110ff31194311967e8a6877eb7476 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:35.595016 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c5e38-6b36-4513-ad6b-fe377a7f4bad None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:35.595485 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c5e38-6b36-4513-ad6b-fe377a7f4bad None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:35.602084 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c5e38-6b36-4513-ad6b-fe377a7f4bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:35.602221 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f668fc-71bd-436f-8731-2c221c9bd112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:35.602221 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f668fc-71bd-436f-8731-2c221c9bd112 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:35.602221 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f668fc-71bd-436f-8731-2c221c9bd112 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:35.602221 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f668fc-71bd-436f-8731-2c221c9bd112 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:35.602584 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f668fc-71bd-436f-8731-2c221c9bd112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:35.602584 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f668fc-71bd-436f-8731-2c221c9bd112 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:35.615469 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1053/2104] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:35 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:58:35.618804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f668fc-71bd-436f-8731-2c221c9bd112 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:35.630137 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-1c6c5e38-6b36-4513-ad6b-fe377a7f4bad None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:35.631539 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-1c6c5e38-6b36-4513-ad6b-fe377a7f4bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:35.636006 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-39f668fc-71bd-436f-8731-2c221c9bd112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:35.658513 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1052/2105] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:58:35.659930 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bedca6-b91e-41b6-afd9-b0795b5a93a3 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:35.660321 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bedca6-b91e-41b6-afd9-b0795b5a93a3 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:35.660683 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bedca6-b91e-41b6-afd9-b0795b5a93a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:35.663276 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f668fc-71bd-436f-8731-2c221c9bd112 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:35.672864 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb32b64-5f74-4050-aeec-d95d0b0b036b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:35.677674 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb32b64-5f74-4050-aeec-d95d0b0b036b admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:35.677979 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb32b64-5f74-4050-aeec-d95d0b0b036b admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:35.678272 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb32b64-5f74-4050-aeec-d95d0b0b036b admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:35.679615 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb32b64-5f74-4050-aeec-d95d0b0b036b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:35.681575 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb32b64-5f74-4050-aeec-d95d0b0b036b admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:35.691540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:35.700047 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-d1bedca6-b91e-41b6-afd9-b0795b5a93a3 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:35.701343 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-d1bedca6-b91e-41b6-afd9-b0795b5a93a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:35.717034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1054/2106] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:35 2022] GET /identity/v3/roles => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:58:35.718393 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb32b64-5f74-4050-aeec-d95d0b0b036b admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:35.725302 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1053/2107] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:35.731220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bedca6-b91e-41b6-afd9-b0795b5a93a3 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:35.739762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bedca6-b91e-41b6-afd9-b0795b5a93a3 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:35.743019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb32b64-5f74-4050-aeec-d95d0b0b036b admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:35.753402 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247943f-8bf9-4126-9b55-737095c9bb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:35.755035 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247943f-8bf9-4126-9b55-737095c9bb18 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:35.755554 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247943f-8bf9-4126-9b55-737095c9bb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:35.756192 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247943f-8bf9-4126-9b55-737095c9bb18 admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:35.757199 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e633b2-2147-4314-b679-ef46278d812e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:35.757548 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247943f-8bf9-4126-9b55-737095c9bb18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:58:35.758130 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e633b2-2147-4314-b679-ef46278d812e admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:35.758413 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e633b2-2147-4314-b679-ef46278d812e admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:35.758735 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e633b2-2147-4314-b679-ef46278d812e admin admin] PATH_INFO: `/v3/projects/8f7c2acd1c5348c8b1ce4460a2c07362/users/46dda6a1c289410992661c589e537574/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:35.758907 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247943f-8bf9-4126-9b55-737095c9bb18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:35.763505 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247943f-8bf9-4126-9b55-737095c9bb18 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:35.785834 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1054/2108] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:58:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:58:35.792965 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247943f-8bf9-4126-9b55-737095c9bb18 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:35.796252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e633b2-2147-4314-b679-ef46278d812e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f7c2acd1c5348c8b1ce4460a2c07362, user_id=46dda6a1c289410992661c589e537574, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:35.799917 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e633b2-2147-4314-b679-ef46278d812e admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:35.830697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247943f-8bf9-4126-9b55-737095c9bb18 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:35.839853 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a822f-d3d9-40a5-8084-d6583eec099e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:35.841138 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a822f-d3d9-40a5-8084-d6583eec099e admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:35.841632 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a822f-d3d9-40a5-8084-d6583eec099e admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:35.842125 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a822f-d3d9-40a5-8084-d6583eec099e admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:35.843577 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a822f-d3d9-40a5-8084-d6583eec099e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:35.846917 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a822f-d3d9-40a5-8084-d6583eec099e admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:35.884139 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1055/2109] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:58:35 2022] PUT /identity/v3/projects/8f7c2acd1c5348c8b1ce4460a2c07362/users/46dda6a1c289410992661c589e537574/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:35.899030 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92236aac-c9e5-4ffd-9942-7177cc2400f2 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:35.899385 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92236aac-c9e5-4ffd-9942-7177cc2400f2 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:35.899766 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92236aac-c9e5-4ffd-9942-7177cc2400f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:35.928874 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-92236aac-c9e5-4ffd-9942-7177cc2400f2 None None] MFA Rules not processed for user `46dda6a1c289410992661c589e537574`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:35.930284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-92236aac-c9e5-4ffd-9942-7177cc2400f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:35.998899 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1056/2110] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:36.003403 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92236aac-c9e5-4ffd-9942-7177cc2400f2 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:36.024284 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1055/2111] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:58:35 2022] POST /identity/v3/projects => generated 384 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:58:36.028479 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a822f-d3d9-40a5-8084-d6583eec099e admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:36.082375 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92236aac-c9e5-4ffd-9942-7177cc2400f2 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:36.094591 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:36.114768 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a822f-d3d9-40a5-8084-d6583eec099e admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:36.126533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30b0cd-abd8-4db9-94f2-1c1c67eacfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:36.126533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30b0cd-abd8-4db9-94f2-1c1c67eacfac admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:36.126533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30b0cd-abd8-4db9-94f2-1c1c67eacfac admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:36.126533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30b0cd-abd8-4db9-94f2-1c1c67eacfac admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:36.127107 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c30b0cd-abd8-4db9-94f2-1c1c67eacfac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:36.127107 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c30b0cd-abd8-4db9-94f2-1c1c67eacfac admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:36.146154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972afd90-00a9-41ac-bc8a-0c972555a670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:36.146834 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972afd90-00a9-41ac-bc8a-0c972555a670 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:36.147123 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972afd90-00a9-41ac-bc8a-0c972555a670 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:36.147408 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972afd90-00a9-41ac-bc8a-0c972555a670 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:36.148127 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972afd90-00a9-41ac-bc8a-0c972555a670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:36.150739 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972afd90-00a9-41ac-bc8a-0c972555a670 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:36.232027 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1056/2112] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:58:36 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:58:36.236359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30b0cd-abd8-4db9-94f2-1c1c67eacfac admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:36.248123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30b0cd-abd8-4db9-94f2-1c1c67eacfac admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:36.253088 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c67edd-59c2-440c-999a-e5c14091e18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:36.253664 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c67edd-59c2-440c-999a-e5c14091e18d admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:36.253958 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c67edd-59c2-440c-999a-e5c14091e18d admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:36.254242 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c67edd-59c2-440c-999a-e5c14091e18d admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:36.254972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c67edd-59c2-440c-999a-e5c14091e18d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:36.256620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c67edd-59c2-440c-999a-e5c14091e18d admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:36.267607 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1057/2113] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:36 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:58:36.271748 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c67edd-59c2-440c-999a-e5c14091e18d admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:36.282529 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c67edd-59c2-440c-999a-e5c14091e18d admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:36.287525 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59270ba3-19fc-4a3d-97af-154419f3967c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:36.288213 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59270ba3-19fc-4a3d-97af-154419f3967c admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:36.288509 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59270ba3-19fc-4a3d-97af-154419f3967c admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:36.288788 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59270ba3-19fc-4a3d-97af-154419f3967c admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:36.289555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59270ba3-19fc-4a3d-97af-154419f3967c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:36.291394 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59270ba3-19fc-4a3d-97af-154419f3967c admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:36.294827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1057/2114] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:58:36 2022] POST /identity/v3/projects => generated 380 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:58:36.300242 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972afd90-00a9-41ac-bc8a-0c972555a670 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:36.302516 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1058/2115] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:36 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:58:36.306590 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59270ba3-19fc-4a3d-97af-154419f3967c admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:36.316168 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59270ba3-19fc-4a3d-97af-154419f3967c admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:36.367089 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972afd90-00a9-41ac-bc8a-0c972555a670 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:36.373418 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1581f9-a743-40a2-a9e7-67ae1530e952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:36.374098 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1581f9-a743-40a2-a9e7-67ae1530e952 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:36.374388 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1581f9-a743-40a2-a9e7-67ae1530e952 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:36.374670 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1581f9-a743-40a2-a9e7-67ae1530e952 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:36.375363 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1581f9-a743-40a2-a9e7-67ae1530e952 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:36.377403 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1581f9-a743-40a2-a9e7-67ae1530e952 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:36.380609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74ca18-2b36-464e-9eae-d03e645891f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:36.381507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74ca18-2b36-464e-9eae-d03e645891f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:36.381801 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74ca18-2b36-464e-9eae-d03e645891f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:36.382076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74ca18-2b36-464e-9eae-d03e645891f6 admin admin] PATH_INFO: `/v3/projects/3173dfd0947546208491d172b9e6bfee/users/3cc61a388cb44db5a99de3c7692f8d07/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:36.399148 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74ca18-2b36-464e-9eae-d03e645891f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3173dfd0947546208491d172b9e6bfee, user_id=3cc61a388cb44db5a99de3c7692f8d07, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:36.401940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74ca18-2b36-464e-9eae-d03e645891f6 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:36.500960 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1059/2116] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:58:36 2022] PUT /identity/v3/projects/3173dfd0947546208491d172b9e6bfee/users/3cc61a388cb44db5a99de3c7692f8d07/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:58:36.507298 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1058/2117] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:58:36 2022] POST /identity/v3/users => generated 297 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:58:36.508459 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74ca18-2b36-464e-9eae-d03e645891f6 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:36.516534 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8193a-02cf-49ca-887e-3fdc43470b5e None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:36.525552 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8193a-02cf-49ca-887e-3fdc43470b5e None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:36.525552 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8193a-02cf-49ca-887e-3fdc43470b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:36.547982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-c3e8193a-02cf-49ca-887e-3fdc43470b5e None None] MFA Rules not processed for user `3cc61a388cb44db5a99de3c7692f8d07`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:36.549254 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-c3e8193a-02cf-49ca-887e-3fdc43470b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:36.573401 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74ca18-2b36-464e-9eae-d03e645891f6 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:36.578714 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c53a08-5eaa-40eb-a13f-d28798ca362a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:36.579398 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c53a08-5eaa-40eb-a13f-d28798ca362a admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:36.579788 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c53a08-5eaa-40eb-a13f-d28798ca362a admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:36.579972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c53a08-5eaa-40eb-a13f-d28798ca362a admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:36.580763 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c53a08-5eaa-40eb-a13f-d28798ca362a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:36.582401 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c53a08-5eaa-40eb-a13f-d28798ca362a admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:36.596920 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1060/2118] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:36 2022] GET /identity/v3/roles => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:58:36.598298 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c53a08-5eaa-40eb-a13f-d28798ca362a admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:36.609840 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c53a08-5eaa-40eb-a13f-d28798ca362a admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:36.614459 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb8aa5-5c67-4560-98a1-4dc8977e3c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:36.615327 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb8aa5-5c67-4560-98a1-4dc8977e3c6e admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:36.615629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb8aa5-5c67-4560-98a1-4dc8977e3c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:36.615907 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb8aa5-5c67-4560-98a1-4dc8977e3c6e admin admin] PATH_INFO: `/v3/projects/04df15b1273b4119865dbc5600be07fc/users/b2eefe29292f46698dc2f3115403877c/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:36.616465 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1059/2119] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:58:36.620481 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:36.621624 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8193a-02cf-49ca-887e-3fdc43470b5e None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:36.631953 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8193a-02cf-49ca-887e-3fdc43470b5e None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:36.632330 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb8aa5-5c67-4560-98a1-4dc8977e3c6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=04df15b1273b4119865dbc5600be07fc, user_id=b2eefe29292f46698dc2f3115403877c, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:36.635115 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb8aa5-5c67-4560-98a1-4dc8977e3c6e admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:36.636878 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b27392-7a35-4d44-afcd-b243df1d2219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:36.637539 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b27392-7a35-4d44-afcd-b243df1d2219 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:36.637828 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b27392-7a35-4d44-afcd-b243df1d2219 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:36.638113 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b27392-7a35-4d44-afcd-b243df1d2219 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:36.638808 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b27392-7a35-4d44-afcd-b243df1d2219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:36.640844 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b27392-7a35-4d44-afcd-b243df1d2219 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:36.712065 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1061/2120] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:58:36 2022] PUT /identity/v3/projects/04df15b1273b4119865dbc5600be07fc/users/b2eefe29292f46698dc2f3115403877c/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:58:36.716052 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb8aa5-5c67-4560-98a1-4dc8977e3c6e admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:36.766815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1060/2121] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:58:36 2022] POST /identity/v3/projects => generated 386 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:58:36.770924 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b27392-7a35-4d44-afcd-b243df1d2219 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:36.777424 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb8aa5-5c67-4560-98a1-4dc8977e3c6e admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:36.832587 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:36.844312 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26593c3-8696-43e4-a1a1-ea97e90e8cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:36.845000 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26593c3-8696-43e4-a1a1-ea97e90e8cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:36.845794 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26593c3-8696-43e4-a1a1-ea97e90e8cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:36.846087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b27392-7a35-4d44-afcd-b243df1d2219 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:36.846224 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26593c3-8696-43e4-a1a1-ea97e90e8cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:36.846841 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26593c3-8696-43e4-a1a1-ea97e90e8cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:36.848646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26593c3-8696-43e4-a1a1-ea97e90e8cf1 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:36.850877 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a330384-60da-41b8-80af-9150b049a7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:36.851549 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a330384-60da-41b8-80af-9150b049a7c5 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:36.851914 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a330384-60da-41b8-80af-9150b049a7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:36.852381 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a330384-60da-41b8-80af-9150b049a7c5 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:36.853300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a330384-60da-41b8-80af-9150b049a7c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:36.855216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a330384-60da-41b8-80af-9150b049a7c5 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:36.859633 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1062/2122] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:36 2022] GET /identity/v3/roles => generated 1427 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:58:36.863472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26593c3-8696-43e4-a1a1-ea97e90e8cf1 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:36.874144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26593c3-8696-43e4-a1a1-ea97e90e8cf1 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:36.878984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fab21a-4d90-4d39-b94c-f7aa27d73762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:36.879855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fab21a-4d90-4d39-b94c-f7aa27d73762 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:36.880197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fab21a-4d90-4d39-b94c-f7aa27d73762 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:36.880480 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fab21a-4d90-4d39-b94c-f7aa27d73762 admin admin] PATH_INFO: `/v3/projects/04df15b1273b4119865dbc5600be07fc/users/b2eefe29292f46698dc2f3115403877c/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:36.882570 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fab21a-4d90-4d39-b94c-f7aa27d73762 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04df15b1273b4119865dbc5600be07fc, user_id=b2eefe29292f46698dc2f3115403877c, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:36.886058 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fab21a-4d90-4d39-b94c-f7aa27d73762 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:36.893900 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:36.896507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1063/2123] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:58:36 2022] PUT /identity/v3/projects/04df15b1273b4119865dbc5600be07fc/users/b2eefe29292f46698dc2f3115403877c/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:58:36.908399 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39610f8-bfa9-4167-85ec-7e7caeae7922 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:36.908687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39610f8-bfa9-4167-85ec-7e7caeae7922 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:36.908972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39610f8-bfa9-4167-85ec-7e7caeae7922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:36.937465 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-f39610f8-bfa9-4167-85ec-7e7caeae7922 None None] MFA Rules not processed for user `b2eefe29292f46698dc2f3115403877c`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:36.939410 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f39610f8-bfa9-4167-85ec-7e7caeae7922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:36.949047 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1061/2124] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:58:36 2022] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:58:36.949603 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a330384-60da-41b8-80af-9150b049a7c5 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:36.960871 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a330384-60da-41b8-80af-9150b049a7c5 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:37.028914 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ae4fb-03dc-45fe-a6a2-46b60ec56a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:37.029103 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1064/2125] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:58:37.029677 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ae4fb-03dc-45fe-a6a2-46b60ec56a61 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:37.030026 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ae4fb-03dc-45fe-a6a2-46b60ec56a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:37.030314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ae4fb-03dc-45fe-a6a2-46b60ec56a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:37.031052 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ae4fb-03dc-45fe-a6a2-46b60ec56a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:37.033771 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ae4fb-03dc-45fe-a6a2-46b60ec56a61 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:37.042047 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39610f8-bfa9-4167-85ec-7e7caeae7922 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:37.044941 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f39610f8-bfa9-4167-85ec-7e7caeae7922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:37.050136 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1062/2126] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:36 2022] GET /identity/v3/roles => generated 1427 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:58:37.060284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ae4fb-03dc-45fe-a6a2-46b60ec56a61 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:37.070885 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ae4fb-03dc-45fe-a6a2-46b60ec56a61 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:37.075906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14a9a6-7adc-43b2-9e36-d2b1fe073b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:37.076838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14a9a6-7adc-43b2-9e36-d2b1fe073b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:37.076983 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:37.077114 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14a9a6-7adc-43b2-9e36-d2b1fe073b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:37.077398 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14a9a6-7adc-43b2-9e36-d2b1fe073b85 admin admin] PATH_INFO: `/v3/projects/5a9ef299ac88435195ad2b3db042140b/users/530e0d89d46c4dd3951e3299a5953da8/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:37.093502 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14a9a6-7adc-43b2-9e36-d2b1fe073b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a9ef299ac88435195ad2b3db042140b, user_id=530e0d89d46c4dd3951e3299a5953da8, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:37.096733 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14a9a6-7adc-43b2-9e36-d2b1fe073b85 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:37.108236 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39610f8-bfa9-4167-85ec-7e7caeae7922 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:37.111826 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6cbcf-6b53-4c99-911b-5dc20ea0047a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:37.112504 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6cbcf-6b53-4c99-911b-5dc20ea0047a service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:37.112794 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6cbcf-6b53-4c99-911b-5dc20ea0047a service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:37.113070 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6cbcf-6b53-4c99-911b-5dc20ea0047a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:37.122488 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6cbcf-6b53-4c99-911b-5dc20ea0047a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:37.123918 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6cbcf-6b53-4c99-911b-5dc20ea0047a service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:37.134024 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1065/2127] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:58:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:58:37.223911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1063/2128] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:58:37 2022] PUT /identity/v3/projects/5a9ef299ac88435195ad2b3db042140b/users/530e0d89d46c4dd3951e3299a5953da8/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:58:37.227789 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6cbcf-6b53-4c99-911b-5dc20ea0047a service cinder] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:37.238044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6cbcf-6b53-4c99-911b-5dc20ea0047a service cinder] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:37.298216 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8f7dd-e870-4ede-b7c0-fae2c8a405c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:37.298828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8f7dd-e870-4ede-b7c0-fae2c8a405c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:37.299122 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8f7dd-e870-4ede-b7c0-fae2c8a405c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:37.299406 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8f7dd-e870-4ede-b7c0-fae2c8a405c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:37.300201 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8f7dd-e870-4ede-b7c0-fae2c8a405c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:37.301927 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8f7dd-e870-4ede-b7c0-fae2c8a405c1 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:37.312592 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1066/2129] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:37 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:58:37.316768 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14a9a6-7adc-43b2-9e36-d2b1fe073b85 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:37.327811 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14a9a6-7adc-43b2-9e36-d2b1fe073b85 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:37.332549 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8442e-a258-4665-ac41-2350bbf0a2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:37.333424 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8442e-a258-4665-ac41-2350bbf0a2ee admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:37.333964 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8442e-a258-4665-ac41-2350bbf0a2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:37.334242 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8442e-a258-4665-ac41-2350bbf0a2ee admin admin] PATH_INFO: `/v3/projects/5a9ef299ac88435195ad2b3db042140b/users/530e0d89d46c4dd3951e3299a5953da8/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:37.336288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8442e-a258-4665-ac41-2350bbf0a2ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a9ef299ac88435195ad2b3db042140b, user_id=530e0d89d46c4dd3951e3299a5953da8, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:37.338967 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8442e-a258-4665-ac41-2350bbf0a2ee admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:37.356497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1064/2130] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:58:37 2022] PUT /identity/v3/projects/5a9ef299ac88435195ad2b3db042140b/users/530e0d89d46c4dd3951e3299a5953da8/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:37.363983 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8f7dd-e870-4ede-b7c0-fae2c8a405c1 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:37.366166 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2e6d3-74a8-4d79-a442-1124b5ca6553 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:37.366464 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2e6d3-74a8-4d79-a442-1124b5ca6553 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:37.367034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2e6d3-74a8-4d79-a442-1124b5ca6553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:37.396736 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-46f2e6d3-74a8-4d79-a442-1124b5ca6553 None None] MFA Rules not processed for user `530e0d89d46c4dd3951e3299a5953da8`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:37.397994 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-46f2e6d3-74a8-4d79-a442-1124b5ca6553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:37.421885 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8f7dd-e870-4ede-b7c0-fae2c8a405c1 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:37.470539 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1065/2131] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:58:37.473146 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a11798-fc02-45bf-984b-51d4994dc3ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:37.473876 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a11798-fc02-45bf-984b-51d4994dc3ec service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:37.474235 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a11798-fc02-45bf-984b-51d4994dc3ec service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:37.474610 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a11798-fc02-45bf-984b-51d4994dc3ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:37.481810 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2e6d3-74a8-4d79-a442-1124b5ca6553 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:37.483210 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-46f2e6d3-74a8-4d79-a442-1124b5ca6553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:37.495970 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2e6d3-74a8-4d79-a442-1124b5ca6553 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:37.500077 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a441e-7f05-408e-b5c9-bbf030a6f66b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:37.500756 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a441e-7f05-408e-b5c9-bbf030a6f66b service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:37.501368 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a441e-7f05-408e-b5c9-bbf030a6f66b service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:37.501368 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a441e-7f05-408e-b5c9-bbf030a6f66b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:37.521991 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:37.525557 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:37.537401 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a11798-fc02-45bf-984b-51d4994dc3ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:37.538892 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a11798-fc02-45bf-984b-51d4994dc3ec service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:37.548789 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1067/2132] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:58:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:58:37.562593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a441e-7f05-408e-b5c9-bbf030a6f66b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:37.564212 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a441e-7f05-408e-b5c9-bbf030a6f66b service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:37.574587 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1066/2133] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:58:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:58:47.608123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=13 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:47.812402 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=17 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:50.283226 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a11798-fc02-45bf-984b-51d4994dc3ec service cinder] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:50.292522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a11798-fc02-45bf-984b-51d4994dc3ec service cinder] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:50.296470 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34b795-a979-4ff2-8c69-5d2f8bf3c24b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:50.297076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34b795-a979-4ff2-8c69-5d2f8bf3c24b service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:50.297432 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34b795-a979-4ff2-8c69-5d2f8bf3c24b service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:50.297781 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34b795-a979-4ff2-8c69-5d2f8bf3c24b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:50.309107 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34b795-a979-4ff2-8c69-5d2f8bf3c24b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:50.310256 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34b795-a979-4ff2-8c69-5d2f8bf3c24b service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:50.321812 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1068/2134] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:58:50 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:58:50.618052 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a441e-7f05-408e-b5c9-bbf030a6f66b service cinder] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:50.620224 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-148a441e-7f05-408e-b5c9-bbf030a6f66b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:50.704166 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a441e-7f05-408e-b5c9-bbf030a6f66b service cinder] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:50.709292 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef41ab-2039-4490-9f67-e625c6d9e116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:50.719540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef41ab-2039-4490-9f67-e625c6d9e116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:50.719540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef41ab-2039-4490-9f67-e625c6d9e116 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:50.719540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef41ab-2039-4490-9f67-e625c6d9e116 admin admin] PATH_INFO: `/v3/users/b2c85857ad78416dab8f65e7ccd8d8e3` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:50.719540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef41ab-2039-4490-9f67-e625c6d9e116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2c85857ad78416dab8f65e7ccd8d8e3)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:50.719540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef41ab-2039-4490-9f67-e625c6d9e116 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:50.966995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-35ef41ab-2039-4490-9f67-e625c6d9e116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2c85857ad78416dab8f65e7ccd8d8e3'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:50.993327 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-35ef41ab-2039-4490-9f67-e625c6d9e116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2c85857ad78416dab8f65e7ccd8d8e3'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:51.010208 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-35ef41ab-2039-4490-9f67-e625c6d9e116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2c85857ad78416dab8f65e7ccd8d8e3'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:51.011229 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-35ef41ab-2039-4490-9f67-e625c6d9e116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2c85857ad78416dab8f65e7ccd8d8e3'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:51.077146 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-35ef41ab-2039-4490-9f67-e625c6d9e116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2c85857ad78416dab8f65e7ccd8d8e3'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:51.084894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1067/2135] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:58:50 2022] DELETE /identity/v3/users/b2c85857ad78416dab8f65e7ccd8d8e3 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:51.089575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc53e73-f8c4-445a-b0e4-244d4895d5e7 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:51.089879 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc53e73-f8c4-445a-b0e4-244d4895d5e7 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:51.090160 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc53e73-f8c4-445a-b0e4-244d4895d5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:51.108086 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-bcc53e73-f8c4-445a-b0e4-244d4895d5e7 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:51.108865 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-bcc53e73-f8c4-445a-b0e4-244d4895d5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:51.169539 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1069/2136] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:51.179477 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef41ab-2039-4490-9f67-e625c6d9e116 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:51.182395 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-35ef41ab-2039-4490-9f67-e625c6d9e116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:51.240565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef41ab-2039-4490-9f67-e625c6d9e116 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:51.244982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f2eb6-a968-4324-bfe8-065f8b145ff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:51.245649 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f2eb6-a968-4324-bfe8-065f8b145ff7 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:51.245940 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f2eb6-a968-4324-bfe8-065f8b145ff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:51.246213 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f2eb6-a968-4324-bfe8-065f8b145ff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:51.256572 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f2eb6-a968-4324-bfe8-065f8b145ff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:51.258383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f2eb6-a968-4324-bfe8-065f8b145ff7 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:51.268968 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1068/2137] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:58:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:58:51.770250 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc53e73-f8c4-445a-b0e4-244d4895d5e7 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:51.771839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-bcc53e73-f8c4-445a-b0e4-244d4895d5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:51.788034 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc53e73-f8c4-445a-b0e4-244d4895d5e7 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:51.794487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14603ba3-a92e-495c-aaa3-bec0b579cdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:51.795372 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14603ba3-a92e-495c-aaa3-bec0b579cdea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:51.795664 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14603ba3-a92e-495c-aaa3-bec0b579cdea admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:51.795948 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14603ba3-a92e-495c-aaa3-bec0b579cdea admin admin] PATH_INFO: `/v3/projects/0b6984aaf8784b25a41e5bb144fe19e5` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:51.797197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14603ba3-a92e-495c-aaa3-bec0b579cdea admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b6984aaf8784b25a41e5bb144fe19e5)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:51.799152 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14603ba3-a92e-495c-aaa3-bec0b579cdea admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:51.960365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-14603ba3-a92e-495c-aaa3-bec0b579cdea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b6984aaf8784b25a41e5bb144fe19e5', 'request_id': 'req-14603ba3-a92e-495c-aaa3-bec0b579cdea'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:51.967553 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-14603ba3-a92e-495c-aaa3-bec0b579cdea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b6984aaf8784b25a41e5bb144fe19e5', 'request_id': 'req-14603ba3-a92e-495c-aaa3-bec0b579cdea'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:51.973435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-14603ba3-a92e-495c-aaa3-bec0b579cdea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b6984aaf8784b25a41e5bb144fe19e5', 'request_id': 'req-14603ba3-a92e-495c-aaa3-bec0b579cdea'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:52.099719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-14603ba3-a92e-495c-aaa3-bec0b579cdea admin admin] The token cache is being invalidate because project 0b6984aaf8784b25a41e5bb144fe19e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:58:52.099719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-14603ba3-a92e-495c-aaa3-bec0b579cdea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:52.099719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-14603ba3-a92e-495c-aaa3-bec0b579cdea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:52.099719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1070/2138] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:58:51 2022] DELETE /identity/v3/projects/0b6984aaf8784b25a41e5bb144fe19e5 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:52.101360 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4e701-4aa8-4e14-a597-8c60fe0e4e03 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:52.101797 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4e701-4aa8-4e14-a597-8c60fe0e4e03 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:52.101940 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4e701-4aa8-4e14-a597-8c60fe0e4e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:52.119770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-a2b4e701-4aa8-4e14-a597-8c60fe0e4e03 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:52.121021 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-a2b4e701-4aa8-4e14-a597-8c60fe0e4e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:52.141843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:52.189791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1069/2139] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:58:52.198333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b166041-ea03-4177-955a-7a50e7960b1a None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:52.198626 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b166041-ea03-4177-955a-7a50e7960b1a None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:52.198939 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b166041-ea03-4177-955a-7a50e7960b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:52.219676 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-4b166041-ea03-4177-955a-7a50e7960b1a None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:52.220905 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-4b166041-ea03-4177-955a-7a50e7960b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:52.229357 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1071/2140] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:52.234189 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4e701-4aa8-4e14-a597-8c60fe0e4e03 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:52.243517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4e701-4aa8-4e14-a597-8c60fe0e4e03 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:52.248187 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c13525-e756-4699-89b8-27241011503d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:52.248849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c13525-e756-4699-89b8-27241011503d admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:52.249136 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c13525-e756-4699-89b8-27241011503d admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:52.249481 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c13525-e756-4699-89b8-27241011503d admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:52.250264 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c13525-e756-4699-89b8-27241011503d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:58:52.250574 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c13525-e756-4699-89b8-27241011503d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:52.252263 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c13525-e756-4699-89b8-27241011503d admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:52.264678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1070/2141] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:58:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:58:52.269195 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b166041-ea03-4177-955a-7a50e7960b1a None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:52.279539 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b166041-ea03-4177-955a-7a50e7960b1a None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:52.284440 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e993c1f-b167-49b9-89c2-a4800e9ad6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:52.285089 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e993c1f-b167-49b9-89c2-a4800e9ad6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:52.285371 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e993c1f-b167-49b9-89c2-a4800e9ad6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:52.285645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e993c1f-b167-49b9-89c2-a4800e9ad6a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:52.286367 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e993c1f-b167-49b9-89c2-a4800e9ad6a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:52.288376 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e993c1f-b167-49b9-89c2-a4800e9ad6a2 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:52.445299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1072/2142] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:58:52 2022] POST /identity/v3/projects => generated 384 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:58:52.450086 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c13525-e756-4699-89b8-27241011503d admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:52.460239 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c13525-e756-4699-89b8-27241011503d admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:52.535168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901681c7-a8d5-486f-a95f-f1586eb8bbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:52.535931 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901681c7-a8d5-486f-a95f-f1586eb8bbc6 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:52.536571 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901681c7-a8d5-486f-a95f-f1586eb8bbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:52.536861 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901681c7-a8d5-486f-a95f-f1586eb8bbc6 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:52.537587 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901681c7-a8d5-486f-a95f-f1586eb8bbc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:52.539656 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901681c7-a8d5-486f-a95f-f1586eb8bbc6 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:52.661213 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1071/2143] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:58:52 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:58:52.674236 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e993c1f-b167-49b9-89c2-a4800e9ad6a2 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:52.680864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e993c1f-b167-49b9-89c2-a4800e9ad6a2 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:52.688177 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6b958-0f03-4deb-a680-5a779926f060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:52.689008 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6b958-0f03-4deb-a680-5a779926f060 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:52.689365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6b958-0f03-4deb-a680-5a779926f060 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:52.689754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6b958-0f03-4deb-a680-5a779926f060 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:52.690816 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6b958-0f03-4deb-a680-5a779926f060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:52.693271 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6b958-0f03-4deb-a680-5a779926f060 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:52.705763 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1073/2144] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:52 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:58:52.709318 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901681c7-a8d5-486f-a95f-f1586eb8bbc6 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:52.720174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901681c7-a8d5-486f-a95f-f1586eb8bbc6 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:52.725026 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ca007-72a6-463c-b80a-f59cfdea42c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:52.725702 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ca007-72a6-463c-b80a-f59cfdea42c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:52.726005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ca007-72a6-463c-b80a-f59cfdea42c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:52.726281 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ca007-72a6-463c-b80a-f59cfdea42c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:52.727779 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ca007-72a6-463c-b80a-f59cfdea42c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:52.729586 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ca007-72a6-463c-b80a-f59cfdea42c8 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:52.740315 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1072/2145] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:52 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:58:52.744915 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6b958-0f03-4deb-a680-5a779926f060 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:52.755050 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6b958-0f03-4deb-a680-5a779926f060 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:52.760368 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f4fe9-369a-4761-8755-a116c0c3f33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:52.761263 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f4fe9-369a-4761-8755-a116c0c3f33f admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:52.761553 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f4fe9-369a-4761-8755-a116c0c3f33f admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:52.761836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f4fe9-369a-4761-8755-a116c0c3f33f admin admin] PATH_INFO: `/v3/projects/4a08d3a5aee344c8a8b80911f995e6b7/users/53c93f2c53874852b84a2a4571ecc311/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:52.778345 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f4fe9-369a-4761-8755-a116c0c3f33f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a08d3a5aee344c8a8b80911f995e6b7, user_id=53c93f2c53874852b84a2a4571ecc311, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:52.781217 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f4fe9-369a-4761-8755-a116c0c3f33f admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:52.860571 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1074/2146] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:58:52 2022] PUT /identity/v3/projects/4a08d3a5aee344c8a8b80911f995e6b7/users/53c93f2c53874852b84a2a4571ecc311/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:52.872361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bd325-aa27-4ee3-83c4-d1fe69728482 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:52.872658 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bd325-aa27-4ee3-83c4-d1fe69728482 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:52.872945 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bd325-aa27-4ee3-83c4-d1fe69728482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:52.903592 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-374bd325-aa27-4ee3-83c4-d1fe69728482 None None] MFA Rules not processed for user `53c93f2c53874852b84a2a4571ecc311`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:52.904867 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-374bd325-aa27-4ee3-83c4-d1fe69728482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:52.970551 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1073/2147] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:52.975060 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f4fe9-369a-4761-8755-a116c0c3f33f admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:52.985964 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:53.043881 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f4fe9-369a-4761-8755-a116c0c3f33f admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:53.048898 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41091460-a523-4bfe-94a4-5ecf8f64be2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:53.049567 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41091460-a523-4bfe-94a4-5ecf8f64be2e admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:53.049974 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41091460-a523-4bfe-94a4-5ecf8f64be2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:53.050253 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41091460-a523-4bfe-94a4-5ecf8f64be2e admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:53.050966 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41091460-a523-4bfe-94a4-5ecf8f64be2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:53.053013 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41091460-a523-4bfe-94a4-5ecf8f64be2e admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:53.161129 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1075/2148] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:58:52 2022] POST /identity/v3/projects => generated 384 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:58:53.165627 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bd325-aa27-4ee3-83c4-d1fe69728482 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:53.176362 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bd325-aa27-4ee3-83c4-d1fe69728482 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:53.189048 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:53.236127 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a4d6c-7dab-47ec-bc01-a4dedae2af22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:53.237242 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a4d6c-7dab-47ec-bc01-a4dedae2af22 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:53.237665 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a4d6c-7dab-47ec-bc01-a4dedae2af22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:53.237952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a4d6c-7dab-47ec-bc01-a4dedae2af22 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:53.238668 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a4d6c-7dab-47ec-bc01-a4dedae2af22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:53.240640 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a4d6c-7dab-47ec-bc01-a4dedae2af22 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:53.372575 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1074/2149] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:58:53 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:58:53.373818 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41091460-a523-4bfe-94a4-5ecf8f64be2e admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:53.384331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41091460-a523-4bfe-94a4-5ecf8f64be2e admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:53.388969 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e57557-953f-4c0e-b41b-f2be2841b9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:53.393103 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e57557-953f-4c0e-b41b-f2be2841b9de admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:53.393103 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e57557-953f-4c0e-b41b-f2be2841b9de admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:53.393103 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e57557-953f-4c0e-b41b-f2be2841b9de admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:53.393103 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e57557-953f-4c0e-b41b-f2be2841b9de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:53.393103 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e57557-953f-4c0e-b41b-f2be2841b9de admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:53.404193 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1076/2150] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:53 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:58:53.408243 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a4d6c-7dab-47ec-bc01-a4dedae2af22 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:53.419329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a4d6c-7dab-47ec-bc01-a4dedae2af22 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:53.424342 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b7039-9a2f-40de-91c7-0216670723e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:53.427482 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b7039-9a2f-40de-91c7-0216670723e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:53.427482 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b7039-9a2f-40de-91c7-0216670723e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:53.427482 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b7039-9a2f-40de-91c7-0216670723e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:53.427482 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b7039-9a2f-40de-91c7-0216670723e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:53.427954 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b7039-9a2f-40de-91c7-0216670723e6 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:53.438212 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1075/2151] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:53 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:58:53.442529 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e57557-953f-4c0e-b41b-f2be2841b9de admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:53.453814 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e57557-953f-4c0e-b41b-f2be2841b9de admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:53.458481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05eefe4-f97a-483f-a084-be68434a1c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:53.459630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05eefe4-f97a-483f-a084-be68434a1c69 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:53.459912 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05eefe4-f97a-483f-a084-be68434a1c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:53.460224 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05eefe4-f97a-483f-a084-be68434a1c69 admin admin] PATH_INFO: `/v3/projects/471cfb5e04dd41fcb813d8177a8f8acf/users/e36869f56a23425088b7c56837a2679f/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:53.475362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05eefe4-f97a-483f-a084-be68434a1c69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=471cfb5e04dd41fcb813d8177a8f8acf, user_id=e36869f56a23425088b7c56837a2679f, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:53.478002 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05eefe4-f97a-483f-a084-be68434a1c69 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:53.575253 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1077/2152] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:58:53 2022] PUT /identity/v3/projects/471cfb5e04dd41fcb813d8177a8f8acf/users/e36869f56a23425088b7c56837a2679f/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:53.585819 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a732aed-9952-428b-b6c7-dd1183ac17c0 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:53.587038 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a732aed-9952-428b-b6c7-dd1183ac17c0 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:53.587436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a732aed-9952-428b-b6c7-dd1183ac17c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:53.615948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-9a732aed-9952-428b-b6c7-dd1183ac17c0 None None] MFA Rules not processed for user `e36869f56a23425088b7c56837a2679f`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:53.617194 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-9a732aed-9952-428b-b6c7-dd1183ac17c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:53.684713 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1076/2153] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:53.689360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05eefe4-f97a-483f-a084-be68434a1c69 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:53.752487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05eefe4-f97a-483f-a084-be68434a1c69 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:53.757133 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84bdd4a-d5df-42e4-b844-dd93ed3faa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:53.757878 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bdd4a-d5df-42e4-b844-dd93ed3faa8d admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:53.758769 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bdd4a-d5df-42e4-b844-dd93ed3faa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:53.759081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bdd4a-d5df-42e4-b844-dd93ed3faa8d admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:53.759774 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84bdd4a-d5df-42e4-b844-dd93ed3faa8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:53.761808 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84bdd4a-d5df-42e4-b844-dd93ed3faa8d admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:53.913691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1078/2154] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:58:53 2022] POST /identity/v3/projects => generated 386 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:58:53.918277 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a732aed-9952-428b-b6c7-dd1183ac17c0 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:53.929261 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a732aed-9952-428b-b6c7-dd1183ac17c0 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:53.993543 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81660a89-9aca-4f7b-a0c9-ff549c4011d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:53.994183 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81660a89-9aca-4f7b-a0c9-ff549c4011d8 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:53.994469 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81660a89-9aca-4f7b-a0c9-ff549c4011d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:53.994748 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81660a89-9aca-4f7b-a0c9-ff549c4011d8 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:53.995458 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81660a89-9aca-4f7b-a0c9-ff549c4011d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:53.997466 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81660a89-9aca-4f7b-a0c9-ff549c4011d8 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:54.176895 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1077/2155] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:58:53 2022] POST /identity/v3/users => generated 300 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:58:54.178234 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84bdd4a-d5df-42e4-b844-dd93ed3faa8d admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:54.191101 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84bdd4a-d5df-42e4-b844-dd93ed3faa8d admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:54.196326 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed027349-503c-44ba-86b8-065e25af2461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:54.197106 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed027349-503c-44ba-86b8-065e25af2461 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:54.197500 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed027349-503c-44ba-86b8-065e25af2461 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:54.197788 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed027349-503c-44ba-86b8-065e25af2461 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:54.198531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed027349-503c-44ba-86b8-065e25af2461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:54.200263 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed027349-503c-44ba-86b8-065e25af2461 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:54.211549 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1079/2156] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:54 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:58:54.215685 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81660a89-9aca-4f7b-a0c9-ff549c4011d8 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:54.226167 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81660a89-9aca-4f7b-a0c9-ff549c4011d8 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:54.231674 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9d5ff-ef58-4bd3-a4b6-8ad391d09c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:54.232693 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9d5ff-ef58-4bd3-a4b6-8ad391d09c1c admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:54.232982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9d5ff-ef58-4bd3-a4b6-8ad391d09c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:54.233265 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9d5ff-ef58-4bd3-a4b6-8ad391d09c1c admin admin] PATH_INFO: `/v3/projects/8dbf6d5fbcc943fc8db6494af24632a3/users/6fc6822102c5489497be6b9b74c2e415/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:54.247375 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:54.250639 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb9d5ff-ef58-4bd3-a4b6-8ad391d09c1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dbf6d5fbcc943fc8db6494af24632a3, user_id=6fc6822102c5489497be6b9b74c2e415, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:54.260918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb9d5ff-ef58-4bd3-a4b6-8ad391d09c1c admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:54.370216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1078/2157] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:58:54 2022] PUT /identity/v3/projects/8dbf6d5fbcc943fc8db6494af24632a3/users/6fc6822102c5489497be6b9b74c2e415/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:58:54.374290 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed027349-503c-44ba-86b8-065e25af2461 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:54.384488 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed027349-503c-44ba-86b8-065e25af2461 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:54.413799 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:54.442051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280b771-6598-478e-8cfe-b4bf7e6df3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:54.442721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280b771-6598-478e-8cfe-b4bf7e6df3aa admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:54.443001 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280b771-6598-478e-8cfe-b4bf7e6df3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:54.443277 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280b771-6598-478e-8cfe-b4bf7e6df3aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:54.444009 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280b771-6598-478e-8cfe-b4bf7e6df3aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:54.445666 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280b771-6598-478e-8cfe-b4bf7e6df3aa admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:54.455324 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1080/2158] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:54 2022] GET /identity/v3/roles => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:58:54.459755 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9d5ff-ef58-4bd3-a4b6-8ad391d09c1c admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:54.470358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9d5ff-ef58-4bd3-a4b6-8ad391d09c1c admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:54.474964 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a38edd-27af-4156-a9e1-0c4eeb5c0d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:54.475840 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a38edd-27af-4156-a9e1-0c4eeb5c0d7e admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:54.476146 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a38edd-27af-4156-a9e1-0c4eeb5c0d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:54.476431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a38edd-27af-4156-a9e1-0c4eeb5c0d7e admin admin] PATH_INFO: `/v3/projects/8dbf6d5fbcc943fc8db6494af24632a3/users/6fc6822102c5489497be6b9b74c2e415/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:54.479103 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a38edd-27af-4156-a9e1-0c4eeb5c0d7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dbf6d5fbcc943fc8db6494af24632a3, user_id=6fc6822102c5489497be6b9b74c2e415, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:54.481770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a38edd-27af-4156-a9e1-0c4eeb5c0d7e admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:54.491909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1079/2159] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:58:54 2022] PUT /identity/v3/projects/8dbf6d5fbcc943fc8db6494af24632a3/users/6fc6822102c5489497be6b9b74c2e415/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:54.503660 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe05f79-fb3a-4139-a3e7-c975934a1573 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:54.506615 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe05f79-fb3a-4139-a3e7-c975934a1573 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:54.506615 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe05f79-fb3a-4139-a3e7-c975934a1573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:54.533208 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-1fe05f79-fb3a-4139-a3e7-c975934a1573 None None] MFA Rules not processed for user `6fc6822102c5489497be6b9b74c2e415`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:54.535380 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-1fe05f79-fb3a-4139-a3e7-c975934a1573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:54.609110 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1081/2160] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:54.620787 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a38edd-27af-4156-a9e1-0c4eeb5c0d7e admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:54.622589 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-77a38edd-27af-4156-a9e1-0c4eeb5c0d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:54.692265 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a38edd-27af-4156-a9e1-0c4eeb5c0d7e admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:54.696188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251e237-54f2-47b2-bed0-0cfddb146856 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:54.696846 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251e237-54f2-47b2-bed0-0cfddb146856 service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:54.697127 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251e237-54f2-47b2-bed0-0cfddb146856 service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:54.697401 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251e237-54f2-47b2-bed0-0cfddb146856 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:54.755779 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1251e237-54f2-47b2-bed0-0cfddb146856 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:54.757278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1251e237-54f2-47b2-bed0-0cfddb146856 service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:54.766442 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1080/2161] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:58:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:58:55.029059 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe05f79-fb3a-4139-a3e7-c975934a1573 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:55.030876 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-1fe05f79-fb3a-4139-a3e7-c975934a1573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:55.112905 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe05f79-fb3a-4139-a3e7-c975934a1573 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:55.117954 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcc5d0-b129-4aed-82f4-034ba38018d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:55.119152 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcc5d0-b129-4aed-82f4-034ba38018d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:55.119297 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcc5d0-b129-4aed-82f4-034ba38018d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:55.119595 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcc5d0-b129-4aed-82f4-034ba38018d4 admin admin] PATH_INFO: `/v3/users/46dda6a1c289410992661c589e537574` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:55.120854 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fcc5d0-b129-4aed-82f4-034ba38018d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46dda6a1c289410992661c589e537574)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:55.123293 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fcc5d0-b129-4aed-82f4-034ba38018d4 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:55.393763 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-95fcc5d0-b129-4aed-82f4-034ba38018d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46dda6a1c289410992661c589e537574'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:55.397762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-95fcc5d0-b129-4aed-82f4-034ba38018d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46dda6a1c289410992661c589e537574'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:55.411318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:55.420505 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-95fcc5d0-b129-4aed-82f4-034ba38018d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46dda6a1c289410992661c589e537574'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:55.429405 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-95fcc5d0-b129-4aed-82f4-034ba38018d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46dda6a1c289410992661c589e537574'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:55.436239 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-95fcc5d0-b129-4aed-82f4-034ba38018d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46dda6a1c289410992661c589e537574'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:55.567800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1082/2162] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:58:55 2022] DELETE /identity/v3/users/46dda6a1c289410992661c589e537574 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:55.569289 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4714371-b412-476e-9a46-1da629ddd5f3 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:55.569765 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4714371-b412-476e-9a46-1da629ddd5f3 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:55.569885 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4714371-b412-476e-9a46-1da629ddd5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:55.588490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-e4714371-b412-476e-9a46-1da629ddd5f3 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:55.589724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-e4714371-b412-476e-9a46-1da629ddd5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:55.648406 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1081/2163] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:58:55.658741 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcc5d0-b129-4aed-82f4-034ba38018d4 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:55.660190 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-95fcc5d0-b129-4aed-82f4-034ba38018d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:55.728919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcc5d0-b129-4aed-82f4-034ba38018d4 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:55.732967 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77735c0c-75b7-4722-b3ba-a5ad290442d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:55.741368 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77735c0c-75b7-4722-b3ba-a5ad290442d0 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:55.741368 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77735c0c-75b7-4722-b3ba-a5ad290442d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:55.741368 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77735c0c-75b7-4722-b3ba-a5ad290442d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:55.743929 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77735c0c-75b7-4722-b3ba-a5ad290442d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:55.745389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77735c0c-75b7-4722-b3ba-a5ad290442d0 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:55.755188 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1083/2164] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:58:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:58:56.250533 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4714371-b412-476e-9a46-1da629ddd5f3 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:56.252983 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-e4714371-b412-476e-9a46-1da629ddd5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:56.265856 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4714371-b412-476e-9a46-1da629ddd5f3 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:56.271414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26299e51-0b15-47e0-bd68-70b8e2028ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:56.272322 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26299e51-0b15-47e0-bd68-70b8e2028ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:56.272607 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26299e51-0b15-47e0-bd68-70b8e2028ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:56.272884 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26299e51-0b15-47e0-bd68-70b8e2028ddd admin admin] PATH_INFO: `/v3/projects/8f7c2acd1c5348c8b1ce4460a2c07362` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:56.274194 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26299e51-0b15-47e0-bd68-70b8e2028ddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f7c2acd1c5348c8b1ce4460a2c07362)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:56.276283 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26299e51-0b15-47e0-bd68-70b8e2028ddd admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:56.371844 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:56.387330 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-26299e51-0b15-47e0-bd68-70b8e2028ddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f7c2acd1c5348c8b1ce4460a2c07362', 'request_id': 'req-26299e51-0b15-47e0-bd68-70b8e2028ddd'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:56.393646 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-26299e51-0b15-47e0-bd68-70b8e2028ddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f7c2acd1c5348c8b1ce4460a2c07362', 'request_id': 'req-26299e51-0b15-47e0-bd68-70b8e2028ddd'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:56.562764 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-26299e51-0b15-47e0-bd68-70b8e2028ddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f7c2acd1c5348c8b1ce4460a2c07362', 'request_id': 'req-26299e51-0b15-47e0-bd68-70b8e2028ddd'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:56.574200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-26299e51-0b15-47e0-bd68-70b8e2028ddd admin admin] The token cache is being invalidate because project 8f7c2acd1c5348c8b1ce4460a2c07362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:58:56.574758 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-26299e51-0b15-47e0-bd68-70b8e2028ddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:56.575277 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-26299e51-0b15-47e0-bd68-70b8e2028ddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:56.577065 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1082/2165] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:58:56 2022] DELETE /identity/v3/projects/8f7c2acd1c5348c8b1ce4460a2c07362 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:56.581049 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77735c0c-75b7-4722-b3ba-a5ad290442d0 service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:56.591313 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77735c0c-75b7-4722-b3ba-a5ad290442d0 service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:56.652434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a807d23-97a2-4185-89c7-c83a0df4bda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:56.653322 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a807d23-97a2-4185-89c7-c83a0df4bda0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:56.653611 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a807d23-97a2-4185-89c7-c83a0df4bda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:56.653895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a807d23-97a2-4185-89c7-c83a0df4bda0 admin admin] PATH_INFO: `/v3/users/b2eefe29292f46698dc2f3115403877c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:56.655115 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a807d23-97a2-4185-89c7-c83a0df4bda0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2eefe29292f46698dc2f3115403877c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:56.657108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a807d23-97a2-4185-89c7-c83a0df4bda0 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:56.917839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9a807d23-97a2-4185-89c7-c83a0df4bda0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2eefe29292f46698dc2f3115403877c'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:56.918614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9a807d23-97a2-4185-89c7-c83a0df4bda0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2eefe29292f46698dc2f3115403877c'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:56.931702 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9a807d23-97a2-4185-89c7-c83a0df4bda0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2eefe29292f46698dc2f3115403877c'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:56.938665 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9a807d23-97a2-4185-89c7-c83a0df4bda0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2eefe29292f46698dc2f3115403877c'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:56.939340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9a807d23-97a2-4185-89c7-c83a0df4bda0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2eefe29292f46698dc2f3115403877c'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:56.941872 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:57.082647 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1084/2166] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:58:56 2022] DELETE /identity/v3/users/b2eefe29292f46698dc2f3115403877c => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:58:57.581897 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26299e51-0b15-47e0-bd68-70b8e2028ddd admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:57.583471 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-26299e51-0b15-47e0-bd68-70b8e2028ddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:57.598409 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26299e51-0b15-47e0-bd68-70b8e2028ddd admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:57.657316 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e2c50-bcd0-483e-9e64-6e449363cbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:57.658257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e2c50-bcd0-483e-9e64-6e449363cbf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:57.658552 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e2c50-bcd0-483e-9e64-6e449363cbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:57.658825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e2c50-bcd0-483e-9e64-6e449363cbf4 admin admin] PATH_INFO: `/v3/projects/04df15b1273b4119865dbc5600be07fc` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:57.660007 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e2c50-bcd0-483e-9e64-6e449363cbf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04df15b1273b4119865dbc5600be07fc)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:57.662060 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e2c50-bcd0-483e-9e64-6e449363cbf4 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:57.796713 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-ae1e2c50-bcd0-483e-9e64-6e449363cbf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04df15b1273b4119865dbc5600be07fc', 'request_id': 'req-ae1e2c50-bcd0-483e-9e64-6e449363cbf4'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:57.800686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a807d23-97a2-4185-89c7-c83a0df4bda0 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:57.802508 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-9a807d23-97a2-4185-89c7-c83a0df4bda0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:57.803720 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-ae1e2c50-bcd0-483e-9e64-6e449363cbf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04df15b1273b4119865dbc5600be07fc', 'request_id': 'req-ae1e2c50-bcd0-483e-9e64-6e449363cbf4'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:57.818390 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a807d23-97a2-4185-89c7-c83a0df4bda0 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:57.871855 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-ae1e2c50-bcd0-483e-9e64-6e449363cbf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04df15b1273b4119865dbc5600be07fc', 'request_id': 'req-ae1e2c50-bcd0-483e-9e64-6e449363cbf4'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:57.888395 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-ae1e2c50-bcd0-483e-9e64-6e449363cbf4 admin admin] The token cache is being invalidate because project 04df15b1273b4119865dbc5600be07fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:58:57.888395 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-ae1e2c50-bcd0-483e-9e64-6e449363cbf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:57.888395 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-ae1e2c50-bcd0-483e-9e64-6e449363cbf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:57.890013 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1083/2167] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:58:57 2022] DELETE /identity/v3/projects/04df15b1273b4119865dbc5600be07fc => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:57.891202 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa115df-d68e-44ad-9e48-30d4164487b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:57.892283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa115df-d68e-44ad-9e48-30d4164487b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:57.892789 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa115df-d68e-44ad-9e48-30d4164487b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:57.892978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa115df-d68e-44ad-9e48-30d4164487b1 admin admin] PATH_INFO: `/v3/users/3cc61a388cb44db5a99de3c7692f8d07` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:57.894714 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa115df-d68e-44ad-9e48-30d4164487b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cc61a388cb44db5a99de3c7692f8d07)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:57.895005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc812d-3a3a-4eef-bab6-3399dd3e198e None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:57.895403 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc812d-3a3a-4eef-bab6-3399dd3e198e None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:57.895825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc812d-3a3a-4eef-bab6-3399dd3e198e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:57.897014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa115df-d68e-44ad-9e48-30d4164487b1 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:57.922390 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-a7bc812d-3a3a-4eef-bab6-3399dd3e198e None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:57.923908 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-a7bc812d-3a3a-4eef-bab6-3399dd3e198e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:57.934586 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1084/2168] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:57.944843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50b24a-4372-4698-9539-21072b84d0aa None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:57.945135 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50b24a-4372-4698-9539-21072b84d0aa None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:57.945996 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50b24a-4372-4698-9539-21072b84d0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:57.964726 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-bf50b24a-4372-4698-9539-21072b84d0aa None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:57.965915 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-bf50b24a-4372-4698-9539-21072b84d0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:57.973841 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1085/2169] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:58:57.977971 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50b24a-4372-4698-9539-21072b84d0aa None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:57.987102 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50b24a-4372-4698-9539-21072b84d0aa None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:57.991928 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d519760-b62a-44cb-8e47-dfe6c913c27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:57.993174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d519760-b62a-44cb-8e47-dfe6c913c27e admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:57.993174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d519760-b62a-44cb-8e47-dfe6c913c27e admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:57.993343 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d519760-b62a-44cb-8e47-dfe6c913c27e admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:57.994075 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d519760-b62a-44cb-8e47-dfe6c913c27e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:58:57.994389 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d519760-b62a-44cb-8e47-dfe6c913c27e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:57.996045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d519760-b62a-44cb-8e47-dfe6c913c27e admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:58.011013 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1086/2170] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:58:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:58:58.014039 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d519760-b62a-44cb-8e47-dfe6c913c27e admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:58.024881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d519760-b62a-44cb-8e47-dfe6c913c27e admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:58.029774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77605c7-660f-44a7-82b4-9b6b92f4b3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:58.030453 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77605c7-660f-44a7-82b4-9b6b92f4b3dc admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:58.030711 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77605c7-660f-44a7-82b4-9b6b92f4b3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:58.030998 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77605c7-660f-44a7-82b4-9b6b92f4b3dc admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:58.031688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77605c7-660f-44a7-82b4-9b6b92f4b3dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:58.033992 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77605c7-660f-44a7-82b4-9b6b92f4b3dc admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:58.193387 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-efa115df-d68e-44ad-9e48-30d4164487b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cc61a388cb44db5a99de3c7692f8d07'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:58.194044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-efa115df-d68e-44ad-9e48-30d4164487b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cc61a388cb44db5a99de3c7692f8d07'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:58.207028 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-efa115df-d68e-44ad-9e48-30d4164487b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cc61a388cb44db5a99de3c7692f8d07'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:58.217099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-efa115df-d68e-44ad-9e48-30d4164487b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cc61a388cb44db5a99de3c7692f8d07'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:58.217099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-efa115df-d68e-44ad-9e48-30d4164487b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cc61a388cb44db5a99de3c7692f8d07'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:58.248525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:58.255190 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1087/2171] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:58:58 2022] POST /identity/v3/projects => generated 366 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:58:58.257841 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77605c7-660f-44a7-82b4-9b6b92f4b3dc admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:58.257841 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-f77605c7-660f-44a7-82b4-9b6b92f4b3dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:58.315512 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77605c7-660f-44a7-82b4-9b6b92f4b3dc admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:58.319047 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d79e36-db98-4c75-9b2f-97008f12f4de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:58.319692 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d79e36-db98-4c75-9b2f-97008f12f4de service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:58.319979 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d79e36-db98-4c75-9b2f-97008f12f4de service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:58.320295 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d79e36-db98-4c75-9b2f-97008f12f4de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:58.322833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b0d79e36-db98-4c75-9b2f-97008f12f4de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:58.346075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1085/2172] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:58:57 2022] DELETE /identity/v3/users/3cc61a388cb44db5a99de3c7692f8d07 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:58:58.347126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa115df-d68e-44ad-9e48-30d4164487b1 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:58.348529 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-efa115df-d68e-44ad-9e48-30d4164487b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:58.387461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d79e36-db98-4c75-9b2f-97008f12f4de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:58.389050 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d79e36-db98-4c75-9b2f-97008f12f4de service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:58.398893 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1088/2173] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:58:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:58:58.400317 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65162b5-79cf-434d-93c7-2fffbfd47681 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:58.400604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65162b5-79cf-434d-93c7-2fffbfd47681 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:58.406241 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65162b5-79cf-434d-93c7-2fffbfd47681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:58.415669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa115df-d68e-44ad-9e48-30d4164487b1 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:58.417678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-f65162b5-79cf-434d-93c7-2fffbfd47681 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:58.418986 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-f65162b5-79cf-434d-93c7-2fffbfd47681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:58.420488 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb3af5-11ce-449f-b403-7ddf9fac4c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:58.421159 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb3af5-11ce-449f-b403-7ddf9fac4c09 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:58.421446 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb3af5-11ce-449f-b403-7ddf9fac4c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:58.421722 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb3af5-11ce-449f-b403-7ddf9fac4c09 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:58.422459 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb3af5-11ce-449f-b403-7ddf9fac4c09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:58.424494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb3af5-11ce-449f-b403-7ddf9fac4c09 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:58.431171 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1089/2174] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:58.438648 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65162b5-79cf-434d-93c7-2fffbfd47681 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:58.440329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-f65162b5-79cf-434d-93c7-2fffbfd47681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:58.502975 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65162b5-79cf-434d-93c7-2fffbfd47681 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:58.506698 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33195ba6-000b-4e1b-ae4d-f5b2cc6ffa80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:58.507354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33195ba6-000b-4e1b-ae4d-f5b2cc6ffa80 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:58.507645 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33195ba6-000b-4e1b-ae4d-f5b2cc6ffa80 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:58.507953 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33195ba6-000b-4e1b-ae4d-f5b2cc6ffa80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:58.521798 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33195ba6-000b-4e1b-ae4d-f5b2cc6ffa80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:58.523284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33195ba6-000b-4e1b-ae4d-f5b2cc6ffa80 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:58.534747 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1086/2175] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:58:58 2022] POST /identity/v3/users => generated 284 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:58:58.534930 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1090/2176] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:58:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:58:58.543763 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb3af5-11ce-449f-b403-7ddf9fac4c09 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:58.549189 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:58.558507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb3af5-11ce-449f-b403-7ddf9fac4c09 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:58.565925 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363448f-d548-4770-bcd9-23919a4da85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:58.566680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363448f-d548-4770-bcd9-23919a4da85a admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:58.567293 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363448f-d548-4770-bcd9-23919a4da85a admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:58.567655 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363448f-d548-4770-bcd9-23919a4da85a admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:58.569654 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363448f-d548-4770-bcd9-23919a4da85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:58.570421 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363448f-d548-4770-bcd9-23919a4da85a admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:58.582605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1087/2177] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:58 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:58:58.586861 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33195ba6-000b-4e1b-ae4d-f5b2cc6ffa80 service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:58.620960 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33195ba6-000b-4e1b-ae4d-f5b2cc6ffa80 service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:58.626511 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197525f-9a2d-4a2e-94b4-dc7b81fe414a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:58.627283 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197525f-9a2d-4a2e-94b4-dc7b81fe414a admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:58.627575 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197525f-9a2d-4a2e-94b4-dc7b81fe414a admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:58.627914 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197525f-9a2d-4a2e-94b4-dc7b81fe414a admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:58.628694 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197525f-9a2d-4a2e-94b4-dc7b81fe414a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:58.630667 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197525f-9a2d-4a2e-94b4-dc7b81fe414a admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:58.653921 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363448f-d548-4770-bcd9-23919a4da85a admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:58.654514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1091/2178] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:58 2022] GET /identity/v3/roles => generated 1427 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:58:58.669200 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363448f-d548-4770-bcd9-23919a4da85a admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:58.677659 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43747ed3-39ec-4652-8ac8-22b2ec333bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:58.678814 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43747ed3-39ec-4652-8ac8-22b2ec333bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:58.679301 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43747ed3-39ec-4652-8ac8-22b2ec333bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:58.680551 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43747ed3-39ec-4652-8ac8-22b2ec333bd9 admin admin] PATH_INFO: `/v3/projects/4a4236f893e849c38f7085c47990b660/users/70415e3face2469fae848e84073ea832/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:58.701667 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43747ed3-39ec-4652-8ac8-22b2ec333bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a4236f893e849c38f7085c47990b660, user_id=70415e3face2469fae848e84073ea832, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:58.704608 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43747ed3-39ec-4652-8ac8-22b2ec333bd9 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:58.846382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1088/2179] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:58:58 2022] PUT /identity/v3/projects/4a4236f893e849c38f7085c47990b660/users/70415e3face2469fae848e84073ea832/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:58:58.856967 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc1209-2286-40ba-a942-67f4e0045bfd None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:58.857259 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc1209-2286-40ba-a942-67f4e0045bfd None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:58.857541 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc1209-2286-40ba-a942-67f4e0045bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:58.887088 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-9dcc1209-2286-40ba-a942-67f4e0045bfd None None] MFA Rules not processed for user `70415e3face2469fae848e84073ea832`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:58.888339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-9dcc1209-2286-40ba-a942-67f4e0045bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:58.923674 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:58.991529 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1092/2180] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:58:58.996211 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43747ed3-39ec-4652-8ac8-22b2ec333bd9 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:59.069499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43747ed3-39ec-4652-8ac8-22b2ec333bd9 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:59.078513 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b690a-92bd-439b-8337-40c211f94dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:59.079602 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b690a-92bd-439b-8337-40c211f94dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:59.080260 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b690a-92bd-439b-8337-40c211f94dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:59.080713 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b690a-92bd-439b-8337-40c211f94dd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:59.081634 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b690a-92bd-439b-8337-40c211f94dd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:59.087371 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b690a-92bd-439b-8337-40c211f94dd5 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:59.087694 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc1209-2286-40ba-a942-67f4e0045bfd None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:59.089531 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-9dcc1209-2286-40ba-a942-67f4e0045bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:59.113415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc1209-2286-40ba-a942-67f4e0045bfd None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:59.120131 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41aa32c-d784-497f-998c-cd3bb2561e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:59.121167 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41aa32c-d784-497f-998c-cd3bb2561e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:59.121558 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41aa32c-d784-497f-998c-cd3bb2561e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:59.126247 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41aa32c-d784-497f-998c-cd3bb2561e9e admin admin] PATH_INFO: `/v3/projects/3173dfd0947546208491d172b9e6bfee` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:59.126247 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41aa32c-d784-497f-998c-cd3bb2561e9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3173dfd0947546208491d172b9e6bfee)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:59.126247 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41aa32c-d784-497f-998c-cd3bb2561e9e admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:59.237957 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1089/2181] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:58:58 2022] POST /identity/v3/projects => generated 366 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:58:59.241762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b690a-92bd-439b-8337-40c211f94dd5 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:59.315555 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c41aa32c-d784-497f-998c-cd3bb2561e9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3173dfd0947546208491d172b9e6bfee', 'request_id': 'req-c41aa32c-d784-497f-998c-cd3bb2561e9e'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:59.317237 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b690a-92bd-439b-8337-40c211f94dd5 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:59.322803 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c41aa32c-d784-497f-998c-cd3bb2561e9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3173dfd0947546208491d172b9e6bfee', 'request_id': 'req-c41aa32c-d784-497f-998c-cd3bb2561e9e'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:59.374362 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c41aa32c-d784-497f-998c-cd3bb2561e9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3173dfd0947546208491d172b9e6bfee', 'request_id': 'req-c41aa32c-d784-497f-998c-cd3bb2561e9e'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:59.378510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39bcaa-29b9-4e1a-8204-866e250ea45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:59.385988 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39bcaa-29b9-4e1a-8204-866e250ea45c admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:59.385988 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39bcaa-29b9-4e1a-8204-866e250ea45c admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:59.385988 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39bcaa-29b9-4e1a-8204-866e250ea45c admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:59.385988 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39bcaa-29b9-4e1a-8204-866e250ea45c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:59.385988 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39bcaa-29b9-4e1a-8204-866e250ea45c admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:59.386609 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c41aa32c-d784-497f-998c-cd3bb2561e9e admin admin] The token cache is being invalidate because project 3173dfd0947546208491d172b9e6bfee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:58:59.386904 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c41aa32c-d784-497f-998c-cd3bb2561e9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:59.387567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c41aa32c-d784-497f-998c-cd3bb2561e9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:59.389330 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1093/2182] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:58:59 2022] DELETE /identity/v3/projects/3173dfd0947546208491d172b9e6bfee => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:58:59.389994 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:59.393225 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41aa32c-d784-497f-998c-cd3bb2561e9e admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:59.394605 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-c41aa32c-d784-497f-998c-cd3bb2561e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:59.410233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41aa32c-d784-497f-998c-cd3bb2561e9e admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:59.415483 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441c542-6b45-4213-839c-283122b52385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:59.416405 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441c542-6b45-4213-839c-283122b52385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:59.416691 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441c542-6b45-4213-839c-283122b52385 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:59.416970 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441c542-6b45-4213-839c-283122b52385 admin admin] PATH_INFO: `/v3/users/530e0d89d46c4dd3951e3299a5953da8` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:59.418180 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441c542-6b45-4213-839c-283122b52385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=530e0d89d46c4dd3951e3299a5953da8)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:59.420166 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441c542-6b45-4213-839c-283122b52385 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:59.489031 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1090/2183] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:58:59 2022] POST /identity/v3/users => generated 290 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:58:59.493682 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39bcaa-29b9-4e1a-8204-866e250ea45c admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:59.495381 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-ab39bcaa-29b9-4e1a-8204-866e250ea45c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:59.506925 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39bcaa-29b9-4e1a-8204-866e250ea45c admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:59.513313 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2febf-eaf4-47a2-98ea-2fb200bf377c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:59.513825 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2febf-eaf4-47a2-98ea-2fb200bf377c admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:59.514112 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2febf-eaf4-47a2-98ea-2fb200bf377c admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:59.515621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2febf-eaf4-47a2-98ea-2fb200bf377c admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:59.515621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2febf-eaf4-47a2-98ea-2fb200bf377c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:59.516751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2febf-eaf4-47a2-98ea-2fb200bf377c admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:59.527257 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1091/2184] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:59 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:58:59.531581 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2febf-eaf4-47a2-98ea-2fb200bf377c admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:59.542346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2febf-eaf4-47a2-98ea-2fb200bf377c admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:59.547653 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce5174-337e-4711-907e-044197973cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:59.548715 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce5174-337e-4711-907e-044197973cb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:59.549000 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce5174-337e-4711-907e-044197973cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:59.549288 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce5174-337e-4711-907e-044197973cb6 admin admin] PATH_INFO: `/v3/projects/9f943f12b88a44e8b78ec9735a0d3c64/users/175bb815305e4bff84ff3fbf71ad60d8/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:59.566000 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce5174-337e-4711-907e-044197973cb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f943f12b88a44e8b78ec9735a0d3c64, user_id=175bb815305e4bff84ff3fbf71ad60d8, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:59.568812 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce5174-337e-4711-907e-044197973cb6 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:59.753964 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1092/2185] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:58:59 2022] PUT /identity/v3/projects/9f943f12b88a44e8b78ec9735a0d3c64/users/175bb815305e4bff84ff3fbf71ad60d8/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:58:59.757795 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce5174-337e-4711-907e-044197973cb6 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:59.768747 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-d441c542-6b45-4213-839c-283122b52385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '530e0d89d46c4dd3951e3299a5953da8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:59.782260 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-d441c542-6b45-4213-839c-283122b52385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '530e0d89d46c4dd3951e3299a5953da8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:59.791130 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-d441c542-6b45-4213-839c-283122b52385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '530e0d89d46c4dd3951e3299a5953da8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:59.791870 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-d441c542-6b45-4213-839c-283122b52385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '530e0d89d46c4dd3951e3299a5953da8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:59.827990 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce5174-337e-4711-907e-044197973cb6 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:59.832653 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f07044-5083-4db8-941f-7b1226cac059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:59.833326 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f07044-5083-4db8-941f-7b1226cac059 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:59.833613 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f07044-5083-4db8-941f-7b1226cac059 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:59.834175 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f07044-5083-4db8-941f-7b1226cac059 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:59.834910 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f07044-5083-4db8-941f-7b1226cac059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:59.837454 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f07044-5083-4db8-941f-7b1226cac059 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:59.847800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1093/2186] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:58:59 2022] GET /identity/v3/roles => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:58:59.852605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f07044-5083-4db8-941f-7b1226cac059 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:59.860728 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-48f07044-5083-4db8-941f-7b1226cac059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:59.867198 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f07044-5083-4db8-941f-7b1226cac059 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:59.872301 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00976039-3c44-4173-9864-2a77a2a04283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:59.873198 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00976039-3c44-4173-9864-2a77a2a04283 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:59.873491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00976039-3c44-4173-9864-2a77a2a04283 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:59.873782 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00976039-3c44-4173-9864-2a77a2a04283 admin admin] PATH_INFO: `/v3/projects/9f943f12b88a44e8b78ec9735a0d3c64/users/175bb815305e4bff84ff3fbf71ad60d8/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:59.875829 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00976039-3c44-4173-9864-2a77a2a04283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f943f12b88a44e8b78ec9735a0d3c64, user_id=175bb815305e4bff84ff3fbf71ad60d8, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:59.878509 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00976039-3c44-4173-9864-2a77a2a04283 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:59.891783 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1094/2187] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:58:59 2022] PUT /identity/v3/projects/9f943f12b88a44e8b78ec9735a0d3c64/users/175bb815305e4bff84ff3fbf71ad60d8/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:58:59.903531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5fe38-11b1-42a6-ba39-1fc7a6221801 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:59.903830 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5fe38-11b1-42a6-ba39-1fc7a6221801 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:59.904190 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5fe38-11b1-42a6-ba39-1fc7a6221801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:59.932862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-d0a5fe38-11b1-42a6-ba39-1fc7a6221801 None None] MFA Rules not processed for user `175bb815305e4bff84ff3fbf71ad60d8`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:58:59.934084 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-d0a5fe38-11b1-42a6-ba39-1fc7a6221801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:59.939821 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-d441c542-6b45-4213-839c-283122b52385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '530e0d89d46c4dd3951e3299a5953da8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:58:59.946694 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1094/2188] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:58:59 2022] DELETE /identity/v3/users/530e0d89d46c4dd3951e3299a5953da8 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:59:00.022195 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1095/2189] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:58:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:59:00.034334 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441c542-6b45-4213-839c-283122b52385 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:00.035744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-d441c542-6b45-4213-839c-283122b52385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:00.064728 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:00.097946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441c542-6b45-4213-839c-283122b52385 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:00.103024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1bb7b-8b6d-4bf0-981f-5235f8454865 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:00.103944 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1bb7b-8b6d-4bf0-981f-5235f8454865 service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:00.104350 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1bb7b-8b6d-4bf0-981f-5235f8454865 service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:00.104688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1bb7b-8b6d-4bf0-981f-5235f8454865 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:00.172609 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1bb7b-8b6d-4bf0-981f-5235f8454865 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:00.174131 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1bb7b-8b6d-4bf0-981f-5235f8454865 service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:00.185490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1095/2190] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:59:00 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:59:00.368852 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5fe38-11b1-42a6-ba39-1fc7a6221801 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:00.369275 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-d0a5fe38-11b1-42a6-ba39-1fc7a6221801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:00.418270 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:00.422022 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1bb7b-8b6d-4bf0-981f-5235f8454865 service cinder] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:00.423702 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-fcc1bb7b-8b6d-4bf0-981f-5235f8454865 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:00.468719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5fe38-11b1-42a6-ba39-1fc7a6221801 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:00.472577 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4d453-88fd-4511-9d01-44d496050d7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:00.473240 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4d453-88fd-4511-9d01-44d496050d7e service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:00.473529 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4d453-88fd-4511-9d01-44d496050d7e service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:00.473873 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4d453-88fd-4511-9d01-44d496050d7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:00.475865 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-2de4d453-88fd-4511-9d01-44d496050d7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:00.534238 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1bb7b-8b6d-4bf0-981f-5235f8454865 service cinder] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:00.539039 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15643618-2d1f-45d2-8115-291487f61d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:00.540860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15643618-2d1f-45d2-8115-291487f61d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:00.541296 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15643618-2d1f-45d2-8115-291487f61d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:00.541586 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15643618-2d1f-45d2-8115-291487f61d7f admin admin] PATH_INFO: `/v3/projects/5a9ef299ac88435195ad2b3db042140b` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:00.543709 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15643618-2d1f-45d2-8115-291487f61d7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a9ef299ac88435195ad2b3db042140b)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:00.551547 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15643618-2d1f-45d2-8115-291487f61d7f admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:00.572868 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4d453-88fd-4511-9d01-44d496050d7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:00.574429 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4d453-88fd-4511-9d01-44d496050d7e service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:00.585167 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1096/2191] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:59:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:59:00.686362 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-15643618-2d1f-45d2-8115-291487f61d7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a9ef299ac88435195ad2b3db042140b', 'request_id': 'req-15643618-2d1f-45d2-8115-291487f61d7f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:00.692426 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-15643618-2d1f-45d2-8115-291487f61d7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a9ef299ac88435195ad2b3db042140b', 'request_id': 'req-15643618-2d1f-45d2-8115-291487f61d7f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:00.768506 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-15643618-2d1f-45d2-8115-291487f61d7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a9ef299ac88435195ad2b3db042140b', 'request_id': 'req-15643618-2d1f-45d2-8115-291487f61d7f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:00.780910 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-15643618-2d1f-45d2-8115-291487f61d7f admin admin] The token cache is being invalidate because project 5a9ef299ac88435195ad2b3db042140b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:59:00.781519 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-15643618-2d1f-45d2-8115-291487f61d7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:00.781775 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-15643618-2d1f-45d2-8115-291487f61d7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:00.783376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1096/2192] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:59:00 2022] DELETE /identity/v3/projects/5a9ef299ac88435195ad2b3db042140b => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:59:00.790784 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c785bb-4237-477b-9a11-4acf5c417029 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:00.791076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c785bb-4237-477b-9a11-4acf5c417029 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:00.791356 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c785bb-4237-477b-9a11-4acf5c417029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:00.809065 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-f1c785bb-4237-477b-9a11-4acf5c417029 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:00.810289 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f1c785bb-4237-477b-9a11-4acf5c417029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:00.847380 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15643618-2d1f-45d2-8115-291487f61d7f admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:00.849780 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-15643618-2d1f-45d2-8115-291487f61d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:00.870097 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1097/2193] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:59:00.879967 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bd53e-2613-4930-b61c-8d00e1d905a1 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:00.880320 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bd53e-2613-4930-b61c-8d00e1d905a1 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:00.880603 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bd53e-2613-4930-b61c-8d00e1d905a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:00.899305 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-429bd53e-2613-4930-b61c-8d00e1d905a1 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:00.900511 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-429bd53e-2613-4930-b61c-8d00e1d905a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:00.908732 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1098/2194] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:59:00.913553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15643618-2d1f-45d2-8115-291487f61d7f admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:00.915347 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4eb93c-2721-42aa-b1ee-b58aa9965c68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:00.916086 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4eb93c-2721-42aa-b1ee-b58aa9965c68 service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:00.916402 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4eb93c-2721-42aa-b1ee-b58aa9965c68 service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:00.916688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4eb93c-2721-42aa-b1ee-b58aa9965c68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:00.917178 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bd53e-2613-4930-b61c-8d00e1d905a1 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:00.919103 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-ea4eb93c-2721-42aa-b1ee-b58aa9965c68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:00.926239 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bd53e-2613-4930-b61c-8d00e1d905a1 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:00.931696 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a9a98-4e60-4ad2-a90b-609565e7adb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:00.932567 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a9a98-4e60-4ad2-a90b-609565e7adb7 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:00.933100 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a9a98-4e60-4ad2-a90b-609565e7adb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:00.933441 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a9a98-4e60-4ad2-a90b-609565e7adb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:00.934184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a9a98-4e60-4ad2-a90b-609565e7adb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:59:00.934499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a9a98-4e60-4ad2-a90b-609565e7adb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:00.936125 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a9a98-4e60-4ad2-a90b-609565e7adb7 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:00.950845 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1099/2195] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:59:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:59:00.955146 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a9a98-4e60-4ad2-a90b-609565e7adb7 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:00.968012 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a9a98-4e60-4ad2-a90b-609565e7adb7 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:00.972999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc417dc-7536-4d0c-bdaf-d1e52c77cabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:00.973662 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc417dc-7536-4d0c-bdaf-d1e52c77cabe admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:00.973961 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc417dc-7536-4d0c-bdaf-d1e52c77cabe admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:00.974235 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc417dc-7536-4d0c-bdaf-d1e52c77cabe admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:00.974932 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc417dc-7536-4d0c-bdaf-d1e52c77cabe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:00.976938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc417dc-7536-4d0c-bdaf-d1e52c77cabe admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:00.991985 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4eb93c-2721-42aa-b1ee-b58aa9965c68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:00.993512 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4eb93c-2721-42aa-b1ee-b58aa9965c68 service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:01.002793 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1097/2196] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:59:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:59:01.095482 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1100/2197] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:59:00 2022] POST /identity/v3/projects => generated 370 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:59:01.100626 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4eb93c-2721-42aa-b1ee-b58aa9965c68 service cinder] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:01.113945 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4eb93c-2721-42aa-b1ee-b58aa9965c68 service cinder] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:01.176471 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde53d9d-4211-4a40-8f04-85dc3a50831d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:01.177159 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde53d9d-4211-4a40-8f04-85dc3a50831d admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:01.177450 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde53d9d-4211-4a40-8f04-85dc3a50831d admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:01.177735 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde53d9d-4211-4a40-8f04-85dc3a50831d admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:01.178439 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde53d9d-4211-4a40-8f04-85dc3a50831d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:01.180366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde53d9d-4211-4a40-8f04-85dc3a50831d admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:01.315881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1098/2198] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:59:01 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:59:01.323491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc417dc-7536-4d0c-bdaf-d1e52c77cabe admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:01.331953 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc417dc-7536-4d0c-bdaf-d1e52c77cabe admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:01.337170 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a12c4-3b24-4363-bdff-6a03623362cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:01.338005 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a12c4-3b24-4363-bdff-6a03623362cb admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:01.338423 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a12c4-3b24-4363-bdff-6a03623362cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:01.338789 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a12c4-3b24-4363-bdff-6a03623362cb admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:01.339897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a12c4-3b24-4363-bdff-6a03623362cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:01.342102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a12c4-3b24-4363-bdff-6a03623362cb admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:01.346455 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:01.356334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1101/2199] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:59:01 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:59:01.360337 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde53d9d-4211-4a40-8f04-85dc3a50831d admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:01.370869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde53d9d-4211-4a40-8f04-85dc3a50831d admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:01.375563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef989a9-2090-4dc6-823e-f15dbb99519f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:01.376273 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef989a9-2090-4dc6-823e-f15dbb99519f admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:01.376645 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef989a9-2090-4dc6-823e-f15dbb99519f admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:01.376923 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef989a9-2090-4dc6-823e-f15dbb99519f admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:01.377694 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef989a9-2090-4dc6-823e-f15dbb99519f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:01.379391 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef989a9-2090-4dc6-823e-f15dbb99519f admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:01.390128 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1099/2200] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:59:01 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:59:01.395147 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a12c4-3b24-4363-bdff-6a03623362cb admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:01.405532 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a12c4-3b24-4363-bdff-6a03623362cb admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:01.409992 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5764d7c-3c02-4706-8f6e-98a8fba12e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:01.410867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5764d7c-3c02-4706-8f6e-98a8fba12e70 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:01.411153 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5764d7c-3c02-4706-8f6e-98a8fba12e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:01.411431 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5764d7c-3c02-4706-8f6e-98a8fba12e70 admin admin] PATH_INFO: `/v3/projects/20273ad34b38492a971b8750ba13ed9a/users/5208d172cd594340b81a1a3c39f4e7b8/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:01.426000 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5764d7c-3c02-4706-8f6e-98a8fba12e70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20273ad34b38492a971b8750ba13ed9a, user_id=5208d172cd594340b81a1a3c39f4e7b8, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:01.428673 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5764d7c-3c02-4706-8f6e-98a8fba12e70 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:01.435356 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:01.575501 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1102/2201] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:59:01 2022] PUT /identity/v3/projects/20273ad34b38492a971b8750ba13ed9a/users/5208d172cd594340b81a1a3c39f4e7b8/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:01.587442 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320c5f0-819c-4ec0-8f45-6127b153e5a0 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:01.587738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320c5f0-819c-4ec0-8f45-6127b153e5a0 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:01.588024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320c5f0-819c-4ec0-8f45-6127b153e5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:01.614350 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-c320c5f0-819c-4ec0-8f45-6127b153e5a0 None None] MFA Rules not processed for user `5208d172cd594340b81a1a3c39f4e7b8`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:01.615243 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-c320c5f0-819c-4ec0-8f45-6127b153e5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:01.683963 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1100/2202] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:59:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:59:01.695372 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5764d7c-3c02-4706-8f6e-98a8fba12e70 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:01.752879 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5764d7c-3c02-4706-8f6e-98a8fba12e70 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:01.756685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac1637-6acb-4421-9f2a-afd90ca7cbf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:01.757340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac1637-6acb-4421-9f2a-afd90ca7cbf5 service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:01.757648 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac1637-6acb-4421-9f2a-afd90ca7cbf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:01.757914 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac1637-6acb-4421-9f2a-afd90ca7cbf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:01.767215 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac1637-6acb-4421-9f2a-afd90ca7cbf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:01.768701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac1637-6acb-4421-9f2a-afd90ca7cbf5 service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:01.778472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1103/2203] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:59:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:59:01.802744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320c5f0-819c-4ec0-8f45-6127b153e5a0 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:01.864816 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320c5f0-819c-4ec0-8f45-6127b153e5a0 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:01.870561 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52ed6d-08bb-4c25-a8ad-75ea100696bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:01.871440 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52ed6d-08bb-4c25-a8ad-75ea100696bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:01.871722 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52ed6d-08bb-4c25-a8ad-75ea100696bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:01.871998 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52ed6d-08bb-4c25-a8ad-75ea100696bc admin admin] PATH_INFO: `/v3/users/5208d172cd594340b81a1a3c39f4e7b8` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:01.873225 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52ed6d-08bb-4c25-a8ad-75ea100696bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5208d172cd594340b81a1a3c39f4e7b8)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:01.875212 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52ed6d-08bb-4c25-a8ad-75ea100696bc admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:02.171183 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-5d52ed6d-08bb-4c25-a8ad-75ea100696bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5208d172cd594340b81a1a3c39f4e7b8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:02.183373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-5d52ed6d-08bb-4c25-a8ad-75ea100696bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5208d172cd594340b81a1a3c39f4e7b8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:02.190098 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-5d52ed6d-08bb-4c25-a8ad-75ea100696bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5208d172cd594340b81a1a3c39f4e7b8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:02.190782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-5d52ed6d-08bb-4c25-a8ad-75ea100696bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5208d172cd594340b81a1a3c39f4e7b8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:02.294659 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-5d52ed6d-08bb-4c25-a8ad-75ea100696bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5208d172cd594340b81a1a3c39f4e7b8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:02.301481 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1101/2204] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:59:01 2022] DELETE /identity/v3/users/5208d172cd594340b81a1a3c39f4e7b8 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:02.305842 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55851fd1-f48c-4e07-8fe4-46862333e73c None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:02.306463 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55851fd1-f48c-4e07-8fe4-46862333e73c None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:02.306580 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55851fd1-f48c-4e07-8fe4-46862333e73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:02.324905 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-55851fd1-f48c-4e07-8fe4-46862333e73c None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:02.326149 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-55851fd1-f48c-4e07-8fe4-46862333e73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:02.392509 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1104/2205] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:59:02.403067 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52ed6d-08bb-4c25-a8ad-75ea100696bc admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:02.404588 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-5d52ed6d-08bb-4c25-a8ad-75ea100696bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:02.465245 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52ed6d-08bb-4c25-a8ad-75ea100696bc admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:02.469423 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab914c47-1416-43a8-bc7a-8fe88c73e748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:02.470076 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab914c47-1416-43a8-bc7a-8fe88c73e748 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:02.470364 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab914c47-1416-43a8-bc7a-8fe88c73e748 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:02.470646 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab914c47-1416-43a8-bc7a-8fe88c73e748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:02.481373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab914c47-1416-43a8-bc7a-8fe88c73e748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:02.484262 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:02.485165 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab914c47-1416-43a8-bc7a-8fe88c73e748 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:02.497325 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1102/2206] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:59:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:59:03.129866 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55851fd1-f48c-4e07-8fe4-46862333e73c None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:03.131461 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-55851fd1-f48c-4e07-8fe4-46862333e73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:03.147029 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55851fd1-f48c-4e07-8fe4-46862333e73c None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:03.152750 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb985cc0-ba81-4d98-a6cd-cfde8480d7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:03.153650 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb985cc0-ba81-4d98-a6cd-cfde8480d7c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:03.153937 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb985cc0-ba81-4d98-a6cd-cfde8480d7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:03.154219 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb985cc0-ba81-4d98-a6cd-cfde8480d7c4 admin admin] PATH_INFO: `/v3/projects/20273ad34b38492a971b8750ba13ed9a` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:03.155420 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb985cc0-ba81-4d98-a6cd-cfde8480d7c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20273ad34b38492a971b8750ba13ed9a)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:03.157881 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb985cc0-ba81-4d98-a6cd-cfde8480d7c4 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:03.294739 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:03.353045 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-cb985cc0-ba81-4d98-a6cd-cfde8480d7c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20273ad34b38492a971b8750ba13ed9a', 'request_id': 'req-cb985cc0-ba81-4d98-a6cd-cfde8480d7c4'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:03.360431 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-cb985cc0-ba81-4d98-a6cd-cfde8480d7c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20273ad34b38492a971b8750ba13ed9a', 'request_id': 'req-cb985cc0-ba81-4d98-a6cd-cfde8480d7c4'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:03.366567 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-cb985cc0-ba81-4d98-a6cd-cfde8480d7c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20273ad34b38492a971b8750ba13ed9a', 'request_id': 'req-cb985cc0-ba81-4d98-a6cd-cfde8480d7c4'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:03.540492 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-cb985cc0-ba81-4d98-a6cd-cfde8480d7c4 admin admin] The token cache is being invalidate because project 20273ad34b38492a971b8750ba13ed9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:59:03.540793 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-cb985cc0-ba81-4d98-a6cd-cfde8480d7c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:03.541579 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-cb985cc0-ba81-4d98-a6cd-cfde8480d7c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:03.543761 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1105/2207] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:59:03 2022] DELETE /identity/v3/projects/20273ad34b38492a971b8750ba13ed9a => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:03.548804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c585c2a-e82f-4600-b034-438b4ef08be2 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:03.549101 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c585c2a-e82f-4600-b034-438b4ef08be2 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:03.549387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c585c2a-e82f-4600-b034-438b4ef08be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:03.569999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-0c585c2a-e82f-4600-b034-438b4ef08be2 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:03.570785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-0c585c2a-e82f-4600-b034-438b4ef08be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:03.651422 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1103/2208] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:59:03.659462 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3c9b9-153a-493b-b215-93c12bb3542d None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:03.660014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3c9b9-153a-493b-b215-93c12bb3542d None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:03.660435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3c9b9-153a-493b-b215-93c12bb3542d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:03.691099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-62d3c9b9-153a-493b-b215-93c12bb3542d None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:03.691099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-62d3c9b9-153a-493b-b215-93c12bb3542d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:03.693335 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1106/2209] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:59:03.698890 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c585c2a-e82f-4600-b034-438b4ef08be2 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:03.709562 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c585c2a-e82f-4600-b034-438b4ef08be2 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:03.716452 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4eb7c6-b27b-47ef-bfa9-a035baa3c302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:03.717017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4eb7c6-b27b-47ef-bfa9-a035baa3c302 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:03.717331 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4eb7c6-b27b-47ef-bfa9-a035baa3c302 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:03.717560 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4eb7c6-b27b-47ef-bfa9-a035baa3c302 admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:03.718314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4eb7c6-b27b-47ef-bfa9-a035baa3c302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:59:03.718617 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4eb7c6-b27b-47ef-bfa9-a035baa3c302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:03.720525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4eb7c6-b27b-47ef-bfa9-a035baa3c302 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:03.743112 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1104/2210] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:59:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:59:03.744369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3c9b9-153a-493b-b215-93c12bb3542d None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:03.753941 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3c9b9-153a-493b-b215-93c12bb3542d None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:03.759043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e7e01-8453-4ea4-991f-6cf960d41d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:03.759726 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e7e01-8453-4ea4-991f-6cf960d41d42 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:03.760019 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e7e01-8453-4ea4-991f-6cf960d41d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:03.760338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e7e01-8453-4ea4-991f-6cf960d41d42 admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:03.761049 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e7e01-8453-4ea4-991f-6cf960d41d42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:03.763054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e7e01-8453-4ea4-991f-6cf960d41d42 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:03.777856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:03.890774 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1107/2211] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:59:03 2022] POST /identity/v3/projects => generated 386 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:59:03.895275 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4eb7c6-b27b-47ef-bfa9-a035baa3c302 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:03.905828 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4eb7c6-b27b-47ef-bfa9-a035baa3c302 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:03.968657 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c3b72-5df2-4675-bb17-7faf5d7c8f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:03.969342 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c3b72-5df2-4675-bb17-7faf5d7c8f6e admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:03.969635 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c3b72-5df2-4675-bb17-7faf5d7c8f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:03.969923 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c3b72-5df2-4675-bb17-7faf5d7c8f6e admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:03.970634 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c3b72-5df2-4675-bb17-7faf5d7c8f6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:03.972632 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c3b72-5df2-4675-bb17-7faf5d7c8f6e admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:04.078448 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1105/2212] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:59:03 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:59:04.082753 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e7e01-8453-4ea4-991f-6cf960d41d42 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:04.094679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e7e01-8453-4ea4-991f-6cf960d41d42 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:04.099399 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4f182-c9be-47a2-9c1f-1775caaa7aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:04.100135 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4f182-c9be-47a2-9c1f-1775caaa7aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:04.100739 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4f182-c9be-47a2-9c1f-1775caaa7aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:04.101326 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4f182-c9be-47a2-9c1f-1775caaa7aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:04.102466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4f182-c9be-47a2-9c1f-1775caaa7aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:04.111145 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4f182-c9be-47a2-9c1f-1775caaa7aa4 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:04.115130 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1108/2213] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:59:04 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:59:04.119142 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c3b72-5df2-4675-bb17-7faf5d7c8f6e admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:04.129511 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c3b72-5df2-4675-bb17-7faf5d7c8f6e admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:04.135128 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d62d89-fc4e-48cf-8058-58fc04997c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:04.135798 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d62d89-fc4e-48cf-8058-58fc04997c28 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:04.136151 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d62d89-fc4e-48cf-8058-58fc04997c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:04.136443 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d62d89-fc4e-48cf-8058-58fc04997c28 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:04.137279 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d62d89-fc4e-48cf-8058-58fc04997c28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:04.138880 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d62d89-fc4e-48cf-8058-58fc04997c28 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:04.149992 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1106/2214] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:59:04 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:59:04.163591 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4f182-c9be-47a2-9c1f-1775caaa7aa4 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:04.173714 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4f182-c9be-47a2-9c1f-1775caaa7aa4 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:04.178230 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bdddf-038b-4279-9e6a-9b930eb7a838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:04.179154 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bdddf-038b-4279-9e6a-9b930eb7a838 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:04.179452 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bdddf-038b-4279-9e6a-9b930eb7a838 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:04.179722 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bdddf-038b-4279-9e6a-9b930eb7a838 admin admin] PATH_INFO: `/v3/projects/cffc3cae7b014c62b9b58207cb7ef3aa/users/aad6767795b0402cb72f249b4c3a8039/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:04.194164 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bdddf-038b-4279-9e6a-9b930eb7a838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cffc3cae7b014c62b9b58207cb7ef3aa, user_id=aad6767795b0402cb72f249b4c3a8039, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:04.197394 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bdddf-038b-4279-9e6a-9b930eb7a838 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:04.283455 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1109/2215] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:59:04 2022] PUT /identity/v3/projects/cffc3cae7b014c62b9b58207cb7ef3aa/users/aad6767795b0402cb72f249b4c3a8039/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:04.288638 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979143e5-4cf2-4d7b-9141-4623b6c8fa77 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:04.288940 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979143e5-4cf2-4d7b-9141-4623b6c8fa77 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:04.289230 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979143e5-4cf2-4d7b-9141-4623b6c8fa77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:04.308584 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-979143e5-4cf2-4d7b-9141-4623b6c8fa77 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:04.309827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-979143e5-4cf2-4d7b-9141-4623b6c8fa77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:04.356850 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:04.369728 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1107/2216] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:59:04.379312 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bdddf-038b-4279-9e6a-9b930eb7a838 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:04.381147 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-2d3bdddf-038b-4279-9e6a-9b930eb7a838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:04.438355 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bdddf-038b-4279-9e6a-9b930eb7a838 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:04.441950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c165c-cbc4-4829-8a76-aaf15054002e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:04.442595 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c165c-cbc4-4829-8a76-aaf15054002e service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:04.442888 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c165c-cbc4-4829-8a76-aaf15054002e service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:04.443169 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c165c-cbc4-4829-8a76-aaf15054002e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:04.452927 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c165c-cbc4-4829-8a76-aaf15054002e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:04.459341 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c165c-cbc4-4829-8a76-aaf15054002e service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:04.464349 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1110/2217] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:59:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:59:08.556234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979143e5-4cf2-4d7b-9141-4623b6c8fa77 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:08.558914 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-979143e5-4cf2-4d7b-9141-4623b6c8fa77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:08.569962 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979143e5-4cf2-4d7b-9141-4623b6c8fa77 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:08.576257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a6a93-2d90-4147-84b1-98a748b587ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:08.577281 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a6a93-2d90-4147-84b1-98a748b587ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:08.577575 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a6a93-2d90-4147-84b1-98a748b587ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:08.577916 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a6a93-2d90-4147-84b1-98a748b587ed admin admin] PATH_INFO: `/v3/users/53c93f2c53874852b84a2a4571ecc311` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:08.579563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a6a93-2d90-4147-84b1-98a748b587ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=53c93f2c53874852b84a2a4571ecc311)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:08.581583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a6a93-2d90-4147-84b1-98a748b587ed admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:08.848981 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c03a6a93-2d90-4147-84b1-98a748b587ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53c93f2c53874852b84a2a4571ecc311'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:08.893965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c03a6a93-2d90-4147-84b1-98a748b587ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53c93f2c53874852b84a2a4571ecc311'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:08.912088 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c03a6a93-2d90-4147-84b1-98a748b587ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53c93f2c53874852b84a2a4571ecc311'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:08.914103 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c03a6a93-2d90-4147-84b1-98a748b587ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53c93f2c53874852b84a2a4571ecc311'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:09.037570 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c03a6a93-2d90-4147-84b1-98a748b587ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53c93f2c53874852b84a2a4571ecc311'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:09.044646 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1108/2218] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:59:08 2022] DELETE /identity/v3/users/53c93f2c53874852b84a2a4571ecc311 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:09.049771 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4db4a1-01f6-46bb-a1e1-9832b9cc6850 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:09.061783 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4db4a1-01f6-46bb-a1e1-9832b9cc6850 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:09.061783 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4db4a1-01f6-46bb-a1e1-9832b9cc6850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:09.070038 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-7d4db4a1-01f6-46bb-a1e1-9832b9cc6850 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:09.071928 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-7d4db4a1-01f6-46bb-a1e1-9832b9cc6850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:09.152353 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1111/2219] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:59:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:59:09.158960 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a6a93-2d90-4147-84b1-98a748b587ed admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:09.160262 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-c03a6a93-2d90-4147-84b1-98a748b587ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:09.276064 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a6a93-2d90-4147-84b1-98a748b587ed admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:09.281197 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d61dc-236c-4f08-ba1d-94170d270692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:09.281867 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d61dc-236c-4f08-ba1d-94170d270692 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:09.282156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d61dc-236c-4f08-ba1d-94170d270692 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:09.282437 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d61dc-236c-4f08-ba1d-94170d270692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:09.293185 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d61dc-236c-4f08-ba1d-94170d270692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:09.294626 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d61dc-236c-4f08-ba1d-94170d270692 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:09.306701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1109/2220] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:59:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:59:10.222951 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4db4a1-01f6-46bb-a1e1-9832b9cc6850 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:10.224474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-7d4db4a1-01f6-46bb-a1e1-9832b9cc6850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:10.244852 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4db4a1-01f6-46bb-a1e1-9832b9cc6850 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:10.266177 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a947417-d647-4a26-b5ca-11bb148c9c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:10.267337 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a947417-d647-4a26-b5ca-11bb148c9c19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:10.267777 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a947417-d647-4a26-b5ca-11bb148c9c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:10.268450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a947417-d647-4a26-b5ca-11bb148c9c19 admin admin] PATH_INFO: `/v3/projects/4a08d3a5aee344c8a8b80911f995e6b7` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:10.272189 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a947417-d647-4a26-b5ca-11bb148c9c19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a08d3a5aee344c8a8b80911f995e6b7)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:10.277419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a947417-d647-4a26-b5ca-11bb148c9c19 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:10.475313 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9a947417-d647-4a26-b5ca-11bb148c9c19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a08d3a5aee344c8a8b80911f995e6b7', 'request_id': 'req-9a947417-d647-4a26-b5ca-11bb148c9c19'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:10.489898 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9a947417-d647-4a26-b5ca-11bb148c9c19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a08d3a5aee344c8a8b80911f995e6b7', 'request_id': 'req-9a947417-d647-4a26-b5ca-11bb148c9c19'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:10.502867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:INSERT=2,keystone:SELECT=93,keystone:DELETE=5 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:10.512504 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9a947417-d647-4a26-b5ca-11bb148c9c19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a08d3a5aee344c8a8b80911f995e6b7', 'request_id': 'req-9a947417-d647-4a26-b5ca-11bb148c9c19'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:10.580550 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9a947417-d647-4a26-b5ca-11bb148c9c19 admin admin] The token cache is being invalidate because project 4a08d3a5aee344c8a8b80911f995e6b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:59:10.580850 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9a947417-d647-4a26-b5ca-11bb148c9c19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:10.581534 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-9a947417-d647-4a26-b5ca-11bb148c9c19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:10.583582 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1112/2221] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:59:10 2022] DELETE /identity/v3/projects/4a08d3a5aee344c8a8b80911f995e6b7 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:10.589327 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d61dc-236c-4f08-ba1d-94170d270692 service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:10.600404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d61dc-236c-4f08-ba1d-94170d270692 service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:10.685238 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c4fae-b494-4451-98d7-8264f1cd02ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:10.686162 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c4fae-b494-4451-98d7-8264f1cd02ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:10.686552 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c4fae-b494-4451-98d7-8264f1cd02ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:10.686892 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c4fae-b494-4451-98d7-8264f1cd02ab admin admin] PATH_INFO: `/v3/users/e36869f56a23425088b7c56837a2679f` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:10.688376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c4fae-b494-4451-98d7-8264f1cd02ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=e36869f56a23425088b7c56837a2679f)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:10.690334 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c4fae-b494-4451-98d7-8264f1cd02ab admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:10.704010 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:10.935709 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-291c4fae-b494-4451-98d7-8264f1cd02ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e36869f56a23425088b7c56837a2679f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:10.966623 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c8524-6873-4018-bada-c77b0e53a8ff None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:10.966623 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c8524-6873-4018-bada-c77b0e53a8ff None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:10.966623 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c8524-6873-4018-bada-c77b0e53a8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:10.974913 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-291c4fae-b494-4451-98d7-8264f1cd02ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e36869f56a23425088b7c56837a2679f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:10.986344 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-291c4fae-b494-4451-98d7-8264f1cd02ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e36869f56a23425088b7c56837a2679f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:10.987309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-291c4fae-b494-4451-98d7-8264f1cd02ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e36869f56a23425088b7c56837a2679f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:11.002068 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-833c8524-6873-4018-bada-c77b0e53a8ff None None] MFA Rules not processed for user `aad6767795b0402cb72f249b4c3a8039`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:11.003357 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-833c8524-6873-4018-bada-c77b0e53a8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:11.074523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1113/2222] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:59:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:59:11.079299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c8524-6873-4018-bada-c77b0e53a8ff None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:11.080684 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-833c8524-6873-4018-bada-c77b0e53a8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:11.088459 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-291c4fae-b494-4451-98d7-8264f1cd02ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e36869f56a23425088b7c56837a2679f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:11.095501 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1110/2223] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:59:10 2022] DELETE /identity/v3/users/e36869f56a23425088b7c56837a2679f => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:11.096497 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c8524-6873-4018-bada-c77b0e53a8ff None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:11.165335 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab05566-5fa0-49b6-b41a-d15266d89e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:11.166312 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab05566-5fa0-49b6-b41a-d15266d89e80 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:11.166806 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab05566-5fa0-49b6-b41a-d15266d89e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:11.167166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab05566-5fa0-49b6-b41a-d15266d89e80 admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:11.168281 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab05566-5fa0-49b6-b41a-d15266d89e80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:11.170388 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab05566-5fa0-49b6-b41a-d15266d89e80 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:11.251071 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1114/2224] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:59:11 2022] POST /identity/v3/projects => generated 386 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:59:11.255286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c4fae-b494-4451-98d7-8264f1cd02ab admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:11.266093 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c4fae-b494-4451-98d7-8264f1cd02ab admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:11.329355 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa2aa2-5e74-439f-b816-6e111387fbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:11.330053 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa2aa2-5e74-439f-b816-6e111387fbb0 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:11.330343 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa2aa2-5e74-439f-b816-6e111387fbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:11.330641 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa2aa2-5e74-439f-b816-6e111387fbb0 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:11.331333 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa2aa2-5e74-439f-b816-6e111387fbb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:11.333496 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa2aa2-5e74-439f-b816-6e111387fbb0 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:11.548688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1111/2225] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:59:11 2022] POST /identity/v3/users => generated 300 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:59:11.552184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab05566-5fa0-49b6-b41a-d15266d89e80 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:11.565500 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab05566-5fa0-49b6-b41a-d15266d89e80 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:11.571067 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae40ce2-945b-456b-8382-2b3701e9ec25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:11.572524 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae40ce2-945b-456b-8382-2b3701e9ec25 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:11.572778 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae40ce2-945b-456b-8382-2b3701e9ec25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:11.573060 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae40ce2-945b-456b-8382-2b3701e9ec25 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:11.573810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae40ce2-945b-456b-8382-2b3701e9ec25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:11.575404 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae40ce2-945b-456b-8382-2b3701e9ec25 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:11.591648 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1115/2226] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:59:11 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:59:11.592957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa2aa2-5e74-439f-b816-6e111387fbb0 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:11.605345 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa2aa2-5e74-439f-b816-6e111387fbb0 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:11.611825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b269e76-af9e-40e7-afee-744516dd18de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:11.612806 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b269e76-af9e-40e7-afee-744516dd18de admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:11.613170 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b269e76-af9e-40e7-afee-744516dd18de admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:11.613507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b269e76-af9e-40e7-afee-744516dd18de admin admin] PATH_INFO: `/v3/projects/d1f02c2820eb4688829932f3177e9c3a/users/d16f30a4de9d4b738d8ac1b8bf587e5f/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:11.631145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b269e76-af9e-40e7-afee-744516dd18de admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f02c2820eb4688829932f3177e9c3a, user_id=d16f30a4de9d4b738d8ac1b8bf587e5f, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:11.634013 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b269e76-af9e-40e7-afee-744516dd18de admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:11.707280 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae40ce2-945b-456b-8382-2b3701e9ec25 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:11.709570 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-6ae40ce2-945b-456b-8382-2b3701e9ec25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:11.725827 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae40ce2-945b-456b-8382-2b3701e9ec25 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:11.732588 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da838afc-82ef-4704-8374-073f1ce3087f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:11.733503 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da838afc-82ef-4704-8374-073f1ce3087f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:11.733793 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da838afc-82ef-4704-8374-073f1ce3087f admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:11.734072 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da838afc-82ef-4704-8374-073f1ce3087f admin admin] PATH_INFO: `/v3/projects/471cfb5e04dd41fcb813d8177a8f8acf` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:11.735817 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da838afc-82ef-4704-8374-073f1ce3087f admin admin] RBAC: Authorizing `identity:delete_project(project_id=471cfb5e04dd41fcb813d8177a8f8acf)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:11.756317 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da838afc-82ef-4704-8374-073f1ce3087f admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:11.803207 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1112/2227] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:59:11 2022] PUT /identity/v3/projects/d1f02c2820eb4688829932f3177e9c3a/users/d16f30a4de9d4b738d8ac1b8bf587e5f/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:11.807988 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b269e76-af9e-40e7-afee-744516dd18de admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:11.875138 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b269e76-af9e-40e7-afee-744516dd18de admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:11.880396 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60864b8-3104-4a8b-94e4-78de2bf01faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:11.881111 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60864b8-3104-4a8b-94e4-78de2bf01faf admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:11.881405 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60864b8-3104-4a8b-94e4-78de2bf01faf admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:11.881693 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60864b8-3104-4a8b-94e4-78de2bf01faf admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:11.882432 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60864b8-3104-4a8b-94e4-78de2bf01faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:11.884653 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60864b8-3104-4a8b-94e4-78de2bf01faf admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:11.904456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1113/2228] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:59:11 2022] GET /identity/v3/roles => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:59:11.906392 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60864b8-3104-4a8b-94e4-78de2bf01faf admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:11.919785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60864b8-3104-4a8b-94e4-78de2bf01faf admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:11.926686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-da838afc-82ef-4704-8374-073f1ce3087f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '471cfb5e04dd41fcb813d8177a8f8acf', 'request_id': 'req-da838afc-82ef-4704-8374-073f1ce3087f'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:11.936062 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-da838afc-82ef-4704-8374-073f1ce3087f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '471cfb5e04dd41fcb813d8177a8f8acf', 'request_id': 'req-da838afc-82ef-4704-8374-073f1ce3087f'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:11.942515 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-da838afc-82ef-4704-8374-073f1ce3087f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '471cfb5e04dd41fcb813d8177a8f8acf', 'request_id': 'req-da838afc-82ef-4704-8374-073f1ce3087f'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:11.995764 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ae944-490b-41f1-8550-6499c2e952fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:11.996781 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ae944-490b-41f1-8550-6499c2e952fc admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:11.997074 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ae944-490b-41f1-8550-6499c2e952fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:11.997359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ae944-490b-41f1-8550-6499c2e952fc admin admin] PATH_INFO: `/v3/projects/d1f02c2820eb4688829932f3177e9c3a/users/d16f30a4de9d4b738d8ac1b8bf587e5f/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:11.999707 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ae944-490b-41f1-8550-6499c2e952fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f02c2820eb4688829932f3177e9c3a, user_id=d16f30a4de9d4b738d8ac1b8bf587e5f, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:12.002596 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ae944-490b-41f1-8550-6499c2e952fc admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:12.015514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1114/2229] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:59:11 2022] PUT /identity/v3/projects/d1f02c2820eb4688829932f3177e9c3a/users/d16f30a4de9d4b738d8ac1b8bf587e5f/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:12.061682 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-da838afc-82ef-4704-8374-073f1ce3087f admin admin] The token cache is being invalidate because project 471cfb5e04dd41fcb813d8177a8f8acf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:59:12.062145 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-da838afc-82ef-4704-8374-073f1ce3087f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:12.062993 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-da838afc-82ef-4704-8374-073f1ce3087f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:12.065028 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1116/2230] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:59:11 2022] DELETE /identity/v3/projects/471cfb5e04dd41fcb813d8177a8f8acf => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:59:12.068805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ae944-490b-41f1-8550-6499c2e952fc admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:12.071131 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-089ae944-490b-41f1-8550-6499c2e952fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:12.176299 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ae944-490b-41f1-8550-6499c2e952fc admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:12.181555 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6b12c-5897-464d-930d-ae4925f450a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:12.182609 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6b12c-5897-464d-930d-ae4925f450a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:12.182965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6b12c-5897-464d-930d-ae4925f450a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:12.183347 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6b12c-5897-464d-930d-ae4925f450a6 admin admin] PATH_INFO: `/v3/users/6fc6822102c5489497be6b9b74c2e415` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:12.184683 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6b12c-5897-464d-930d-ae4925f450a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fc6822102c5489497be6b9b74c2e415)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:12.186732 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6b12c-5897-464d-930d-ae4925f450a6 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:12.536475 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-13e6b12c-5897-464d-930d-ae4925f450a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fc6822102c5489497be6b9b74c2e415'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:12.566910 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e6942-0748-4c8c-bda9-5fccae3761d7 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:12.567863 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e6942-0748-4c8c-bda9-5fccae3761d7 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:12.568265 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-13e6b12c-5897-464d-930d-ae4925f450a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fc6822102c5489497be6b9b74c2e415'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:12.568392 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e6942-0748-4c8c-bda9-5fccae3761d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:12.589498 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-f28e6942-0748-4c8c-bda9-5fccae3761d7 None None] MFA Rules not processed for user `fe6f58bedd87454bad46b0c48697eec9`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:12.591021 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f28e6942-0748-4c8c-bda9-5fccae3761d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:12.594060 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-13e6b12c-5897-464d-930d-ae4925f450a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fc6822102c5489497be6b9b74c2e415'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:12.594931 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-13e6b12c-5897-464d-930d-ae4925f450a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fc6822102c5489497be6b9b74c2e415'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:12.654257 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1117/2231] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:59:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:59:12.860417 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-13e6b12c-5897-464d-930d-ae4925f450a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fc6822102c5489497be6b9b74c2e415'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:12.873397 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1115/2232] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:59:12 2022] DELETE /identity/v3/users/6fc6822102c5489497be6b9b74c2e415 => generated 0 bytes in 802 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:13.203802 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:13.428053 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:DELETE=10,keystone:SELECT=85,keystone:INSERT=5 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:13.801100 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e6942-0748-4c8c-bda9-5fccae3761d7 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:13.803479 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f28e6942-0748-4c8c-bda9-5fccae3761d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:13.831954 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e6942-0748-4c8c-bda9-5fccae3761d7 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:13.936020 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2da016-9a63-4be2-97a4-01334f8a79c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:13.938742 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2da016-9a63-4be2-97a4-01334f8a79c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:13.938742 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2da016-9a63-4be2-97a4-01334f8a79c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:13.938742 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2da016-9a63-4be2-97a4-01334f8a79c6 admin admin] PATH_INFO: `/v3/projects/8dbf6d5fbcc943fc8db6494af24632a3` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:13.947971 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2da016-9a63-4be2-97a4-01334f8a79c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dbf6d5fbcc943fc8db6494af24632a3)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:13.950307 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2da016-9a63-4be2-97a4-01334f8a79c6 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:14.116795 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-ee2da016-9a63-4be2-97a4-01334f8a79c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dbf6d5fbcc943fc8db6494af24632a3', 'request_id': 'req-ee2da016-9a63-4be2-97a4-01334f8a79c6'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:14.126818 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-ee2da016-9a63-4be2-97a4-01334f8a79c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dbf6d5fbcc943fc8db6494af24632a3', 'request_id': 'req-ee2da016-9a63-4be2-97a4-01334f8a79c6'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:14.133491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-ee2da016-9a63-4be2-97a4-01334f8a79c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dbf6d5fbcc943fc8db6494af24632a3', 'request_id': 'req-ee2da016-9a63-4be2-97a4-01334f8a79c6'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:14.283096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-ee2da016-9a63-4be2-97a4-01334f8a79c6 admin admin] The token cache is being invalidate because project 8dbf6d5fbcc943fc8db6494af24632a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:59:14.283481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-ee2da016-9a63-4be2-97a4-01334f8a79c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:14.284462 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-ee2da016-9a63-4be2-97a4-01334f8a79c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:14.286625 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1118/2233] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:59:13 2022] DELETE /identity/v3/projects/8dbf6d5fbcc943fc8db6494af24632a3 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:19.478583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a21990-e628-437a-9090-2b5a0eb81ac1 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:19.479499 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a21990-e628-437a-9090-2b5a0eb81ac1 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:19.479944 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a21990-e628-437a-9090-2b5a0eb81ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:19.488416 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:19.502800 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-c7a21990-e628-437a-9090-2b5a0eb81ac1 None None] MFA Rules not processed for user `4a1474b39e0b477daff5833491cd6df5`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:19.504675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-c7a21990-e628-437a-9090-2b5a0eb81ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:19.654993 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1116/2234] 10.222.0.119 () {58 vars in 1014 bytes} [Thu Jul 14 15:59:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:59:19.706030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2da016-9a63-4be2-97a4-01334f8a79c6 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:19.708093 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-ee2da016-9a63-4be2-97a4-01334f8a79c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:19.729631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:19.833176 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2da016-9a63-4be2-97a4-01334f8a79c6 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:19.839379 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ae88f-af05-4b69-8d97-3c7a6a359a6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a5c169576e432c8174a562ae358e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:19.840056 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ae88f-af05-4b69-8d97-3c7a6a359a6e service swift] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:19.840374 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ae88f-af05-4b69-8d97-3c7a6a359a6e service swift] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:19.840846 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ae88f-af05-4b69-8d97-3c7a6a359a6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:19.850547 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ae88f-af05-4b69-8d97-3c7a6a359a6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:19.852951 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ae88f-af05-4b69-8d97-3c7a6a359a6e service swift] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:19.880258 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1119/2235] 10.222.0.119 () {60 vars in 1389 bytes} [Thu Jul 14 15:59:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:59:19.981383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b073437-90d2-4a20-abcd-e3ec4e4d807b None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:19.981943 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b073437-90d2-4a20-abcd-e3ec4e4d807b None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:19.982442 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b073437-90d2-4a20-abcd-e3ec4e4d807b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:20.020831 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-2b073437-90d2-4a20-abcd-e3ec4e4d807b None None] MFA Rules not processed for user `d16f30a4de9d4b738d8ac1b8bf587e5f`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:20.022251 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-2b073437-90d2-4a20-abcd-e3ec4e4d807b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:20.140411 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1117/2236] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:59:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:59:20.161843 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ae88f-af05-4b69-8d97-3c7a6a359a6e service swift] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:20.163707 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-278ae88f-af05-4b69-8d97-3c7a6a359a6e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:20.266821 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ae88f-af05-4b69-8d97-3c7a6a359a6e service swift] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:20.271076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61920fd2-274f-4be9-be16-1dd6c291232e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b236c66c184d3ca40c2069dc316664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:20.272059 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61920fd2-274f-4be9-be16-1dd6c291232e service glance] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:20.272531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61920fd2-274f-4be9-be16-1dd6c291232e service glance] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:20.272997 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61920fd2-274f-4be9-be16-1dd6c291232e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:20.275986 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-61920fd2-274f-4be9-be16-1dd6c291232e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:20.368846 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61920fd2-274f-4be9-be16-1dd6c291232e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:20.371163 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61920fd2-274f-4be9-be16-1dd6c291232e service glance] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:20.407393 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1120/2237] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:59:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:59:20.813021 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abba0de-5b02-4c3c-816d-96053b573d93 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:20.813467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abba0de-5b02-4c3c-816d-96053b573d93 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:20.813555 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abba0de-5b02-4c3c-816d-96053b573d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:20.845290 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-6abba0de-5b02-4c3c-816d-96053b573d93 None None] MFA Rules not processed for user `4a1474b39e0b477daff5833491cd6df5`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:20.852891 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-6abba0de-5b02-4c3c-816d-96053b573d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:20.876610 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1118/2238] 10.222.0.119 () {58 vars in 1014 bytes} [Thu Jul 14 15:59:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:59:20.881059 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61920fd2-274f-4be9-be16-1dd6c291232e service glance] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:20.897530 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61920fd2-274f-4be9-be16-1dd6c291232e service glance] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:20.905821 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e95af-b6b0-4877-b151-e48d423969fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a5c169576e432c8174a562ae358e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:20.906916 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e95af-b6b0-4877-b151-e48d423969fa service swift] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:20.907417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e95af-b6b0-4877-b151-e48d423969fa service swift] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:20.907872 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e95af-b6b0-4877-b151-e48d423969fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:20.918054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e95af-b6b0-4877-b151-e48d423969fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:20.919966 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e95af-b6b0-4877-b151-e48d423969fa service swift] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:20.931395 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1121/2239] 10.222.0.119 () {60 vars in 1389 bytes} [Thu Jul 14 15:59:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:59:26.453833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abba0de-5b02-4c3c-816d-96053b573d93 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:26.456171 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-6abba0de-5b02-4c3c-816d-96053b573d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:26.557570 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abba0de-5b02-4c3c-816d-96053b573d93 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:26.563671 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb1aaa-a907-4914-a965-b5be916831d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:26.564813 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb1aaa-a907-4914-a965-b5be916831d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:26.565214 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb1aaa-a907-4914-a965-b5be916831d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:26.565682 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb1aaa-a907-4914-a965-b5be916831d9 admin admin] PATH_INFO: `/v3/users/70415e3face2469fae848e84073ea832` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:26.567439 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb1aaa-a907-4914-a965-b5be916831d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70415e3face2469fae848e84073ea832)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:26.577965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb1aaa-a907-4914-a965-b5be916831d9 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:26.761303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:26.918570 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-1bfb1aaa-a907-4914-a965-b5be916831d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70415e3face2469fae848e84073ea832'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:26.938162 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-1bfb1aaa-a907-4914-a965-b5be916831d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70415e3face2469fae848e84073ea832'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:26.947253 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-1bfb1aaa-a907-4914-a965-b5be916831d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70415e3face2469fae848e84073ea832'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:26.948140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-1bfb1aaa-a907-4914-a965-b5be916831d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70415e3face2469fae848e84073ea832'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:27.043088 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-1bfb1aaa-a907-4914-a965-b5be916831d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70415e3face2469fae848e84073ea832'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:27.053906 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1119/2240] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:59:26 2022] DELETE /identity/v3/users/70415e3face2469fae848e84073ea832 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:27.058825 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865437b1-4702-43a2-8036-23707441bd70 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:27.059527 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865437b1-4702-43a2-8036-23707441bd70 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:27.059527 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865437b1-4702-43a2-8036-23707441bd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:27.094670 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-865437b1-4702-43a2-8036-23707441bd70 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:27.094670 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-865437b1-4702-43a2-8036-23707441bd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:27.166553 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:27.214818 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1122/2241] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:59:27.225246 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb1aaa-a907-4914-a965-b5be916831d9 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:27.229290 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-1bfb1aaa-a907-4914-a965-b5be916831d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:27.353676 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb1aaa-a907-4914-a965-b5be916831d9 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:27.360755 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49481be-173e-4594-90d4-bbfe2c462091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:27.361434 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49481be-173e-4594-90d4-bbfe2c462091 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:27.361727 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49481be-173e-4594-90d4-bbfe2c462091 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:27.362025 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49481be-173e-4594-90d4-bbfe2c462091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:27.393158 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49481be-173e-4594-90d4-bbfe2c462091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:27.397993 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49481be-173e-4594-90d4-bbfe2c462091 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:27.443461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1120/2242] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:59:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:59:28.240527 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865437b1-4702-43a2-8036-23707441bd70 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:28.246941 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-865437b1-4702-43a2-8036-23707441bd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:28.263329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865437b1-4702-43a2-8036-23707441bd70 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:28.270077 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae99724-f501-47ec-bd00-9a45cd86ab36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:28.271165 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae99724-f501-47ec-bd00-9a45cd86ab36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:28.271612 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae99724-f501-47ec-bd00-9a45cd86ab36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:28.272251 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae99724-f501-47ec-bd00-9a45cd86ab36 admin admin] PATH_INFO: `/v3/projects/4a4236f893e849c38f7085c47990b660` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:28.273382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae99724-f501-47ec-bd00-9a45cd86ab36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a4236f893e849c38f7085c47990b660)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:28.276837 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae99724-f501-47ec-bd00-9a45cd86ab36 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:28.565507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5ae99724-f501-47ec-bd00-9a45cd86ab36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a4236f893e849c38f7085c47990b660', 'request_id': 'req-5ae99724-f501-47ec-bd00-9a45cd86ab36'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:28.576315 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5ae99724-f501-47ec-bd00-9a45cd86ab36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a4236f893e849c38f7085c47990b660', 'request_id': 'req-5ae99724-f501-47ec-bd00-9a45cd86ab36'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:28.597307 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5ae99724-f501-47ec-bd00-9a45cd86ab36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a4236f893e849c38f7085c47990b660', 'request_id': 'req-5ae99724-f501-47ec-bd00-9a45cd86ab36'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:28.749197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5ae99724-f501-47ec-bd00-9a45cd86ab36 admin admin] The token cache is being invalidate because project 4a4236f893e849c38f7085c47990b660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:59:28.749642 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5ae99724-f501-47ec-bd00-9a45cd86ab36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:28.750575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5ae99724-f501-47ec-bd00-9a45cd86ab36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:28.753486 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1123/2243] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:59:28 2022] DELETE /identity/v3/projects/4a4236f893e849c38f7085c47990b660 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:28.759933 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49481be-173e-4594-90d4-bbfe2c462091 service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:28.798302 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49481be-173e-4594-90d4-bbfe2c462091 service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:28.947824 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55ef9e-8e05-4900-8afb-6f09deaca0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:28.948771 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55ef9e-8e05-4900-8afb-6f09deaca0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:28.949055 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55ef9e-8e05-4900-8afb-6f09deaca0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:28.949334 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55ef9e-8e05-4900-8afb-6f09deaca0ed admin admin] PATH_INFO: `/v3/users/175bb815305e4bff84ff3fbf71ad60d8` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:28.950555 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55ef9e-8e05-4900-8afb-6f09deaca0ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=175bb815305e4bff84ff3fbf71ad60d8)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:28.952520 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55ef9e-8e05-4900-8afb-6f09deaca0ed admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:29.336450 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-2c55ef9e-8e05-4900-8afb-6f09deaca0ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '175bb815305e4bff84ff3fbf71ad60d8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:29.399551 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:29.399551 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-2c55ef9e-8e05-4900-8afb-6f09deaca0ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '175bb815305e4bff84ff3fbf71ad60d8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:29.473205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-2c55ef9e-8e05-4900-8afb-6f09deaca0ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '175bb815305e4bff84ff3fbf71ad60d8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:29.475634 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-2c55ef9e-8e05-4900-8afb-6f09deaca0ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '175bb815305e4bff84ff3fbf71ad60d8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:29.796693 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-2c55ef9e-8e05-4900-8afb-6f09deaca0ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '175bb815305e4bff84ff3fbf71ad60d8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:29.796693 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1121/2244] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:59:28 2022] DELETE /identity/v3/users/175bb815305e4bff84ff3fbf71ad60d8 => generated 0 bytes in 1018 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:30.884789 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae99724-f501-47ec-bd00-9a45cd86ab36 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:30.888158 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-5ae99724-f501-47ec-bd00-9a45cd86ab36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:30.957890 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae99724-f501-47ec-bd00-9a45cd86ab36 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:31.196678 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf691a9-7be4-45ec-8128-c434abaec5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:31.199790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf691a9-7be4-45ec-8128-c434abaec5d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:31.200088 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf691a9-7be4-45ec-8128-c434abaec5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:31.200421 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf691a9-7be4-45ec-8128-c434abaec5d5 admin admin] PATH_INFO: `/v3/projects/9f943f12b88a44e8b78ec9735a0d3c64` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:31.203086 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf691a9-7be4-45ec-8128-c434abaec5d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f943f12b88a44e8b78ec9735a0d3c64)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:31.206853 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf691a9-7be4-45ec-8128-c434abaec5d5 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:31.493733 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-cbf691a9-7be4-45ec-8128-c434abaec5d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f943f12b88a44e8b78ec9735a0d3c64', 'request_id': 'req-cbf691a9-7be4-45ec-8128-c434abaec5d5'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:31.520585 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-cbf691a9-7be4-45ec-8128-c434abaec5d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f943f12b88a44e8b78ec9735a0d3c64', 'request_id': 'req-cbf691a9-7be4-45ec-8128-c434abaec5d5'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:31.532769 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-cbf691a9-7be4-45ec-8128-c434abaec5d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f943f12b88a44e8b78ec9735a0d3c64', 'request_id': 'req-cbf691a9-7be4-45ec-8128-c434abaec5d5'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:31.534497 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:31.653333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-cbf691a9-7be4-45ec-8128-c434abaec5d5 admin admin] The token cache is being invalidate because project 9f943f12b88a44e8b78ec9735a0d3c64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:59:31.653604 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-cbf691a9-7be4-45ec-8128-c434abaec5d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:31.654198 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-cbf691a9-7be4-45ec-8128-c434abaec5d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:31.655777 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1124/2245] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:59:30 2022] DELETE /identity/v3/projects/9f943f12b88a44e8b78ec9735a0d3c64 => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:31.663388 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b25da8-83c2-413c-9225-04118ea9ca7c None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:31.664962 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b25da8-83c2-413c-9225-04118ea9ca7c None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:31.665503 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b25da8-83c2-413c-9225-04118ea9ca7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:31.692831 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-89b25da8-83c2-413c-9225-04118ea9ca7c None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:31.695406 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-89b25da8-83c2-413c-9225-04118ea9ca7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:31.783056 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1122/2246] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:59:31.785012 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9cd9a-ab6a-410d-b87b-4ccaf16e0476 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:31.785611 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9cd9a-ab6a-410d-b87b-4ccaf16e0476 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:31.786118 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9cd9a-ab6a-410d-b87b-4ccaf16e0476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:31.807417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-32f9cd9a-ab6a-410d-b87b-4ccaf16e0476 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:31.809617 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-32f9cd9a-ab6a-410d-b87b-4ccaf16e0476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:31.837344 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1125/2247] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:59:31.839144 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b25da8-83c2-413c-9225-04118ea9ca7c None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:31.851107 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b25da8-83c2-413c-9225-04118ea9ca7c None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:31.857733 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfe6fa-87d8-4e7b-8632-1495d3498ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:31.858757 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfe6fa-87d8-4e7b-8632-1495d3498ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:31.859266 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfe6fa-87d8-4e7b-8632-1495d3498ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:31.859948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfe6fa-87d8-4e7b-8632-1495d3498ef0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:31.860942 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cfe6fa-87d8-4e7b-8632-1495d3498ef0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:59:31.861492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cfe6fa-87d8-4e7b-8632-1495d3498ef0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:31.863334 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cfe6fa-87d8-4e7b-8632-1495d3498ef0 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:31.896070 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9cd9a-ab6a-410d-b87b-4ccaf16e0476 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:31.905620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1123/2248] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:59:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:59:31.912765 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9cd9a-ab6a-410d-b87b-4ccaf16e0476 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:31.923195 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b968be-b5ce-49d5-8f22-7a83fe6a8e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:31.928886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b968be-b5ce-49d5-8f22-7a83fe6a8e25 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:31.928886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b968be-b5ce-49d5-8f22-7a83fe6a8e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:31.928886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b968be-b5ce-49d5-8f22-7a83fe6a8e25 admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:31.928886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b968be-b5ce-49d5-8f22-7a83fe6a8e25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:31.930331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b968be-b5ce-49d5-8f22-7a83fe6a8e25 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:32.099774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfe6fa-87d8-4e7b-8632-1495d3498ef0 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:32.113641 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1126/2249] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:59:31 2022] POST /identity/v3/projects => generated 400 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:59:32.117466 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfe6fa-87d8-4e7b-8632-1495d3498ef0 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:32.228521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063ea82-e13b-4c78-8044-82073bf64ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:32.229302 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063ea82-e13b-4c78-8044-82073bf64ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:32.229588 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063ea82-e13b-4c78-8044-82073bf64ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:32.229970 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063ea82-e13b-4c78-8044-82073bf64ca2 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:32.230650 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6063ea82-e13b-4c78-8044-82073bf64ca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:32.232866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6063ea82-e13b-4c78-8044-82073bf64ca2 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:32.426930 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1124/2250] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:59:32 2022] POST /identity/v3/users => generated 301 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:59:32.428252 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b968be-b5ce-49d5-8f22-7a83fe6a8e25 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:32.446923 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b968be-b5ce-49d5-8f22-7a83fe6a8e25 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:32.455673 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a58dc2-e2c4-4eec-a197-58e05d32e7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:32.456502 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a58dc2-e2c4-4eec-a197-58e05d32e7d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:32.456795 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a58dc2-e2c4-4eec-a197-58e05d32e7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:32.457139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a58dc2-e2c4-4eec-a197-58e05d32e7d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:32.460305 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a58dc2-e2c4-4eec-a197-58e05d32e7d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:32.469721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a58dc2-e2c4-4eec-a197-58e05d32e7d7 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:32.487933 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1127/2251] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:59:32 2022] GET /identity/v3/roles => generated 1427 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:59:32.491971 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063ea82-e13b-4c78-8044-82073bf64ca2 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:32.534026 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063ea82-e13b-4c78-8044-82073bf64ca2 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:32.540201 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5f2c4-26f8-4b85-96bd-8757c553c6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:32.541190 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5f2c4-26f8-4b85-96bd-8757c553c6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:32.545669 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5f2c4-26f8-4b85-96bd-8757c553c6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:32.546312 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5f2c4-26f8-4b85-96bd-8757c553c6c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:32.547340 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5f2c4-26f8-4b85-96bd-8757c553c6c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:32.549443 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5f2c4-26f8-4b85-96bd-8757c553c6c9 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:32.569922 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1125/2252] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:59:32 2022] GET /identity/v3/roles => generated 1427 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:59:32.573283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a58dc2-e2c4-4eec-a197-58e05d32e7d7 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:32.590871 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a58dc2-e2c4-4eec-a197-58e05d32e7d7 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:32.600396 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63029f-2cbe-4830-bb45-983d1f77980d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:32.601309 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63029f-2cbe-4830-bb45-983d1f77980d admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:32.601601 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63029f-2cbe-4830-bb45-983d1f77980d admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:32.602418 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63029f-2cbe-4830-bb45-983d1f77980d admin admin] PATH_INFO: `/v3/projects/dc07719825d94ee7b536dfbd26bf3a23/users/1c2c27dd38ad4d8eb7963999f7432f06/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:32.641777 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63029f-2cbe-4830-bb45-983d1f77980d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc07719825d94ee7b536dfbd26bf3a23, user_id=1c2c27dd38ad4d8eb7963999f7432f06, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:32.644565 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63029f-2cbe-4830-bb45-983d1f77980d admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:32.800512 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1128/2253] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:59:32 2022] PUT /identity/v3/projects/dc07719825d94ee7b536dfbd26bf3a23/users/1c2c27dd38ad4d8eb7963999f7432f06/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:32.814847 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dced81f-9bd1-418e-9cc0-1c3e82d63764 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:32.815958 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dced81f-9bd1-418e-9cc0-1c3e82d63764 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:32.815958 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dced81f-9bd1-418e-9cc0-1c3e82d63764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:32.885434 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-9dced81f-9bd1-418e-9cc0-1c3e82d63764 None None] MFA Rules not processed for user `1c2c27dd38ad4d8eb7963999f7432f06`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:32.886895 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-9dced81f-9bd1-418e-9cc0-1c3e82d63764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:32.932905 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:32.999446 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1126/2254] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:59:32 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:59:33.004001 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63029f-2cbe-4830-bb45-983d1f77980d admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:33.122346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63029f-2cbe-4830-bb45-983d1f77980d admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:33.127989 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd622683-e5e4-48f2-94bf-ff5a05997a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:33.129205 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd622683-e5e4-48f2-94bf-ff5a05997a95 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:33.129728 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd622683-e5e4-48f2-94bf-ff5a05997a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:33.130202 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd622683-e5e4-48f2-94bf-ff5a05997a95 admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:33.131202 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd622683-e5e4-48f2-94bf-ff5a05997a95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:33.134186 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd622683-e5e4-48f2-94bf-ff5a05997a95 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:33.254370 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1129/2255] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:59:33 2022] POST /identity/v3/projects => generated 400 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:59:33.259155 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dced81f-9bd1-418e-9cc0-1c3e82d63764 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:33.292632 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dced81f-9bd1-418e-9cc0-1c3e82d63764 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:33.439364 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7e6db-5bb5-42bf-9465-24fae715d1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:33.442233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7e6db-5bb5-42bf-9465-24fae715d1a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:33.442943 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7e6db-5bb5-42bf-9465-24fae715d1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:33.443670 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7e6db-5bb5-42bf-9465-24fae715d1a2 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:33.448233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7e6db-5bb5-42bf-9465-24fae715d1a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:33.454480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7e6db-5bb5-42bf-9465-24fae715d1a2 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:33.761865 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1127/2256] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:59:33 2022] POST /identity/v3/users => generated 307 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:59:33.766096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd622683-e5e4-48f2-94bf-ff5a05997a95 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:33.783397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd622683-e5e4-48f2-94bf-ff5a05997a95 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:33.796999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742c2e7-1b56-4b33-89ed-616df33b9e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:33.797703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742c2e7-1b56-4b33-89ed-616df33b9e28 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:33.798016 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742c2e7-1b56-4b33-89ed-616df33b9e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:33.798301 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742c2e7-1b56-4b33-89ed-616df33b9e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:33.799127 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742c2e7-1b56-4b33-89ed-616df33b9e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:33.806807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742c2e7-1b56-4b33-89ed-616df33b9e28 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:33.852634 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1130/2257] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:59:33 2022] GET /identity/v3/roles => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:59:33.856557 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7e6db-5bb5-42bf-9465-24fae715d1a2 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:33.870319 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7e6db-5bb5-42bf-9465-24fae715d1a2 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:33.877942 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e4cbf-e663-4aa8-9006-9ebf3a6e6618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:33.879210 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e4cbf-e663-4aa8-9006-9ebf3a6e6618 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:33.879782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e4cbf-e663-4aa8-9006-9ebf3a6e6618 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:33.880276 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e4cbf-e663-4aa8-9006-9ebf3a6e6618 admin admin] PATH_INFO: `/v3/projects/29e5eccb25db4b27b8ed7818681f0d8e/users/8b55c55ba69749e9be96deb8d0629dc8/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:33.912977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e4cbf-e663-4aa8-9006-9ebf3a6e6618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e5eccb25db4b27b8ed7818681f0d8e, user_id=8b55c55ba69749e9be96deb8d0629dc8, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:33.923940 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e4cbf-e663-4aa8-9006-9ebf3a6e6618 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:34.517754 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1128/2258] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:59:33 2022] PUT /identity/v3/projects/29e5eccb25db4b27b8ed7818681f0d8e/users/8b55c55ba69749e9be96deb8d0629dc8/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:34.521897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742c2e7-1b56-4b33-89ed-616df33b9e28 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:34.532333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742c2e7-1b56-4b33-89ed-616df33b9e28 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:34.594112 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ac733-2be8-476f-b380-b6dc8b487dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:34.594808 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ac733-2be8-476f-b380-b6dc8b487dfe admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:34.595095 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ac733-2be8-476f-b380-b6dc8b487dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:34.595376 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ac733-2be8-476f-b380-b6dc8b487dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:34.596110 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ac733-2be8-476f-b380-b6dc8b487dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:34.597718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ac733-2be8-476f-b380-b6dc8b487dfe admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:34.599787 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:34.608584 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1131/2259] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:59:34 2022] GET /identity/v3/roles => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:59:34.612914 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e4cbf-e663-4aa8-9006-9ebf3a6e6618 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:34.624363 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e4cbf-e663-4aa8-9006-9ebf3a6e6618 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:34.629094 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a90e7b-1620-49be-9560-2fff4b365023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:34.630020 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a90e7b-1620-49be-9560-2fff4b365023 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:34.630413 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a90e7b-1620-49be-9560-2fff4b365023 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:34.630627 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a90e7b-1620-49be-9560-2fff4b365023 admin admin] PATH_INFO: `/v3/projects/29e5eccb25db4b27b8ed7818681f0d8e/users/8b55c55ba69749e9be96deb8d0629dc8/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:34.632668 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a90e7b-1620-49be-9560-2fff4b365023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e5eccb25db4b27b8ed7818681f0d8e, user_id=8b55c55ba69749e9be96deb8d0629dc8, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:34.635770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a90e7b-1620-49be-9560-2fff4b365023 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:34.646264 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1129/2260] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:59:34 2022] PUT /identity/v3/projects/29e5eccb25db4b27b8ed7818681f0d8e/users/8b55c55ba69749e9be96deb8d0629dc8/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:34.657247 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e636058-a302-4206-ae24-41aaeb44fe06 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:34.657542 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e636058-a302-4206-ae24-41aaeb44fe06 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:34.657824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e636058-a302-4206-ae24-41aaeb44fe06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:34.686661 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-9e636058-a302-4206-ae24-41aaeb44fe06 None None] MFA Rules not processed for user `8b55c55ba69749e9be96deb8d0629dc8`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:34.688014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-9e636058-a302-4206-ae24-41aaeb44fe06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:34.756325 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1132/2261] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:59:34 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:59:34.767660 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a90e7b-1620-49be-9560-2fff4b365023 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:34.769502 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-70a90e7b-1620-49be-9560-2fff4b365023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:34.825041 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a90e7b-1620-49be-9560-2fff4b365023 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:34.837503 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9af62a-c166-4584-9dac-53d0394f6e07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:34.838302 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9af62a-c166-4584-9dac-53d0394f6e07 service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:34.838619 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9af62a-c166-4584-9dac-53d0394f6e07 service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:34.838899 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9af62a-c166-4584-9dac-53d0394f6e07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:34.848182 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9af62a-c166-4584-9dac-53d0394f6e07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:34.849698 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9af62a-c166-4584-9dac-53d0394f6e07 service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:34.859803 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1130/2262] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:59:34 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:59:35.444557 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e636058-a302-4206-ae24-41aaeb44fe06 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:35.455715 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e636058-a302-4206-ae24-41aaeb44fe06 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:35.459940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e82fc-0228-457e-baff-8210ce9ead6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:35.467288 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e82fc-0228-457e-baff-8210ce9ead6f service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:35.467288 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e82fc-0228-457e-baff-8210ce9ead6f service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:35.467288 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e82fc-0228-457e-baff-8210ce9ead6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:35.551885 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e82fc-0228-457e-baff-8210ce9ead6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:35.558644 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e82fc-0228-457e-baff-8210ce9ead6f service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:35.574832 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1133/2263] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:59:35 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:59:37.732985 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af20a4b-e754-41ab-96a2-8d5a5e34a202 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:37.732985 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af20a4b-e754-41ab-96a2-8d5a5e34a202 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:37.732985 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af20a4b-e754-41ab-96a2-8d5a5e34a202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:37.759064 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-7af20a4b-e754-41ab-96a2-8d5a5e34a202 None None] MFA Rules not processed for user `aad6767795b0402cb72f249b4c3a8039`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:37.766670 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-7af20a4b-e754-41ab-96a2-8d5a5e34a202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:37.785382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:37.853344 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1131/2264] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:59:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:59:41.203588 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e82fc-0228-457e-baff-8210ce9ead6f service cinder] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:41.207865 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-7c9e82fc-0228-457e-baff-8210ce9ead6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:41.300168 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e82fc-0228-457e-baff-8210ce9ead6f service cinder] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:41.308323 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f035ab-2052-46b6-a250-0e0e822f4e58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716cbbfeede34885b0411e5b9b25df47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:41.309318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f035ab-2052-46b6-a250-0e0e822f4e58 service placement] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:41.309814 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f035ab-2052-46b6-a250-0e0e822f4e58 service placement] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:41.310358 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f035ab-2052-46b6-a250-0e0e822f4e58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:41.313416 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-d0f035ab-2052-46b6-a250-0e0e822f4e58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:41.330453 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f035ab-2052-46b6-a250-0e0e822f4e58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:41.332295 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f035ab-2052-46b6-a250-0e0e822f4e58 service placement] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:41.349254 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1134/2265] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:59:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:59:42.999575 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af20a4b-e754-41ab-96a2-8d5a5e34a202 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:43.123847 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af20a4b-e754-41ab-96a2-8d5a5e34a202 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:43.133128 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9cce62-b8be-456a-b089-dc1c38ca628c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:43.134851 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cce62-b8be-456a-b089-dc1c38ca628c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:43.135232 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cce62-b8be-456a-b089-dc1c38ca628c admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:43.135422 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cce62-b8be-456a-b089-dc1c38ca628c admin admin] PATH_INFO: `/v3/users/1c2c27dd38ad4d8eb7963999f7432f06` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:43.137853 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9cce62-b8be-456a-b089-dc1c38ca628c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c2c27dd38ad4d8eb7963999f7432f06)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:43.151615 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9cce62-b8be-456a-b089-dc1c38ca628c admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:43.401447 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-ad9cce62-b8be-456a-b089-dc1c38ca628c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c2c27dd38ad4d8eb7963999f7432f06'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:43.420369 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-ad9cce62-b8be-456a-b089-dc1c38ca628c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c2c27dd38ad4d8eb7963999f7432f06'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:43.431628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-ad9cce62-b8be-456a-b089-dc1c38ca628c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c2c27dd38ad4d8eb7963999f7432f06'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:43.436370 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-ad9cce62-b8be-456a-b089-dc1c38ca628c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c2c27dd38ad4d8eb7963999f7432f06'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:43.540623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-ad9cce62-b8be-456a-b089-dc1c38ca628c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c2c27dd38ad4d8eb7963999f7432f06'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:43.552704 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1132/2266] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:59:42 2022] DELETE /identity/v3/users/1c2c27dd38ad4d8eb7963999f7432f06 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:43.558957 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e83f5f-a0b8-4714-8ecb-2e802d0b2843 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:43.559560 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e83f5f-a0b8-4714-8ecb-2e802d0b2843 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:43.559786 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e83f5f-a0b8-4714-8ecb-2e802d0b2843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:43.563081 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9e5d9-d70b-4fac-b46d-2c034178d6e8 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:43.563382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9e5d9-d70b-4fac-b46d-2c034178d6e8 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:43.563668 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9e5d9-d70b-4fac-b46d-2c034178d6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:43.596440 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-63e83f5f-a0b8-4714-8ecb-2e802d0b2843 None None] MFA Rules not processed for user `4a1474b39e0b477daff5833491cd6df5`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:43.597900 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-63e83f5f-a0b8-4714-8ecb-2e802d0b2843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:43.608816 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-75d9e5d9-d70b-4fac-b46d-2c034178d6e8 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:43.610720 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-75d9e5d9-d70b-4fac-b46d-2c034178d6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:43.613178 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:43.675391 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:43.701766 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1135/2267] 10.222.0.119 () {58 vars in 1014 bytes} [Thu Jul 14 15:59:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:59:43.704332 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1133/2268] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:59:43.716754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e83f5f-a0b8-4714-8ecb-2e802d0b2843 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:43.718555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-63e83f5f-a0b8-4714-8ecb-2e802d0b2843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:43.719622 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9e5d9-d70b-4fac-b46d-2c034178d6e8 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:43.721528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-75d9e5d9-d70b-4fac-b46d-2c034178d6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:43.796258 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9e5d9-d70b-4fac-b46d-2c034178d6e8 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:43.800486 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152c339-f58b-4c08-b0e5-7724cb8a39a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:43.801338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152c339-f58b-4c08-b0e5-7724cb8a39a3 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:43.801880 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152c339-f58b-4c08-b0e5-7724cb8a39a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:43.802373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152c339-f58b-4c08-b0e5-7724cb8a39a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:43.803963 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e83f5f-a0b8-4714-8ecb-2e802d0b2843 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:43.810590 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236b92c-f95d-490d-a6cd-ec588a31164c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a5c169576e432c8174a562ae358e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:43.811336 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236b92c-f95d-490d-a6cd-ec588a31164c service swift] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:43.811544 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236b92c-f95d-490d-a6cd-ec588a31164c service swift] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:43.811832 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236b92c-f95d-490d-a6cd-ec588a31164c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:43.814962 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152c339-f58b-4c08-b0e5-7724cb8a39a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:43.816881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152c339-f58b-4c08-b0e5-7724cb8a39a3 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:43.822221 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236b92c-f95d-490d-a6cd-ec588a31164c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:43.830482 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236b92c-f95d-490d-a6cd-ec588a31164c service swift] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:43.830920 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1134/2269] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:59:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:59:43.834382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1136/2270] 10.222.0.119 () {60 vars in 1389 bytes} [Thu Jul 14 15:59:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 15:59:44.770613 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152c339-f58b-4c08-b0e5-7724cb8a39a3 service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:44.772061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-3152c339-f58b-4c08-b0e5-7724cb8a39a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:44.806760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152c339-f58b-4c08-b0e5-7724cb8a39a3 service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:44.823392 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb6a3e-80df-4dff-b39f-c9276eb0a54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:44.824643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb6a3e-80df-4dff-b39f-c9276eb0a54d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:44.825005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb6a3e-80df-4dff-b39f-c9276eb0a54d admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:44.825405 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb6a3e-80df-4dff-b39f-c9276eb0a54d admin admin] PATH_INFO: `/v3/projects/dc07719825d94ee7b536dfbd26bf3a23` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:44.827053 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb6a3e-80df-4dff-b39f-c9276eb0a54d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc07719825d94ee7b536dfbd26bf3a23)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:44.829470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb6a3e-80df-4dff-b39f-c9276eb0a54d admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:45.010895 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-cdeb6a3e-80df-4dff-b39f-c9276eb0a54d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc07719825d94ee7b536dfbd26bf3a23', 'request_id': 'req-cdeb6a3e-80df-4dff-b39f-c9276eb0a54d'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:45.031414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-cdeb6a3e-80df-4dff-b39f-c9276eb0a54d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc07719825d94ee7b536dfbd26bf3a23', 'request_id': 'req-cdeb6a3e-80df-4dff-b39f-c9276eb0a54d'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:45.127037 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-cdeb6a3e-80df-4dff-b39f-c9276eb0a54d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc07719825d94ee7b536dfbd26bf3a23', 'request_id': 'req-cdeb6a3e-80df-4dff-b39f-c9276eb0a54d'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:45.141497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-cdeb6a3e-80df-4dff-b39f-c9276eb0a54d admin admin] The token cache is being invalidate because project dc07719825d94ee7b536dfbd26bf3a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:59:45.141798 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-cdeb6a3e-80df-4dff-b39f-c9276eb0a54d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:45.142478 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-cdeb6a3e-80df-4dff-b39f-c9276eb0a54d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:45.144195 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1135/2271] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:59:44 2022] DELETE /identity/v3/projects/dc07719825d94ee7b536dfbd26bf3a23 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:45.148336 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236b92c-f95d-490d-a6cd-ec588a31164c service swift] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:45.162480 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236b92c-f95d-490d-a6cd-ec588a31164c service swift] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:45.241559 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8b97f-e46f-4f63-bf02-1b57a41fff59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:45.242445 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8b97f-e46f-4f63-bf02-1b57a41fff59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:45.242798 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8b97f-e46f-4f63-bf02-1b57a41fff59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:45.243483 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8b97f-e46f-4f63-bf02-1b57a41fff59 admin admin] PATH_INFO: `/v3/users/8b55c55ba69749e9be96deb8d0629dc8` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:45.244310 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8b97f-e46f-4f63-bf02-1b57a41fff59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b55c55ba69749e9be96deb8d0629dc8)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:45.246330 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8b97f-e46f-4f63-bf02-1b57a41fff59 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:45.468943 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-e9a8b97f-e46f-4f63-bf02-1b57a41fff59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b55c55ba69749e9be96deb8d0629dc8'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:45.469823 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-e9a8b97f-e46f-4f63-bf02-1b57a41fff59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b55c55ba69749e9be96deb8d0629dc8'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:45.471324 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:45.486738 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-e9a8b97f-e46f-4f63-bf02-1b57a41fff59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b55c55ba69749e9be96deb8d0629dc8'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:45.494865 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-e9a8b97f-e46f-4f63-bf02-1b57a41fff59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b55c55ba69749e9be96deb8d0629dc8'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:45.495827 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-e9a8b97f-e46f-4f63-bf02-1b57a41fff59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b55c55ba69749e9be96deb8d0629dc8'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:45.638254 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1137/2272] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:59:45 2022] DELETE /identity/v3/users/8b55c55ba69749e9be96deb8d0629dc8 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:46.104241 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e559080-20f7-494f-989b-a86e682b1900 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:46.104801 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e559080-20f7-494f-989b-a86e682b1900 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:46.104976 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e559080-20f7-494f-989b-a86e682b1900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:46.126127 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-3e559080-20f7-494f-989b-a86e682b1900 None None] MFA Rules not processed for user `4a1474b39e0b477daff5833491cd6df5`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:46.127374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-3e559080-20f7-494f-989b-a86e682b1900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:46.197666 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1136/2273] 10.222.0.119 () {58 vars in 972 bytes} [Thu Jul 14 15:59:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:59:46.214926 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8b97f-e46f-4f63-bf02-1b57a41fff59 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:46.217335 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-e9a8b97f-e46f-4f63-bf02-1b57a41fff59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:46.305625 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8b97f-e46f-4f63-bf02-1b57a41fff59 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:46.311707 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c700ea5-7cd2-4c13-b8f5-9f69d1f9d932 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a5c169576e432c8174a562ae358e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:46.312409 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c700ea5-7cd2-4c13-b8f5-9f69d1f9d932 service swift] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:46.312857 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c700ea5-7cd2-4c13-b8f5-9f69d1f9d932 service swift] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:46.313148 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c700ea5-7cd2-4c13-b8f5-9f69d1f9d932 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:46.322558 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c700ea5-7cd2-4c13-b8f5-9f69d1f9d932 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:46.324374 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c700ea5-7cd2-4c13-b8f5-9f69d1f9d932 service swift] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:46.333552 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1138/2274] 10.222.0.119 () {60 vars in 1389 bytes} [Thu Jul 14 15:59:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:59:46.577354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e559080-20f7-494f-989b-a86e682b1900 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:46.578951 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-3e559080-20f7-494f-989b-a86e682b1900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:46.611596 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:46.685936 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e559080-20f7-494f-989b-a86e682b1900 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:46.690550 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c628b2-2a6f-4034-bbcd-2009c2429565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:46.691415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c628b2-2a6f-4034-bbcd-2009c2429565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:46.691738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c628b2-2a6f-4034-bbcd-2009c2429565 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:46.692028 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c628b2-2a6f-4034-bbcd-2009c2429565 admin admin] PATH_INFO: `/v3/projects/29e5eccb25db4b27b8ed7818681f0d8e` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:46.693303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c628b2-2a6f-4034-bbcd-2009c2429565 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29e5eccb25db4b27b8ed7818681f0d8e)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:46.695220 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c628b2-2a6f-4034-bbcd-2009c2429565 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:46.805276 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-e1c628b2-2a6f-4034-bbcd-2009c2429565 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29e5eccb25db4b27b8ed7818681f0d8e', 'request_id': 'req-e1c628b2-2a6f-4034-bbcd-2009c2429565'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:46.814483 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-e1c628b2-2a6f-4034-bbcd-2009c2429565 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29e5eccb25db4b27b8ed7818681f0d8e', 'request_id': 'req-e1c628b2-2a6f-4034-bbcd-2009c2429565'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:46.901225 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-e1c628b2-2a6f-4034-bbcd-2009c2429565 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29e5eccb25db4b27b8ed7818681f0d8e', 'request_id': 'req-e1c628b2-2a6f-4034-bbcd-2009c2429565'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:46.915870 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-e1c628b2-2a6f-4034-bbcd-2009c2429565 admin admin] The token cache is being invalidate because project 29e5eccb25db4b27b8ed7818681f0d8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:59:46.916371 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-e1c628b2-2a6f-4034-bbcd-2009c2429565 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:46.917175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-e1c628b2-2a6f-4034-bbcd-2009c2429565 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:46.919001 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1137/2275] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:59:46 2022] DELETE /identity/v3/projects/29e5eccb25db4b27b8ed7818681f0d8e => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:46.927891 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b977a-009d-44d3-90ba-3c87a7757255 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:46.928288 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b977a-009d-44d3-90ba-3c87a7757255 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:46.928645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b977a-009d-44d3-90ba-3c87a7757255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:46.951794 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-854b977a-009d-44d3-90ba-3c87a7757255 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:46.953105 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-854b977a-009d-44d3-90ba-3c87a7757255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:47.039955 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1139/2276] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:59:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:59:47.049088 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438e5b3-8950-4009-a7e4-fd735e7226d8 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:47.049481 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438e5b3-8950-4009-a7e4-fd735e7226d8 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:47.049780 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438e5b3-8950-4009-a7e4-fd735e7226d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:47.073618 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-0438e5b3-8950-4009-a7e4-fd735e7226d8 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:47.075018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-0438e5b3-8950-4009-a7e4-fd735e7226d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:47.083348 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1138/2277] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:59:47.088682 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b977a-009d-44d3-90ba-3c87a7757255 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:47.100130 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b977a-009d-44d3-90ba-3c87a7757255 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:47.106162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24735783-39af-4780-9ff9-d9aca6377d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:47.116308 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24735783-39af-4780-9ff9-d9aca6377d7c admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:47.116308 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24735783-39af-4780-9ff9-d9aca6377d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:47.116308 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24735783-39af-4780-9ff9-d9aca6377d7c admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:47.116308 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24735783-39af-4780-9ff9-d9aca6377d7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:59:47.116308 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24735783-39af-4780-9ff9-d9aca6377d7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:47.116308 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24735783-39af-4780-9ff9-d9aca6377d7c admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:47.122922 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1140/2278] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:59:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:59:47.127351 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438e5b3-8950-4009-a7e4-fd735e7226d8 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:47.137840 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438e5b3-8950-4009-a7e4-fd735e7226d8 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:47.143402 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ed167-450e-4242-9120-14ea8230f0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:47.150919 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ed167-450e-4242-9120-14ea8230f0ef admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:47.150919 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ed167-450e-4242-9120-14ea8230f0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:47.150919 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ed167-450e-4242-9120-14ea8230f0ef admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:47.150919 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ed167-450e-4242-9120-14ea8230f0ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:47.150919 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ed167-450e-4242-9120-14ea8230f0ef admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:47.391104 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1139/2279] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:59:47 2022] POST /identity/v3/projects => generated 380 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:59:47.391448 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24735783-39af-4780-9ff9-d9aca6377d7c admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:47.413550 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24735783-39af-4780-9ff9-d9aca6377d7c admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:47.503219 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:47.528831 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0f45a-6618-4a8c-ab82-15fb008d6f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:47.529524 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0f45a-6618-4a8c-ab82-15fb008d6f0b admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:47.529814 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0f45a-6618-4a8c-ab82-15fb008d6f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:47.530096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0f45a-6618-4a8c-ab82-15fb008d6f0b admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:47.530825 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0f45a-6618-4a8c-ab82-15fb008d6f0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:47.532813 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0f45a-6618-4a8c-ab82-15fb008d6f0b admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:48.117077 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1141/2280] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:59:47 2022] POST /identity/v3/users => generated 291 bytes in 728 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:59:48.121081 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ed167-450e-4242-9120-14ea8230f0ef admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:48.135655 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ed167-450e-4242-9120-14ea8230f0ef admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:48.151884 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166c805-4c7b-4089-9a66-0220177bd50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:48.152631 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166c805-4c7b-4089-9a66-0220177bd50e admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:48.152918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166c805-4c7b-4089-9a66-0220177bd50e admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:48.153203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166c805-4c7b-4089-9a66-0220177bd50e admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:48.153941 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166c805-4c7b-4089-9a66-0220177bd50e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:48.155590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166c805-4c7b-4089-9a66-0220177bd50e admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:48.168350 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1140/2281] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:59:48 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:59:48.172248 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0f45a-6618-4a8c-ab82-15fb008d6f0b admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:48.185469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0f45a-6618-4a8c-ab82-15fb008d6f0b admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:48.190543 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a2a61-5716-4117-ab88-6afebcb748ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:48.191487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a2a61-5716-4117-ab88-6afebcb748ee admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:48.192131 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a2a61-5716-4117-ab88-6afebcb748ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:48.192616 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a2a61-5716-4117-ab88-6afebcb748ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:48.193769 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a2a61-5716-4117-ab88-6afebcb748ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:48.195596 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a2a61-5716-4117-ab88-6afebcb748ee admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:48.208831 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1142/2282] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:59:48 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:59:48.213878 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166c805-4c7b-4089-9a66-0220177bd50e admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:48.224766 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166c805-4c7b-4089-9a66-0220177bd50e admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:48.234480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a66a64-e7aa-40aa-851e-0a1300a2481d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:48.236497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a66a64-e7aa-40aa-851e-0a1300a2481d admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:48.237943 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a66a64-e7aa-40aa-851e-0a1300a2481d admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:48.238509 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a66a64-e7aa-40aa-851e-0a1300a2481d admin admin] PATH_INFO: `/v3/projects/4259dd633ef845e5af90b109b145dd90/users/bc09737aece34e97b00936372737797c/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:48.272314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a66a64-e7aa-40aa-851e-0a1300a2481d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4259dd633ef845e5af90b109b145dd90, user_id=bc09737aece34e97b00936372737797c, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:48.275313 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a66a64-e7aa-40aa-851e-0a1300a2481d admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:48.345308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1141/2283] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:59:48 2022] PUT /identity/v3/projects/4259dd633ef845e5af90b109b145dd90/users/bc09737aece34e97b00936372737797c/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:48.358095 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235c86f-8d46-46c8-9434-ddf68fc64bda None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:48.358393 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235c86f-8d46-46c8-9434-ddf68fc64bda None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:48.358670 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235c86f-8d46-46c8-9434-ddf68fc64bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:48.390525 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-7235c86f-8d46-46c8-9434-ddf68fc64bda None None] MFA Rules not processed for user `bc09737aece34e97b00936372737797c`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:48.392188 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-7235c86f-8d46-46c8-9434-ddf68fc64bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:48.461672 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1143/2284] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:59:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:59:48.466493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a66a64-e7aa-40aa-851e-0a1300a2481d admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:48.516367 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:48.551388 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a66a64-e7aa-40aa-851e-0a1300a2481d admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:48.557688 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a333c42-eff1-4c05-894c-3b70ba293fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:48.558457 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a333c42-eff1-4c05-894c-3b70ba293fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:48.558885 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a333c42-eff1-4c05-894c-3b70ba293fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:48.559203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a333c42-eff1-4c05-894c-3b70ba293fa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:48.559909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a333c42-eff1-4c05-894c-3b70ba293fa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:48.562156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a333c42-eff1-4c05-894c-3b70ba293fa8 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:48.718863 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1142/2285] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:59:48 2022] POST /identity/v3/projects => generated 380 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:59:48.723321 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235c86f-8d46-46c8-9434-ddf68fc64bda None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:48.735457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235c86f-8d46-46c8-9434-ddf68fc64bda None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:48.816473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6db89-84ad-42ab-9497-7e64f23e71c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:48.816473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6db89-84ad-42ab-9497-7e64f23e71c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:48.816473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6db89-84ad-42ab-9497-7e64f23e71c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:48.816881 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6db89-84ad-42ab-9497-7e64f23e71c2 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:48.817448 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6db89-84ad-42ab-9497-7e64f23e71c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:48.822058 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6db89-84ad-42ab-9497-7e64f23e71c2 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:48.970380 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1144/2286] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:59:48 2022] POST /identity/v3/users => generated 291 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:59:48.974781 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a333c42-eff1-4c05-894c-3b70ba293fa8 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:48.985545 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a333c42-eff1-4c05-894c-3b70ba293fa8 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:48.990153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a794de-8605-4dae-94a1-e3bffb4bff48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:48.990818 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a794de-8605-4dae-94a1-e3bffb4bff48 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:48.991106 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a794de-8605-4dae-94a1-e3bffb4bff48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:48.991387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a794de-8605-4dae-94a1-e3bffb4bff48 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:48.992142 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a794de-8605-4dae-94a1-e3bffb4bff48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:48.994061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a794de-8605-4dae-94a1-e3bffb4bff48 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:49.005996 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1143/2287] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:59:48 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:59:49.010747 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6db89-84ad-42ab-9497-7e64f23e71c2 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:49.021024 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6db89-84ad-42ab-9497-7e64f23e71c2 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:49.026505 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83e2ae-bbff-4be2-9305-3a2aae94da82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:49.027167 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83e2ae-bbff-4be2-9305-3a2aae94da82 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:49.027487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83e2ae-bbff-4be2-9305-3a2aae94da82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:49.027763 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83e2ae-bbff-4be2-9305-3a2aae94da82 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:49.028530 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83e2ae-bbff-4be2-9305-3a2aae94da82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:49.030190 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83e2ae-bbff-4be2-9305-3a2aae94da82 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:49.040725 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1145/2288] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:59:49 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:59:49.044872 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a794de-8605-4dae-94a1-e3bffb4bff48 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:49.058501 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a794de-8605-4dae-94a1-e3bffb4bff48 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:49.063313 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa85cad-7b13-4d6d-8cf1-b4b66b3806cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:49.064260 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa85cad-7b13-4d6d-8cf1-b4b66b3806cd admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:49.064555 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa85cad-7b13-4d6d-8cf1-b4b66b3806cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:49.064862 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa85cad-7b13-4d6d-8cf1-b4b66b3806cd admin admin] PATH_INFO: `/v3/projects/068f83d54b8f4f2a8ae5fa3419776c5b/users/7a1fd9b4145b4b5ab870ec4e68c7a054/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:49.089063 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa85cad-7b13-4d6d-8cf1-b4b66b3806cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=068f83d54b8f4f2a8ae5fa3419776c5b, user_id=7a1fd9b4145b4b5ab870ec4e68c7a054, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:49.095184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa85cad-7b13-4d6d-8cf1-b4b66b3806cd admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:49.189871 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1144/2289] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:59:49 2022] PUT /identity/v3/projects/068f83d54b8f4f2a8ae5fa3419776c5b/users/7a1fd9b4145b4b5ab870ec4e68c7a054/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:49.197828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06c517-7e2b-4b26-9254-f0c9f6470598 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:49.198031 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06c517-7e2b-4b26-9254-f0c9f6470598 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:49.198415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06c517-7e2b-4b26-9254-f0c9f6470598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:49.263995 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-6d06c517-7e2b-4b26-9254-f0c9f6470598 None None] MFA Rules not processed for user `7a1fd9b4145b4b5ab870ec4e68c7a054`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:49.289572 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-6d06c517-7e2b-4b26-9254-f0c9f6470598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:49.289572 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:49.361024 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1146/2290] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:59:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:59:49.367104 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa85cad-7b13-4d6d-8cf1-b4b66b3806cd admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:49.443029 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa85cad-7b13-4d6d-8cf1-b4b66b3806cd admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:49.450039 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d691d-ba32-43f9-9605-c00fa3840ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:49.451036 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d691d-ba32-43f9-9605-c00fa3840ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:49.451470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d691d-ba32-43f9-9605-c00fa3840ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:49.451762 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d691d-ba32-43f9-9605-c00fa3840ab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:49.452662 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d691d-ba32-43f9-9605-c00fa3840ab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:49.455171 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d691d-ba32-43f9-9605-c00fa3840ab9 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:49.681955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1145/2291] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:59:49 2022] POST /identity/v3/projects => generated 380 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:59:49.684747 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06c517-7e2b-4b26-9254-f0c9f6470598 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:49.697840 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06c517-7e2b-4b26-9254-f0c9f6470598 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:49.770058 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67c2a2-ed98-4baf-b8ad-a70c604fdf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:49.770747 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67c2a2-ed98-4baf-b8ad-a70c604fdf3b admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:49.771038 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67c2a2-ed98-4baf-b8ad-a70c604fdf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:49.771379 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67c2a2-ed98-4baf-b8ad-a70c604fdf3b admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:49.772213 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67c2a2-ed98-4baf-b8ad-a70c604fdf3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:49.775335 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67c2a2-ed98-4baf-b8ad-a70c604fdf3b admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:49.843794 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1147/2292] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:59:49 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:59:49.847232 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d691d-ba32-43f9-9605-c00fa3840ab9 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:49.859833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d691d-ba32-43f9-9605-c00fa3840ab9 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:49.865428 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6747d2e-0213-4489-8421-b0eb42e14e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:49.866210 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6747d2e-0213-4489-8421-b0eb42e14e2f admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:49.866557 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6747d2e-0213-4489-8421-b0eb42e14e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:49.866864 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6747d2e-0213-4489-8421-b0eb42e14e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:49.867792 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6747d2e-0213-4489-8421-b0eb42e14e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:49.869809 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6747d2e-0213-4489-8421-b0eb42e14e2f admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:49.886806 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1146/2293] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:59:49 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:59:49.888082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67c2a2-ed98-4baf-b8ad-a70c604fdf3b admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:49.900176 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67c2a2-ed98-4baf-b8ad-a70c604fdf3b admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:49.905158 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b287584-f8c6-4d20-9f08-fb1a49fdb7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:49.906195 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b287584-f8c6-4d20-9f08-fb1a49fdb7e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:49.906485 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b287584-f8c6-4d20-9f08-fb1a49fdb7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:49.906770 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b287584-f8c6-4d20-9f08-fb1a49fdb7e5 admin admin] PATH_INFO: `/v3/projects/f32fdd1b01b94ae58711cb180c4ced66/users/0980032865c04e29bf9c4423e7ba29c2/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:49.923202 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b287584-f8c6-4d20-9f08-fb1a49fdb7e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f32fdd1b01b94ae58711cb180c4ced66, user_id=0980032865c04e29bf9c4423e7ba29c2, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:49.926097 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b287584-f8c6-4d20-9f08-fb1a49fdb7e5 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:50.020602 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1148/2294] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:59:49 2022] PUT /identity/v3/projects/f32fdd1b01b94ae58711cb180c4ced66/users/0980032865c04e29bf9c4423e7ba29c2/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:50.025527 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6747d2e-0213-4489-8421-b0eb42e14e2f admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:50.037846 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6747d2e-0213-4489-8421-b0eb42e14e2f admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:50.102398 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65c23d-918d-432c-aec3-75630588d179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:50.103545 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65c23d-918d-432c-aec3-75630588d179 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:50.103828 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65c23d-918d-432c-aec3-75630588d179 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:50.104141 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65c23d-918d-432c-aec3-75630588d179 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:50.104883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65c23d-918d-432c-aec3-75630588d179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:50.106502 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65c23d-918d-432c-aec3-75630588d179 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:50.112151 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:50.117427 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1147/2295] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:59:50 2022] GET /identity/v3/roles => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:59:50.123027 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b287584-f8c6-4d20-9f08-fb1a49fdb7e5 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:50.135929 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b287584-f8c6-4d20-9f08-fb1a49fdb7e5 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:50.141650 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05430957-cb1a-419f-8110-8d2b00f13002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:50.142616 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05430957-cb1a-419f-8110-8d2b00f13002 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:50.143149 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05430957-cb1a-419f-8110-8d2b00f13002 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:50.143483 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05430957-cb1a-419f-8110-8d2b00f13002 admin admin] PATH_INFO: `/v3/projects/f32fdd1b01b94ae58711cb180c4ced66/users/0980032865c04e29bf9c4423e7ba29c2/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:50.145821 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05430957-cb1a-419f-8110-8d2b00f13002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f32fdd1b01b94ae58711cb180c4ced66, user_id=0980032865c04e29bf9c4423e7ba29c2, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:50.148620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05430957-cb1a-419f-8110-8d2b00f13002 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:50.160636 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1149/2296] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:59:50 2022] PUT /identity/v3/projects/f32fdd1b01b94ae58711cb180c4ced66/users/0980032865c04e29bf9c4423e7ba29c2/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:50.172439 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eee61a-314d-480e-90fd-cc211e7e5c5f None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:50.172804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eee61a-314d-480e-90fd-cc211e7e5c5f None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:50.173092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eee61a-314d-480e-90fd-cc211e7e5c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:50.202147 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-56eee61a-314d-480e-90fd-cc211e7e5c5f None None] MFA Rules not processed for user `0980032865c04e29bf9c4423e7ba29c2`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:50.203366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-56eee61a-314d-480e-90fd-cc211e7e5c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:50.278149 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1148/2297] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:59:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:59:50.289772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05430957-cb1a-419f-8110-8d2b00f13002 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:50.291677 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-05430957-cb1a-419f-8110-8d2b00f13002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:50.353083 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05430957-cb1a-419f-8110-8d2b00f13002 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:50.357114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c323a-434c-442c-a212-42a249f18436 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:50.357798 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c323a-434c-442c-a212-42a249f18436 service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:50.358083 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c323a-434c-442c-a212-42a249f18436 service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:50.358361 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c323a-434c-442c-a212-42a249f18436 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:50.369533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c323a-434c-442c-a212-42a249f18436 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:50.371142 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c323a-434c-442c-a212-42a249f18436 service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:50.382163 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1150/2298] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:59:50 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:59:50.576693 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eee61a-314d-480e-90fd-cc211e7e5c5f None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:50.578592 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-56eee61a-314d-480e-90fd-cc211e7e5c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:50.593296 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eee61a-314d-480e-90fd-cc211e7e5c5f None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:50.600208 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed1681-d28a-4619-bfea-ef8c43cb62df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:50.600973 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed1681-d28a-4619-bfea-ef8c43cb62df service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:50.602005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed1681-d28a-4619-bfea-ef8c43cb62df service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:50.602005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed1681-d28a-4619-bfea-ef8c43cb62df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:50.694957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed1681-d28a-4619-bfea-ef8c43cb62df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:50.703334 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed1681-d28a-4619-bfea-ef8c43cb62df service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:50.717735 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1149/2299] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:59:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:59:51.734094 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c323a-434c-442c-a212-42a249f18436 service cinder] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:51.736129 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-ca4c323a-434c-442c-a212-42a249f18436 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:51.763032 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:51.819087 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c323a-434c-442c-a212-42a249f18436 service cinder] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:51.824403 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4201c-d6d1-49db-b6da-ce4969abd1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:51.825609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4201c-d6d1-49db-b6da-ce4969abd1c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:51.826098 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4201c-d6d1-49db-b6da-ce4969abd1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:51.826587 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4201c-d6d1-49db-b6da-ce4969abd1c3 admin admin] PATH_INFO: `/v3/users/6a713d55889246049668bdb4e221c998` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:51.828080 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4201c-d6d1-49db-b6da-ce4969abd1c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a713d55889246049668bdb4e221c998)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:51.831794 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4201c-d6d1-49db-b6da-ce4969abd1c3 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:52.107061 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-16e4201c-d6d1-49db-b6da-ce4969abd1c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a713d55889246049668bdb4e221c998'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:52.113325 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-16e4201c-d6d1-49db-b6da-ce4969abd1c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a713d55889246049668bdb4e221c998'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:52.125676 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-16e4201c-d6d1-49db-b6da-ce4969abd1c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a713d55889246049668bdb4e221c998'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:52.144983 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-16e4201c-d6d1-49db-b6da-ce4969abd1c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a713d55889246049668bdb4e221c998'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:52.145762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-16e4201c-d6d1-49db-b6da-ce4969abd1c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a713d55889246049668bdb4e221c998'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:52.244467 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1151/2300] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:59:51 2022] DELETE /identity/v3/users/6a713d55889246049668bdb4e221c998 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:52.540939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed1681-d28a-4619-bfea-ef8c43cb62df service cinder] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:52.554545 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed1681-d28a-4619-bfea-ef8c43cb62df service cinder] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:52.621094 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af38185-8db7-4418-982e-e0f7cad019f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:52.621998 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af38185-8db7-4418-982e-e0f7cad019f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:52.622414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af38185-8db7-4418-982e-e0f7cad019f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:52.622701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af38185-8db7-4418-982e-e0f7cad019f4 admin admin] PATH_INFO: `/v3/projects/cbdae82cb97b48b7a541a22084bc111f` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:52.623943 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af38185-8db7-4418-982e-e0f7cad019f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbdae82cb97b48b7a541a22084bc111f)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:52.625872 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af38185-8db7-4418-982e-e0f7cad019f4 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:52.731043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:52.749120 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-8af38185-8db7-4418-982e-e0f7cad019f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbdae82cb97b48b7a541a22084bc111f', 'request_id': 'req-8af38185-8db7-4418-982e-e0f7cad019f4'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:52.755716 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-8af38185-8db7-4418-982e-e0f7cad019f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbdae82cb97b48b7a541a22084bc111f', 'request_id': 'req-8af38185-8db7-4418-982e-e0f7cad019f4'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:53.156418 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-8af38185-8db7-4418-982e-e0f7cad019f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbdae82cb97b48b7a541a22084bc111f', 'request_id': 'req-8af38185-8db7-4418-982e-e0f7cad019f4'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:53.176482 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-8af38185-8db7-4418-982e-e0f7cad019f4 admin admin] The token cache is being invalidate because project cbdae82cb97b48b7a541a22084bc111f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:59:53.176482 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-8af38185-8db7-4418-982e-e0f7cad019f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:53.176482 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-8af38185-8db7-4418-982e-e0f7cad019f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:53.176482 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1150/2301] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:59:52 2022] DELETE /identity/v3/projects/cbdae82cb97b48b7a541a22084bc111f => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:53.180037 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe37452-4662-42e5-b354-05ffefc3c317 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:53.180620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe37452-4662-42e5-b354-05ffefc3c317 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:53.180721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe37452-4662-42e5-b354-05ffefc3c317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:53.200263 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-5fe37452-4662-42e5-b354-05ffefc3c317 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:53.201495 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-5fe37452-4662-42e5-b354-05ffefc3c317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:53.268554 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1152/2302] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:59:53.278340 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316a27c-ce2f-4d3c-8be0-5bf5de849811 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:53.278575 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316a27c-ce2f-4d3c-8be0-5bf5de849811 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:53.278861 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316a27c-ce2f-4d3c-8be0-5bf5de849811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:53.298664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-c316a27c-ce2f-4d3c-8be0-5bf5de849811 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:53.299997 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-c316a27c-ce2f-4d3c-8be0-5bf5de849811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:53.309205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1151/2303] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:59:53.313824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe37452-4662-42e5-b354-05ffefc3c317 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:53.323983 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe37452-4662-42e5-b354-05ffefc3c317 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:53.329068 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283a2bb-d2f6-4019-ab58-025d48ff1a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:53.329736 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283a2bb-d2f6-4019-ab58-025d48ff1a1a admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:53.330020 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283a2bb-d2f6-4019-ab58-025d48ff1a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:53.330300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283a2bb-d2f6-4019-ab58-025d48ff1a1a admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:53.331064 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283a2bb-d2f6-4019-ab58-025d48ff1a1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:59:53.331336 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283a2bb-d2f6-4019-ab58-025d48ff1a1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:53.333066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283a2bb-d2f6-4019-ab58-025d48ff1a1a admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:53.346600 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1153/2304] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 15:59:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:59:53.351115 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316a27c-ce2f-4d3c-8be0-5bf5de849811 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:53.361797 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316a27c-ce2f-4d3c-8be0-5bf5de849811 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:53.366974 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4add8b8-8ab5-4e75-90cc-914e5e875a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:53.367720 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4add8b8-8ab5-4e75-90cc-914e5e875a34 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:53.368013 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4add8b8-8ab5-4e75-90cc-914e5e875a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:53.368430 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4add8b8-8ab5-4e75-90cc-914e5e875a34 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:53.369205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4add8b8-8ab5-4e75-90cc-914e5e875a34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:53.371111 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4add8b8-8ab5-4e75-90cc-914e5e875a34 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:53.490833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1152/2305] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 15:59:53 2022] POST /identity/v3/projects => generated 374 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:59:53.503933 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283a2bb-d2f6-4019-ab58-025d48ff1a1a admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:53.506921 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283a2bb-d2f6-4019-ab58-025d48ff1a1a admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:53.572482 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d36242-8b5d-456a-904c-2bd5bc617145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:53.573116 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d36242-8b5d-456a-904c-2bd5bc617145 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:53.573423 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d36242-8b5d-456a-904c-2bd5bc617145 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:53.573728 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d36242-8b5d-456a-904c-2bd5bc617145 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:53.574457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d36242-8b5d-456a-904c-2bd5bc617145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:53.576408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d36242-8b5d-456a-904c-2bd5bc617145 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:53.676285 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:53.729893 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1154/2306] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 15:59:53 2022] POST /identity/v3/users => generated 288 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:59:53.734487 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4add8b8-8ab5-4e75-90cc-914e5e875a34 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:53.746397 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4add8b8-8ab5-4e75-90cc-914e5e875a34 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:53.751721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a264f-5d7c-4d9b-aa85-e8d4ac5068fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:53.752633 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a264f-5d7c-4d9b-aa85-e8d4ac5068fc admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:53.752925 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a264f-5d7c-4d9b-aa85-e8d4ac5068fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:53.753211 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a264f-5d7c-4d9b-aa85-e8d4ac5068fc admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:53.753949 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a264f-5d7c-4d9b-aa85-e8d4ac5068fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:53.755607 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a264f-5d7c-4d9b-aa85-e8d4ac5068fc admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:53.769007 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1153/2307] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:59:53 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:59:53.774750 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d36242-8b5d-456a-904c-2bd5bc617145 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:53.785456 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d36242-8b5d-456a-904c-2bd5bc617145 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:53.791727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac5ef8-981e-4d82-a264-beaa3da6125c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:53.792461 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac5ef8-981e-4d82-a264-beaa3da6125c admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:53.792727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac5ef8-981e-4d82-a264-beaa3da6125c admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:53.793004 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac5ef8-981e-4d82-a264-beaa3da6125c admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:53.793740 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac5ef8-981e-4d82-a264-beaa3da6125c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:53.795388 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac5ef8-981e-4d82-a264-beaa3da6125c admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:53.810512 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1155/2308] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 15:59:53 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:59:53.817770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a264f-5d7c-4d9b-aa85-e8d4ac5068fc admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:53.823760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a264f-5d7c-4d9b-aa85-e8d4ac5068fc admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:53.828911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab0c9b-a401-45f6-acbe-f2ddea1d518f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:53.829756 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab0c9b-a401-45f6-acbe-f2ddea1d518f admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:53.830046 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab0c9b-a401-45f6-acbe-f2ddea1d518f admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:53.830327 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab0c9b-a401-45f6-acbe-f2ddea1d518f admin admin] PATH_INFO: `/v3/projects/976bae50af4d476b9195b2006bd707fb/users/fc90ff5846f6412c9a36a3f66fdc403c/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:53.845940 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab0c9b-a401-45f6-acbe-f2ddea1d518f admin admin] RBAC: Authorizing `identity:create_grant(project_id=976bae50af4d476b9195b2006bd707fb, user_id=fc90ff5846f6412c9a36a3f66fdc403c, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:53.848639 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab0c9b-a401-45f6-acbe-f2ddea1d518f admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:53.998372 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1154/2309] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 15:59:53 2022] PUT /identity/v3/projects/976bae50af4d476b9195b2006bd707fb/users/fc90ff5846f6412c9a36a3f66fdc403c/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:59:54.008534 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f5f6e-ee0b-464a-a3f1-9cef134e44b4 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:54.008898 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f5f6e-ee0b-464a-a3f1-9cef134e44b4 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:54.009218 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f5f6e-ee0b-464a-a3f1-9cef134e44b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:54.037433 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-bb6f5f6e-ee0b-464a-a3f1-9cef134e44b4 None None] MFA Rules not processed for user `fc90ff5846f6412c9a36a3f66fdc403c`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:54.038731 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-bb6f5f6e-ee0b-464a-a3f1-9cef134e44b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:54.111544 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1156/2310] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:59:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:59:54.122770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab0c9b-a401-45f6-acbe-f2ddea1d518f admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:54.129782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-55ab0c9b-a401-45f6-acbe-f2ddea1d518f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:54.213991 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab0c9b-a401-45f6-acbe-f2ddea1d518f admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:54.218530 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547437e4-204f-467c-8be6-441495d09cab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:54.219204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547437e4-204f-467c-8be6-441495d09cab service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:54.219495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547437e4-204f-467c-8be6-441495d09cab service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:54.220407 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547437e4-204f-467c-8be6-441495d09cab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:54.233250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547437e4-204f-467c-8be6-441495d09cab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:54.235149 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547437e4-204f-467c-8be6-441495d09cab service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:54.249403 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1155/2311] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:59:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:59:57.198212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68949af-7ff3-4f10-a805-e23d95a3d33b None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:57.198768 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68949af-7ff3-4f10-a805-e23d95a3d33b None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:57.198768 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68949af-7ff3-4f10-a805-e23d95a3d33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:57.222331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-f68949af-7ff3-4f10-a805-e23d95a3d33b None None] MFA Rules not processed for user `fc90ff5846f6412c9a36a3f66fdc403c`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:57.222331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f68949af-7ff3-4f10-a805-e23d95a3d33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:57.226674 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1157/2312] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:59:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:59:57.824950 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547437e4-204f-467c-8be6-441495d09cab service cinder] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:57.826634 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-547437e4-204f-467c-8be6-441495d09cab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:57.944555 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:57.973309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547437e4-204f-467c-8be6-441495d09cab service cinder] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:57.978537 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0d2cc-cbd8-4ae6-9eb3-dbe7c065db73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:57.979444 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0d2cc-cbd8-4ae6-9eb3-dbe7c065db73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:57.979719 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0d2cc-cbd8-4ae6-9eb3-dbe7c065db73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:57.980085 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0d2cc-cbd8-4ae6-9eb3-dbe7c065db73 admin admin] PATH_INFO: `/v3/users/bc09737aece34e97b00936372737797c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:57.984187 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0d2cc-cbd8-4ae6-9eb3-dbe7c065db73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc09737aece34e97b00936372737797c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:57.984187 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0d2cc-cbd8-4ae6-9eb3-dbe7c065db73 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:58.226261 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-1ef0d2cc-cbd8-4ae6-9eb3-dbe7c065db73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc09737aece34e97b00936372737797c'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:58.250130 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-1ef0d2cc-cbd8-4ae6-9eb3-dbe7c065db73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc09737aece34e97b00936372737797c'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:58.269989 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-1ef0d2cc-cbd8-4ae6-9eb3-dbe7c065db73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc09737aece34e97b00936372737797c'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:58.270971 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-1ef0d2cc-cbd8-4ae6-9eb3-dbe7c065db73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc09737aece34e97b00936372737797c'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:58.372880 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-1ef0d2cc-cbd8-4ae6-9eb3-dbe7c065db73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc09737aece34e97b00936372737797c'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:58.380677 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1156/2313] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:59:57 2022] DELETE /identity/v3/users/bc09737aece34e97b00936372737797c => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:59:58.386301 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e365ace-6520-4ce3-9c80-cd162b0f22f6 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:58.386835 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e365ace-6520-4ce3-9c80-cd162b0f22f6 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:58.386918 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e365ace-6520-4ce3-9c80-cd162b0f22f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:58.411253 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-1e365ace-6520-4ce3-9c80-cd162b0f22f6 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:59:58.412870 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-1e365ace-6520-4ce3-9c80-cd162b0f22f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:58.485214 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1158/2314] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 15:59:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:59:58.496197 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0d2cc-cbd8-4ae6-9eb3-dbe7c065db73 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:58.497943 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-1ef0d2cc-cbd8-4ae6-9eb3-dbe7c065db73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:58.576023 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0d2cc-cbd8-4ae6-9eb3-dbe7c065db73 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:58.580091 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc6e3d-c83b-4fb3-b1e4-82b4478c6992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:58.580883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc6e3d-c83b-4fb3-b1e4-82b4478c6992 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:58.581254 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc6e3d-c83b-4fb3-b1e4-82b4478c6992 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:58.581549 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc6e3d-c83b-4fb3-b1e4-82b4478c6992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:58.593277 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc6e3d-c83b-4fb3-b1e4-82b4478c6992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:58.595047 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc6e3d-c83b-4fb3-b1e4-82b4478c6992 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:58.607167 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1157/2315] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 15:59:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:59:59.119112 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e365ace-6520-4ce3-9c80-cd162b0f22f6 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:59.125327 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-1e365ace-6520-4ce3-9c80-cd162b0f22f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:59.134854 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e365ace-6520-4ce3-9c80-cd162b0f22f6 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:59.141821 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1387d9-c71e-4b94-863d-29a594c733c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:59.143455 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1387d9-c71e-4b94-863d-29a594c733c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:59.143455 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1387d9-c71e-4b94-863d-29a594c733c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:59.143455 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1387d9-c71e-4b94-863d-29a594c733c6 admin admin] PATH_INFO: `/v3/projects/4259dd633ef845e5af90b109b145dd90` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:59.167499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1387d9-c71e-4b94-863d-29a594c733c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4259dd633ef845e5af90b109b145dd90)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:59.169486 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1387d9-c71e-4b94-863d-29a594c733c6 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:59.190336 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:59.300864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-2b1387d9-c71e-4b94-863d-29a594c733c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4259dd633ef845e5af90b109b145dd90', 'request_id': 'req-2b1387d9-c71e-4b94-863d-29a594c733c6'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:59.314803 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-2b1387d9-c71e-4b94-863d-29a594c733c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4259dd633ef845e5af90b109b145dd90', 'request_id': 'req-2b1387d9-c71e-4b94-863d-29a594c733c6'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:59.321471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-2b1387d9-c71e-4b94-863d-29a594c733c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4259dd633ef845e5af90b109b145dd90', 'request_id': 'req-2b1387d9-c71e-4b94-863d-29a594c733c6'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:59.420981 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-2b1387d9-c71e-4b94-863d-29a594c733c6 admin admin] The token cache is being invalidate because project 4259dd633ef845e5af90b109b145dd90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:59:59.421570 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-2b1387d9-c71e-4b94-863d-29a594c733c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:59.422018 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-2b1387d9-c71e-4b94-863d-29a594c733c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:59.423615 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1159/2316] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 15:59:59 2022] DELETE /identity/v3/projects/4259dd633ef845e5af90b109b145dd90 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:59:59.427769 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc6e3d-c83b-4fb3-b1e4-82b4478c6992 service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:59.438711 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc6e3d-c83b-4fb3-b1e4-82b4478c6992 service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:59.499210 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45a559-2265-4101-9b19-916159a11bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:59.500089 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45a559-2265-4101-9b19-916159a11bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:59.500403 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45a559-2265-4101-9b19-916159a11bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:59.500747 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45a559-2265-4101-9b19-916159a11bd6 admin admin] PATH_INFO: `/v3/users/7a1fd9b4145b4b5ab870ec4e68c7a054` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:59.502132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45a559-2265-4101-9b19-916159a11bd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a1fd9b4145b4b5ab870ec4e68c7a054)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:59.504559 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45a559-2265-4101-9b19-916159a11bd6 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:59.524923 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:59.842158 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-8b45a559-2265-4101-9b19-916159a11bd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a1fd9b4145b4b5ab870ec4e68c7a054'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:59.852335 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-8b45a559-2265-4101-9b19-916159a11bd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a1fd9b4145b4b5ab870ec4e68c7a054'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:59.859582 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-8b45a559-2265-4101-9b19-916159a11bd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a1fd9b4145b4b5ab870ec4e68c7a054'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:59:59.862132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-8b45a559-2265-4101-9b19-916159a11bd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a1fd9b4145b4b5ab870ec4e68c7a054'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:00:00.048871 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-8b45a559-2265-4101-9b19-916159a11bd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a1fd9b4145b4b5ab870ec4e68c7a054'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:00:00.055765 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1158/2317] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 15:59:59 2022] DELETE /identity/v3/users/7a1fd9b4145b4b5ab870ec4e68c7a054 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:00:00.626284 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1387d9-c71e-4b94-863d-29a594c733c6 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:00.627712 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-2b1387d9-c71e-4b94-863d-29a594c733c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:00.643798 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1387d9-c71e-4b94-863d-29a594c733c6 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:00.702699 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa985b-813c-473d-9249-3006a1953549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:00.703680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa985b-813c-473d-9249-3006a1953549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:00.703972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa985b-813c-473d-9249-3006a1953549 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:00.704306 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa985b-813c-473d-9249-3006a1953549 admin admin] PATH_INFO: `/v3/projects/068f83d54b8f4f2a8ae5fa3419776c5b` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:00.705503 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa985b-813c-473d-9249-3006a1953549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=068f83d54b8f4f2a8ae5fa3419776c5b)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:00.707412 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa985b-813c-473d-9249-3006a1953549 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:00.865579 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-3afa985b-813c-473d-9249-3006a1953549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '068f83d54b8f4f2a8ae5fa3419776c5b', 'request_id': 'req-3afa985b-813c-473d-9249-3006a1953549'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:00:00.872918 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-3afa985b-813c-473d-9249-3006a1953549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '068f83d54b8f4f2a8ae5fa3419776c5b', 'request_id': 'req-3afa985b-813c-473d-9249-3006a1953549'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:00:00.878575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-3afa985b-813c-473d-9249-3006a1953549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '068f83d54b8f4f2a8ae5fa3419776c5b', 'request_id': 'req-3afa985b-813c-473d-9249-3006a1953549'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:00:00.962528 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-3afa985b-813c-473d-9249-3006a1953549 admin admin] The token cache is being invalidate because project 068f83d54b8f4f2a8ae5fa3419776c5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:00:00.962914 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-3afa985b-813c-473d-9249-3006a1953549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:00:00.963570 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-3afa985b-813c-473d-9249-3006a1953549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:00:00.965225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1160/2318] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:00:00 2022] DELETE /identity/v3/projects/068f83d54b8f4f2a8ae5fa3419776c5b => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:00:00.970818 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45a559-2265-4101-9b19-916159a11bd6 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:00.971271 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-8b45a559-2265-4101-9b19-916159a11bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:00.983842 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45a559-2265-4101-9b19-916159a11bd6 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:01.040462 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82e44b-d198-4077-8ac4-590a9f48ed05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:01.041333 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82e44b-d198-4077-8ac4-590a9f48ed05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:01.041666 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82e44b-d198-4077-8ac4-590a9f48ed05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:01.041976 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82e44b-d198-4077-8ac4-590a9f48ed05 admin admin] PATH_INFO: `/v3/users/0980032865c04e29bf9c4423e7ba29c2` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:01.043172 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82e44b-d198-4077-8ac4-590a9f48ed05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0980032865c04e29bf9c4423e7ba29c2)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:01.045129 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82e44b-d198-4077-8ac4-590a9f48ed05 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:01.213677 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-ab82e44b-d198-4077-8ac4-590a9f48ed05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0980032865c04e29bf9c4423e7ba29c2'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:00:01.226616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-ab82e44b-d198-4077-8ac4-590a9f48ed05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0980032865c04e29bf9c4423e7ba29c2'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:00:01.234207 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-ab82e44b-d198-4077-8ac4-590a9f48ed05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0980032865c04e29bf9c4423e7ba29c2'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:00:01.234956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-ab82e44b-d198-4077-8ac4-590a9f48ed05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0980032865c04e29bf9c4423e7ba29c2'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:00:01.300853 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-ab82e44b-d198-4077-8ac4-590a9f48ed05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0980032865c04e29bf9c4423e7ba29c2'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:00:01.308328 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1159/2319] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:00:00 2022] DELETE /identity/v3/users/0980032865c04e29bf9c4423e7ba29c2 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:00:01.907969 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa985b-813c-473d-9249-3006a1953549 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:01.909535 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-3afa985b-813c-473d-9249-3006a1953549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:01.925212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa985b-813c-473d-9249-3006a1953549 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:01.960571 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:01.985493 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc33ce-a665-4f57-be2b-623f98d296f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:01.986375 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc33ce-a665-4f57-be2b-623f98d296f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:01.986658 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc33ce-a665-4f57-be2b-623f98d296f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:01.987129 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc33ce-a665-4f57-be2b-623f98d296f7 admin admin] PATH_INFO: `/v3/projects/f32fdd1b01b94ae58711cb180c4ced66` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:01.988358 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc33ce-a665-4f57-be2b-623f98d296f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f32fdd1b01b94ae58711cb180c4ced66)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:01.990279 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc33ce-a665-4f57-be2b-623f98d296f7 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:02.110253 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-49cc33ce-a665-4f57-be2b-623f98d296f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f32fdd1b01b94ae58711cb180c4ced66', 'request_id': 'req-49cc33ce-a665-4f57-be2b-623f98d296f7'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:00:02.116365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-49cc33ce-a665-4f57-be2b-623f98d296f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f32fdd1b01b94ae58711cb180c4ced66', 'request_id': 'req-49cc33ce-a665-4f57-be2b-623f98d296f7'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:00:02.121869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-49cc33ce-a665-4f57-be2b-623f98d296f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f32fdd1b01b94ae58711cb180c4ced66', 'request_id': 'req-49cc33ce-a665-4f57-be2b-623f98d296f7'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:00:02.214737 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-49cc33ce-a665-4f57-be2b-623f98d296f7 admin admin] The token cache is being invalidate because project f32fdd1b01b94ae58711cb180c4ced66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:00:02.214959 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-49cc33ce-a665-4f57-be2b-623f98d296f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:00:02.215600 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-49cc33ce-a665-4f57-be2b-623f98d296f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:00:02.217249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1161/2320] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:00:01 2022] DELETE /identity/v3/projects/f32fdd1b01b94ae58711cb180c4ced66 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:00:02.224673 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f33cae-c1eb-47cc-9b63-bbcc7f2010eb None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:02.225134 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f33cae-c1eb-47cc-9b63-bbcc7f2010eb None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:02.225715 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f33cae-c1eb-47cc-9b63-bbcc7f2010eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:02.243713 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-37f33cae-c1eb-47cc-9b63-bbcc7f2010eb None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:00:02.244983 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-37f33cae-c1eb-47cc-9b63-bbcc7f2010eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:02.253505 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:02.306594 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1160/2321] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:00:02.315325 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660ee2c-3ae1-4e26-bbd9-995d6fa76006 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:02.315618 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660ee2c-3ae1-4e26-bbd9-995d6fa76006 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:02.315952 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660ee2c-3ae1-4e26-bbd9-995d6fa76006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:02.334034 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-6660ee2c-3ae1-4e26-bbd9-995d6fa76006 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:00:02.335507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-6660ee2c-3ae1-4e26-bbd9-995d6fa76006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:02.344138 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1162/2322] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:00:02.348335 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f33cae-c1eb-47cc-9b63-bbcc7f2010eb None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:02.358999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f33cae-c1eb-47cc-9b63-bbcc7f2010eb None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:02.363925 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93d872-fa8b-420e-aee3-bf1d24c5cd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:02.364624 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93d872-fa8b-420e-aee3-bf1d24c5cd87 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:02.364917 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93d872-fa8b-420e-aee3-bf1d24c5cd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:02.365203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93d872-fa8b-420e-aee3-bf1d24c5cd87 admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:02.366060 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93d872-fa8b-420e-aee3-bf1d24c5cd87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:00:02.366380 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93d872-fa8b-420e-aee3-bf1d24c5cd87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:02.368761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93d872-fa8b-420e-aee3-bf1d24c5cd87 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:02.380409 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1161/2323] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 16:00:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:00:02.385373 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660ee2c-3ae1-4e26-bbd9-995d6fa76006 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:02.394635 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660ee2c-3ae1-4e26-bbd9-995d6fa76006 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:02.399306 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20760483-cd18-48b7-b963-0564ac58a0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:02.399974 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20760483-cd18-48b7-b963-0564ac58a0cc admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:02.400308 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20760483-cd18-48b7-b963-0564ac58a0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:02.400611 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20760483-cd18-48b7-b963-0564ac58a0cc admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:02.401299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20760483-cd18-48b7-b963-0564ac58a0cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:02.403226 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20760483-cd18-48b7-b963-0564ac58a0cc admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:02.560434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1163/2324] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:00:02 2022] POST /identity/v3/projects => generated 384 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:00:02.565066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93d872-fa8b-420e-aee3-bf1d24c5cd87 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:02.578469 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93d872-fa8b-420e-aee3-bf1d24c5cd87 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:02.641360 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa27499-7105-47f3-9e8a-4405173a1ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:02.642043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa27499-7105-47f3-9e8a-4405173a1ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:02.642329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa27499-7105-47f3-9e8a-4405173a1ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:02.642607 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa27499-7105-47f3-9e8a-4405173a1ac4 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:02.643333 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa27499-7105-47f3-9e8a-4405173a1ac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:02.645286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa27499-7105-47f3-9e8a-4405173a1ac4 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:02.813793 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1162/2325] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:00:02 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:00:02.817815 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20760483-cd18-48b7-b963-0564ac58a0cc admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:02.828206 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20760483-cd18-48b7-b963-0564ac58a0cc admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:02.832893 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf4bf2-dc2b-4a41-84b2-ab2b25c694bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:02.833558 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf4bf2-dc2b-4a41-84b2-ab2b25c694bd admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:02.833872 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf4bf2-dc2b-4a41-84b2-ab2b25c694bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:02.834149 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf4bf2-dc2b-4a41-84b2-ab2b25c694bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:02.835852 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf4bf2-dc2b-4a41-84b2-ab2b25c694bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:02.837431 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf4bf2-dc2b-4a41-84b2-ab2b25c694bd admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:02.848209 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1164/2326] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:00:02 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:00:02.853560 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa27499-7105-47f3-9e8a-4405173a1ac4 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:02.863201 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa27499-7105-47f3-9e8a-4405173a1ac4 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:02.868229 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457332a-e2b1-44be-805d-ea5747245bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:02.874373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457332a-e2b1-44be-805d-ea5747245bed admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:02.874373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457332a-e2b1-44be-805d-ea5747245bed admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:02.874373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457332a-e2b1-44be-805d-ea5747245bed admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:02.874373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457332a-e2b1-44be-805d-ea5747245bed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:02.874373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457332a-e2b1-44be-805d-ea5747245bed admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:02.887527 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1163/2327] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:00:02 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 16:00:02.888896 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf4bf2-dc2b-4a41-84b2-ab2b25c694bd admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:02.899936 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf4bf2-dc2b-4a41-84b2-ab2b25c694bd admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:02.904865 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a785c-962a-4f84-b055-a9e19ad40d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:02.907408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a785c-962a-4f84-b055-a9e19ad40d2e admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:02.907408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a785c-962a-4f84-b055-a9e19ad40d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:02.907408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a785c-962a-4f84-b055-a9e19ad40d2e admin admin] PATH_INFO: `/v3/projects/a02d8a2f826a4475982abb77ccc636f5/users/f891f70cc0e34e1f98116dec9c09cc5f/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:02.924998 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a785c-962a-4f84-b055-a9e19ad40d2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a02d8a2f826a4475982abb77ccc636f5, user_id=f891f70cc0e34e1f98116dec9c09cc5f, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:02.930058 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a785c-962a-4f84-b055-a9e19ad40d2e admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:03.050425 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1165/2328] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:00:02 2022] PUT /identity/v3/projects/a02d8a2f826a4475982abb77ccc636f5/users/f891f70cc0e34e1f98116dec9c09cc5f/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:00:03.055648 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdeb9d0-8cf6-422e-8b73-88bb3c6dd3b2 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:03.056381 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdeb9d0-8cf6-422e-8b73-88bb3c6dd3b2 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:03.056695 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdeb9d0-8cf6-422e-8b73-88bb3c6dd3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:03.077572 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-2cdeb9d0-8cf6-422e-8b73-88bb3c6dd3b2 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:00:03.077572 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-2cdeb9d0-8cf6-422e-8b73-88bb3c6dd3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:03.142664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1164/2329] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:00:03.164720 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a785c-962a-4f84-b055-a9e19ad40d2e admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:03.168572 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-665a785c-962a-4f84-b055-a9e19ad40d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:03.239277 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a785c-962a-4f84-b055-a9e19ad40d2e admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:03.243122 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1942e17-f85a-406f-b226-e44a056cd4c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:03.243773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1942e17-f85a-406f-b226-e44a056cd4c5 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:03.244085 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1942e17-f85a-406f-b226-e44a056cd4c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:03.244393 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1942e17-f85a-406f-b226-e44a056cd4c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:03.253634 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1942e17-f85a-406f-b226-e44a056cd4c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:03.255168 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1942e17-f85a-406f-b226-e44a056cd4c5 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:03.266026 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1166/2330] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:00:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:00:04.927469 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a9726-ad51-4ad1-890e-32fc1737d61e None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:04.928067 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a9726-ad51-4ad1-890e-32fc1737d61e None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:04.928067 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a9726-ad51-4ad1-890e-32fc1737d61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:04.957795 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-e57a9726-ad51-4ad1-890e-32fc1737d61e None None] MFA Rules not processed for user `f891f70cc0e34e1f98116dec9c09cc5f`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:00:04.959073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-e57a9726-ad51-4ad1-890e-32fc1737d61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:04.968935 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:05.042384 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1165/2331] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:00:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:00:05.063637 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1942e17-f85a-406f-b226-e44a056cd4c5 service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:05.065101 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-c1942e17-f85a-406f-b226-e44a056cd4c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:05.073151 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:05.125984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1942e17-f85a-406f-b226-e44a056cd4c5 service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:05.130617 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27aab7-367d-4865-9a07-a6a810501654 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:05.131360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27aab7-367d-4865-9a07-a6a810501654 service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:05.131723 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27aab7-367d-4865-9a07-a6a810501654 service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:05.132166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27aab7-367d-4865-9a07-a6a810501654 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:05.142365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27aab7-367d-4865-9a07-a6a810501654 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:05.143817 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27aab7-367d-4865-9a07-a6a810501654 service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:05.153186 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1167/2332] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:00:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:00:08.107410 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f62d4e-b831-41e4-aafa-3d1a07738744 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:08.107939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f62d4e-b831-41e4-aafa-3d1a07738744 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:08.108035 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f62d4e-b831-41e4-aafa-3d1a07738744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:08.125899 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-10f62d4e-b831-41e4-aafa-3d1a07738744 None None] MFA Rules not processed for user `f891f70cc0e34e1f98116dec9c09cc5f`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:00:08.127102 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-10f62d4e-b831-41e4-aafa-3d1a07738744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:08.134910 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1166/2333] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:00:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:00:15.203425 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=24 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:18.120558 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=26 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:21.885212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628d2dd-8943-4662-8151-7ec61808c5e2 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:21.885739 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628d2dd-8943-4662-8151-7ec61808c5e2 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:21.885739 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628d2dd-8943-4662-8151-7ec61808c5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:21.905162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-d628d2dd-8943-4662-8151-7ec61808c5e2 None None] MFA Rules not processed for user `b0d02887422a43e4bb69566a2d64e890`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:00:21.907045 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-d628d2dd-8943-4662-8151-7ec61808c5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:21.965847 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1168/2334] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:00:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:00:31.958065 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=25 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:36.675955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a5f03-aaa9-4e7e-bf5c-0f9f262f972f None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:36.676537 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a5f03-aaa9-4e7e-bf5c-0f9f262f972f None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:36.677058 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a5f03-aaa9-4e7e-bf5c-0f9f262f972f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:36.696289 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-a00a5f03-aaa9-4e7e-bf5c-0f9f262f972f None None] MFA Rules not processed for user `4a1474b39e0b477daff5833491cd6df5`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:00:36.697792 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-a00a5f03-aaa9-4e7e-bf5c-0f9f262f972f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:36.785750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1167/2335] 10.222.0.119 () {58 vars in 1014 bytes} [Thu Jul 14 16:00:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:00:36.810669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628d2dd-8943-4662-8151-7ec61808c5e2 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:36.812143 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-d628d2dd-8943-4662-8151-7ec61808c5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:36.892560 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628d2dd-8943-4662-8151-7ec61808c5e2 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:36.897647 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb731e8c-4ce1-4aa3-9aa1-f6df8a79148e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a5c169576e432c8174a562ae358e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:36.898338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb731e8c-4ce1-4aa3-9aa1-f6df8a79148e service swift] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:36.898773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb731e8c-4ce1-4aa3-9aa1-f6df8a79148e service swift] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:36.899078 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb731e8c-4ce1-4aa3-9aa1-f6df8a79148e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:36.907976 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb731e8c-4ce1-4aa3-9aa1-f6df8a79148e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:36.909631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb731e8c-4ce1-4aa3-9aa1-f6df8a79148e service swift] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:36.918882 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1169/2336] 10.222.0.119 () {60 vars in 1389 bytes} [Thu Jul 14 16:00:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 16:00:37.955783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e972e28-a1b6-4a95-ad64-a085188c93ed None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:37.955783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e972e28-a1b6-4a95-ad64-a085188c93ed None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:37.955783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e972e28-a1b6-4a95-ad64-a085188c93ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:37.970951 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-3e972e28-a1b6-4a95-ad64-a085188c93ed None None] MFA Rules not processed for user `4a1474b39e0b477daff5833491cd6df5`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:00:37.972243 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-3e972e28-a1b6-4a95-ad64-a085188c93ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:37.982484 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1168/2337] 10.222.0.119 () {58 vars in 972 bytes} [Thu Jul 14 16:00:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:00:37.995638 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb731e8c-4ce1-4aa3-9aa1-f6df8a79148e service swift] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:38.007223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb731e8c-4ce1-4aa3-9aa1-f6df8a79148e service swift] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:38.022990 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e361fd-2561-427d-abfc-295f1d3ae117 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a5c169576e432c8174a562ae358e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:38.023660 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e361fd-2561-427d-abfc-295f1d3ae117 service swift] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:38.023950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e361fd-2561-427d-abfc-295f1d3ae117 service swift] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:38.024283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e361fd-2561-427d-abfc-295f1d3ae117 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:38.035123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e361fd-2561-427d-abfc-295f1d3ae117 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:38.037228 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e361fd-2561-427d-abfc-295f1d3ae117 service swift] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:38.047622 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1170/2338] 10.222.0.119 () {60 vars in 1389 bytes} [Thu Jul 14 16:00:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 16:00:39.115858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e60fd2-c396-4f69-b56b-c82554eb9073 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:39.116438 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e60fd2-c396-4f69-b56b-c82554eb9073 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:39.116438 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e60fd2-c396-4f69-b56b-c82554eb9073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:39.136341 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-52e60fd2-c396-4f69-b56b-c82554eb9073 None None] MFA Rules not processed for user `4a1474b39e0b477daff5833491cd6df5`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:00:39.137558 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-52e60fd2-c396-4f69-b56b-c82554eb9073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:39.145275 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1169/2339] 10.222.0.119 () {58 vars in 1014 bytes} [Thu Jul 14 16:00:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:00:39.158033 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e361fd-2561-427d-abfc-295f1d3ae117 service swift] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:39.171085 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e361fd-2561-427d-abfc-295f1d3ae117 service swift] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:39.176671 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960b729-bb8c-45a4-b9f0-5dfd3c2f0559 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a5c169576e432c8174a562ae358e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:39.177344 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960b729-bb8c-45a4-b9f0-5dfd3c2f0559 service swift] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:39.177636 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960b729-bb8c-45a4-b9f0-5dfd3c2f0559 service swift] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:39.177915 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960b729-bb8c-45a4-b9f0-5dfd3c2f0559 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:39.187960 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960b729-bb8c-45a4-b9f0-5dfd3c2f0559 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:39.189644 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960b729-bb8c-45a4-b9f0-5dfd3c2f0559 service swift] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:39.197983 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1171/2340] 10.222.0.119 () {60 vars in 1389 bytes} [Thu Jul 14 16:00:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 16:00:39.959190 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ed978-4bd3-4b4c-83f7-22db321b5557 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:39.959515 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ed978-4bd3-4b4c-83f7-22db321b5557 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:39.959804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ed978-4bd3-4b4c-83f7-22db321b5557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:39.978306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-216ed978-4bd3-4b4c-83f7-22db321b5557 None None] MFA Rules not processed for user `4a1474b39e0b477daff5833491cd6df5`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:00:39.979496 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-216ed978-4bd3-4b4c-83f7-22db321b5557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:39.986801 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1170/2341] 10.222.0.119 () {58 vars in 972 bytes} [Thu Jul 14 16:00:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:00:39.999267 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960b729-bb8c-45a4-b9f0-5dfd3c2f0559 service swift] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:40.010382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960b729-bb8c-45a4-b9f0-5dfd3c2f0559 service swift] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:40.015392 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0a3c7-e991-4421-be0f-8b3a81d95bfc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a5c169576e432c8174a562ae358e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:40.016184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0a3c7-e991-4421-be0f-8b3a81d95bfc service swift] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:40.016394 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0a3c7-e991-4421-be0f-8b3a81d95bfc service swift] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:40.016633 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0a3c7-e991-4421-be0f-8b3a81d95bfc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:40.026159 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0a3c7-e991-4421-be0f-8b3a81d95bfc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:40.027885 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0a3c7-e991-4421-be0f-8b3a81d95bfc service swift] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:40.036481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1172/2342] 10.222.0.119 () {60 vars in 1389 bytes} [Thu Jul 14 16:00:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 16:00:42.928952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ed978-4bd3-4b4c-83f7-22db321b5557 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:42.930383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-216ed978-4bd3-4b4c-83f7-22db321b5557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:42.942651 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ed978-4bd3-4b4c-83f7-22db321b5557 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:42.948324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1290a70-2be4-47a1-a713-831defbb569f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:42.948324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1290a70-2be4-47a1-a713-831defbb569f service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:42.948551 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1290a70-2be4-47a1-a713-831defbb569f service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:42.948811 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1290a70-2be4-47a1-a713-831defbb569f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:42.950715 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-d1290a70-2be4-47a1-a713-831defbb569f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:42.951175 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0a3c7-e991-4421-be0f-8b3a81d95bfc service swift] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:42.952705 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-37c0a3c7-e991-4421-be0f-8b3a81d95bfc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:42.967235 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0a3c7-e991-4421-be0f-8b3a81d95bfc service swift] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:42.972878 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1af95-d37d-425e-a4d4-d7247e387b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:42.974582 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1af95-d37d-425e-a4d4-d7247e387b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:42.974582 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1af95-d37d-425e-a4d4-d7247e387b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:42.974582 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1af95-d37d-425e-a4d4-d7247e387b27 admin admin] PATH_INFO: `/v3/users/fc90ff5846f6412c9a36a3f66fdc403c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:42.975719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1af95-d37d-425e-a4d4-d7247e387b27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc90ff5846f6412c9a36a3f66fdc403c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:42.977818 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1af95-d37d-425e-a4d4-d7247e387b27 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:43.019541 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1290a70-2be4-47a1-a713-831defbb569f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:43.021095 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1290a70-2be4-47a1-a713-831defbb569f service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:43.032719 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1171/2343] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:00:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:00:43.280333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-adf1af95-d37d-425e-a4d4-d7247e387b27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc90ff5846f6412c9a36a3f66fdc403c'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:00:43.281161 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-adf1af95-d37d-425e-a4d4-d7247e387b27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc90ff5846f6412c9a36a3f66fdc403c'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:00:43.297931 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-adf1af95-d37d-425e-a4d4-d7247e387b27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc90ff5846f6412c9a36a3f66fdc403c'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:00:43.305337 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-adf1af95-d37d-425e-a4d4-d7247e387b27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc90ff5846f6412c9a36a3f66fdc403c'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:00:43.306657 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-adf1af95-d37d-425e-a4d4-d7247e387b27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc90ff5846f6412c9a36a3f66fdc403c'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:00:43.463674 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1173/2344] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:00:42 2022] DELETE /identity/v3/users/fc90ff5846f6412c9a36a3f66fdc403c => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:00:43.468497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff50fcc-e705-4ec4-804e-0e6ccf2a04d6 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:43.468865 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff50fcc-e705-4ec4-804e-0e6ccf2a04d6 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:43.469217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff50fcc-e705-4ec4-804e-0e6ccf2a04d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:43.498375 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-9ff50fcc-e705-4ec4-804e-0e6ccf2a04d6 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:00:43.499640 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-9ff50fcc-e705-4ec4-804e-0e6ccf2a04d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:43.593060 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1172/2345] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:00:43.610380 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1af95-d37d-425e-a4d4-d7247e387b27 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:43.612079 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-adf1af95-d37d-425e-a4d4-d7247e387b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:43.648955 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:43.677145 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1af95-d37d-425e-a4d4-d7247e387b27 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:43.683848 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02312c-76bb-4635-aef4-e30b64416a2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:43.686275 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02312c-76bb-4635-aef4-e30b64416a2b service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:43.686275 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02312c-76bb-4635-aef4-e30b64416a2b service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:43.686275 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02312c-76bb-4635-aef4-e30b64416a2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:43.700752 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02312c-76bb-4635-aef4-e30b64416a2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:43.703169 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02312c-76bb-4635-aef4-e30b64416a2b service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:43.719460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1174/2346] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:00:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:00:44.142165 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff50fcc-e705-4ec4-804e-0e6ccf2a04d6 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:44.143746 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-9ff50fcc-e705-4ec4-804e-0e6ccf2a04d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:44.158645 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff50fcc-e705-4ec4-804e-0e6ccf2a04d6 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:44.183019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22367900-4198-4480-9780-4b4fad26419a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:44.183913 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22367900-4198-4480-9780-4b4fad26419a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:44.184434 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22367900-4198-4480-9780-4b4fad26419a admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:44.184890 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22367900-4198-4480-9780-4b4fad26419a admin admin] PATH_INFO: `/v3/projects/976bae50af4d476b9195b2006bd707fb` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:44.186139 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22367900-4198-4480-9780-4b4fad26419a admin admin] RBAC: Authorizing `identity:delete_project(project_id=976bae50af4d476b9195b2006bd707fb)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:44.188071 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22367900-4198-4480-9780-4b4fad26419a admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:44.211385 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:44.326753 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-22367900-4198-4480-9780-4b4fad26419a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '976bae50af4d476b9195b2006bd707fb', 'request_id': 'req-22367900-4198-4480-9780-4b4fad26419a'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:00:44.333260 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-22367900-4198-4480-9780-4b4fad26419a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '976bae50af4d476b9195b2006bd707fb', 'request_id': 'req-22367900-4198-4480-9780-4b4fad26419a'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:00:44.482556 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-22367900-4198-4480-9780-4b4fad26419a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '976bae50af4d476b9195b2006bd707fb', 'request_id': 'req-22367900-4198-4480-9780-4b4fad26419a'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:00:44.497493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-22367900-4198-4480-9780-4b4fad26419a admin admin] The token cache is being invalidate because project 976bae50af4d476b9195b2006bd707fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:00:44.497949 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-22367900-4198-4480-9780-4b4fad26419a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:00:44.499060 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-22367900-4198-4480-9780-4b4fad26419a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:00:44.500643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1173/2347] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:00:44 2022] DELETE /identity/v3/projects/976bae50af4d476b9195b2006bd707fb => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:00:44.505956 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f3d6c-7d87-4d4b-a3cf-5c8620b8588f None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:44.506533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f3d6c-7d87-4d4b-a3cf-5c8620b8588f None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:44.506533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f3d6c-7d87-4d4b-a3cf-5c8620b8588f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:44.527758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-fb4f3d6c-7d87-4d4b-a3cf-5c8620b8588f None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:00:44.529049 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-fb4f3d6c-7d87-4d4b-a3cf-5c8620b8588f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:44.593484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1175/2348] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:00:44.601404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68377258-acab-4c83-9bff-46e357f6907a None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:44.601700 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68377258-acab-4c83-9bff-46e357f6907a None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:44.601983 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68377258-acab-4c83-9bff-46e357f6907a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:44.622569 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-68377258-acab-4c83-9bff-46e357f6907a None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:00:44.627174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-68377258-acab-4c83-9bff-46e357f6907a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:44.632432 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1174/2349] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:00:44.637046 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f3d6c-7d87-4d4b-a3cf-5c8620b8588f None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:44.647068 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f3d6c-7d87-4d4b-a3cf-5c8620b8588f None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:44.651853 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fde4c-934b-405a-b5b2-4011b3e539fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:44.655697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fde4c-934b-405a-b5b2-4011b3e539fe admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:44.655697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fde4c-934b-405a-b5b2-4011b3e539fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:44.655697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fde4c-934b-405a-b5b2-4011b3e539fe admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:44.655697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362fde4c-934b-405a-b5b2-4011b3e539fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:00:44.655697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362fde4c-934b-405a-b5b2-4011b3e539fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:44.655697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362fde4c-934b-405a-b5b2-4011b3e539fe admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:44.667950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1176/2350] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 16:00:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:00:44.672329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68377258-acab-4c83-9bff-46e357f6907a None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:44.682722 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68377258-acab-4c83-9bff-46e357f6907a None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:44.690325 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36549c-07a8-4017-9106-06f303352559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:44.690325 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36549c-07a8-4017-9106-06f303352559 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:44.690325 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36549c-07a8-4017-9106-06f303352559 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:44.690325 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36549c-07a8-4017-9106-06f303352559 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:44.690756 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36549c-07a8-4017-9106-06f303352559 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:44.691581 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36549c-07a8-4017-9106-06f303352559 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:44.802762 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1175/2351] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:00:44 2022] POST /identity/v3/projects => generated 400 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:00:44.807748 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fde4c-934b-405a-b5b2-4011b3e539fe admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:44.818733 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fde4c-934b-405a-b5b2-4011b3e539fe admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:44.886154 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23df6b7-3125-4b60-8166-607763295c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:44.886991 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23df6b7-3125-4b60-8166-607763295c4b admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:44.887393 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23df6b7-3125-4b60-8166-607763295c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:44.887782 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23df6b7-3125-4b60-8166-607763295c4b admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:44.888639 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23df6b7-3125-4b60-8166-607763295c4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:44.890684 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23df6b7-3125-4b60-8166-607763295c4b admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:45.002489 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1177/2352] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:00:44 2022] POST /identity/v3/users => generated 301 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:00:45.004135 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36549c-07a8-4017-9106-06f303352559 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:45.015937 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36549c-07a8-4017-9106-06f303352559 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:45.020650 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b374dd-b122-4484-8953-195ddc92d1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:45.021323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b374dd-b122-4484-8953-195ddc92d1cc admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:45.021675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b374dd-b122-4484-8953-195ddc92d1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:45.021889 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b374dd-b122-4484-8953-195ddc92d1cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:45.022620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b374dd-b122-4484-8953-195ddc92d1cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:45.024856 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b374dd-b122-4484-8953-195ddc92d1cc admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:45.037962 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1176/2353] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:00:45 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:00:45.042051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23df6b7-3125-4b60-8166-607763295c4b admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:45.052960 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23df6b7-3125-4b60-8166-607763295c4b admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:45.058391 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff99f61-6f49-4d83-9dd4-ede37004b82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:45.059140 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff99f61-6f49-4d83-9dd4-ede37004b82b admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:45.059501 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff99f61-6f49-4d83-9dd4-ede37004b82b admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:45.059852 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff99f61-6f49-4d83-9dd4-ede37004b82b admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:45.060694 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff99f61-6f49-4d83-9dd4-ede37004b82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:45.062378 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff99f61-6f49-4d83-9dd4-ede37004b82b admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:45.074220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1178/2354] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:00:45 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 16:00:45.078427 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b374dd-b122-4484-8953-195ddc92d1cc admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:45.088947 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b374dd-b122-4484-8953-195ddc92d1cc admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:45.093681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64678024-0482-4284-8122-874f5cd32dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:45.094594 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64678024-0482-4284-8122-874f5cd32dda admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:45.094902 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64678024-0482-4284-8122-874f5cd32dda admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:45.095180 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64678024-0482-4284-8122-874f5cd32dda admin admin] PATH_INFO: `/v3/projects/07d41396b7504be6a21bdf0150f339cf/users/ff051949ea45455795082a790e2365f1/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:45.114202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64678024-0482-4284-8122-874f5cd32dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d41396b7504be6a21bdf0150f339cf, user_id=ff051949ea45455795082a790e2365f1, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:45.116788 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64678024-0482-4284-8122-874f5cd32dda admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:45.244550 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1177/2355] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:00:45 2022] PUT /identity/v3/projects/07d41396b7504be6a21bdf0150f339cf/users/ff051949ea45455795082a790e2365f1/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:00:45.308535 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824df1f-52d8-4539-b8e3-40dd71472a33 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:45.308847 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824df1f-52d8-4539-b8e3-40dd71472a33 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:45.309133 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824df1f-52d8-4539-b8e3-40dd71472a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:45.342956 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-e824df1f-52d8-4539-b8e3-40dd71472a33 None None] MFA Rules not processed for user `ff051949ea45455795082a790e2365f1`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:00:45.344387 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-e824df1f-52d8-4539-b8e3-40dd71472a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:45.370269 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:45.429194 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1179/2356] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:00:45 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:00:45.442851 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64678024-0482-4284-8122-874f5cd32dda admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:45.444740 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-64678024-0482-4284-8122-874f5cd32dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:45.519834 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64678024-0482-4284-8122-874f5cd32dda admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:45.523590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216c4cc-9215-45fd-9702-87172d79d20c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:45.524296 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216c4cc-9215-45fd-9702-87172d79d20c service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:45.524585 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216c4cc-9215-45fd-9702-87172d79d20c service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:45.524861 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216c4cc-9215-45fd-9702-87172d79d20c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:45.535494 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216c4cc-9215-45fd-9702-87172d79d20c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:45.537146 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216c4cc-9215-45fd-9702-87172d79d20c service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:45.549932 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1178/2357] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:00:45 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:00:55.500773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=18 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:55.544701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:01.011001 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824df1f-52d8-4539-b8e3-40dd71472a33 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:01.077578 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824df1f-52d8-4539-b8e3-40dd71472a33 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:01.082287 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d1a2a-77ec-4895-871c-91d72a551013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:01.083160 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d1a2a-77ec-4895-871c-91d72a551013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:01.083457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d1a2a-77ec-4895-871c-91d72a551013 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:01.083745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d1a2a-77ec-4895-871c-91d72a551013 admin admin] PATH_INFO: `/v3/users/ff051949ea45455795082a790e2365f1` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:01.085102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d1a2a-77ec-4895-871c-91d72a551013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff051949ea45455795082a790e2365f1)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:01.087386 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d1a2a-77ec-4895-871c-91d72a551013 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:01.278835 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-6e0d1a2a-77ec-4895-871c-91d72a551013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff051949ea45455795082a790e2365f1'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:01.279485 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-6e0d1a2a-77ec-4895-871c-91d72a551013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff051949ea45455795082a790e2365f1'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:01.292035 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-6e0d1a2a-77ec-4895-871c-91d72a551013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff051949ea45455795082a790e2365f1'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:01.299038 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-6e0d1a2a-77ec-4895-871c-91d72a551013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff051949ea45455795082a790e2365f1'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:01.302897 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-6e0d1a2a-77ec-4895-871c-91d72a551013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff051949ea45455795082a790e2365f1'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:01.386725 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1180/2358] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:01:01 2022] DELETE /identity/v3/users/ff051949ea45455795082a790e2365f1 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:01:01.391386 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d0cd4-e8f5-4bca-bb06-75d31fd07c71 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:01.392335 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d0cd4-e8f5-4bca-bb06-75d31fd07c71 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:01.392969 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d0cd4-e8f5-4bca-bb06-75d31fd07c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:01.411599 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-b28d0cd4-e8f5-4bca-bb06-75d31fd07c71 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:01:01.412912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b28d0cd4-e8f5-4bca-bb06-75d31fd07c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:01.474173 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1179/2359] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:01:01.485015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d1a2a-77ec-4895-871c-91d72a551013 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:01.486459 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-6e0d1a2a-77ec-4895-871c-91d72a551013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:01.549219 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d1a2a-77ec-4895-871c-91d72a551013 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:01.553065 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c63ad-df04-40f4-85fc-9800eecba2f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:01.553720 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c63ad-df04-40f4-85fc-9800eecba2f0 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:01.554011 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c63ad-df04-40f4-85fc-9800eecba2f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:01.554296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c63ad-df04-40f4-85fc-9800eecba2f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:01.564186 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c63ad-df04-40f4-85fc-9800eecba2f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:01.565632 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c63ad-df04-40f4-85fc-9800eecba2f0 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:01.575583 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1181/2360] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:01:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:01:02.017141 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d0cd4-e8f5-4bca-bb06-75d31fd07c71 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:02.018685 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b28d0cd4-e8f5-4bca-bb06-75d31fd07c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:02.032226 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d0cd4-e8f5-4bca-bb06-75d31fd07c71 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:02.037027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57331d0-8b1d-4921-ae94-e696c1d4a717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:02.037907 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57331d0-8b1d-4921-ae94-e696c1d4a717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:02.038200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57331d0-8b1d-4921-ae94-e696c1d4a717 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:02.038483 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57331d0-8b1d-4921-ae94-e696c1d4a717 admin admin] PATH_INFO: `/v3/projects/07d41396b7504be6a21bdf0150f339cf` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:02.039687 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57331d0-8b1d-4921-ae94-e696c1d4a717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07d41396b7504be6a21bdf0150f339cf)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:02.042517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57331d0-8b1d-4921-ae94-e696c1d4a717 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:02.169328 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c57331d0-8b1d-4921-ae94-e696c1d4a717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07d41396b7504be6a21bdf0150f339cf', 'request_id': 'req-c57331d0-8b1d-4921-ae94-e696c1d4a717'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:02.177293 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c57331d0-8b1d-4921-ae94-e696c1d4a717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07d41396b7504be6a21bdf0150f339cf', 'request_id': 'req-c57331d0-8b1d-4921-ae94-e696c1d4a717'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:02.255115 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c57331d0-8b1d-4921-ae94-e696c1d4a717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07d41396b7504be6a21bdf0150f339cf', 'request_id': 'req-c57331d0-8b1d-4921-ae94-e696c1d4a717'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:02.273380 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c57331d0-8b1d-4921-ae94-e696c1d4a717 admin admin] The token cache is being invalidate because project 07d41396b7504be6a21bdf0150f339cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:01:02.273380 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c57331d0-8b1d-4921-ae94-e696c1d4a717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:02.273380 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c57331d0-8b1d-4921-ae94-e696c1d4a717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:01:02.273380 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1180/2361] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:01:02 2022] DELETE /identity/v3/projects/07d41396b7504be6a21bdf0150f339cf => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:01:02.275030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215d7c9-49a2-495b-8ff8-9646132edf24 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:02.275575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215d7c9-49a2-495b-8ff8-9646132edf24 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:02.275575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215d7c9-49a2-495b-8ff8-9646132edf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:02.293078 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-6215d7c9-49a2-495b-8ff8-9646132edf24 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:01:02.294361 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-6215d7c9-49a2-495b-8ff8-9646132edf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:02.311641 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:02.354242 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1182/2362] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:01:02.362229 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d838608-3d89-41ee-80cf-8bcbb2b44168 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:02.362578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d838608-3d89-41ee-80cf-8bcbb2b44168 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:02.362883 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d838608-3d89-41ee-80cf-8bcbb2b44168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:02.382089 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-3d838608-3d89-41ee-80cf-8bcbb2b44168 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:01:02.383284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-3d838608-3d89-41ee-80cf-8bcbb2b44168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:02.392015 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1181/2363] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:01:02.396453 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215d7c9-49a2-495b-8ff8-9646132edf24 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:02.406204 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215d7c9-49a2-495b-8ff8-9646132edf24 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:02.411004 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d864826-ed99-4085-9d24-79235035597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:02.411655 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d864826-ed99-4085-9d24-79235035597a admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:02.411944 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d864826-ed99-4085-9d24-79235035597a admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:02.412255 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d864826-ed99-4085-9d24-79235035597a admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:02.412997 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d864826-ed99-4085-9d24-79235035597a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:01:02.413291 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d864826-ed99-4085-9d24-79235035597a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:02.414885 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d864826-ed99-4085-9d24-79235035597a admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:02.426992 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1183/2364] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 16:01:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 16:01:02.431426 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d838608-3d89-41ee-80cf-8bcbb2b44168 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:02.441623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d838608-3d89-41ee-80cf-8bcbb2b44168 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:02.446488 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4240d-0916-49a8-86df-1c683e7dd5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:02.447189 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4240d-0916-49a8-86df-1c683e7dd5b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:02.447487 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4240d-0916-49a8-86df-1c683e7dd5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:02.447769 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4240d-0916-49a8-86df-1c683e7dd5b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:02.448516 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4240d-0916-49a8-86df-1c683e7dd5b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:02.450423 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4240d-0916-49a8-86df-1c683e7dd5b0 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:02.542783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1182/2365] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:01:02 2022] POST /identity/v3/projects => generated 378 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:01:02.547498 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d864826-ed99-4085-9d24-79235035597a admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:02.558206 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d864826-ed99-4085-9d24-79235035597a admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:02.615615 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952d6ce-f937-476b-99a8-7d63f423a445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:02.616323 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952d6ce-f937-476b-99a8-7d63f423a445 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:02.616616 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952d6ce-f937-476b-99a8-7d63f423a445 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:02.616898 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952d6ce-f937-476b-99a8-7d63f423a445 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:02.617587 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952d6ce-f937-476b-99a8-7d63f423a445 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:02.620174 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952d6ce-f937-476b-99a8-7d63f423a445 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:02.736262 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1184/2366] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:01:02 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:01:02.740434 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4240d-0916-49a8-86df-1c683e7dd5b0 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:02.751930 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4240d-0916-49a8-86df-1c683e7dd5b0 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:02.756537 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be840db-dc33-4b4f-88ea-cb7dcd2d94a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:02.757200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be840db-dc33-4b4f-88ea-cb7dcd2d94a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:02.757494 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be840db-dc33-4b4f-88ea-cb7dcd2d94a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:02.757786 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be840db-dc33-4b4f-88ea-cb7dcd2d94a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:02.758608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be840db-dc33-4b4f-88ea-cb7dcd2d94a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:02.760542 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be840db-dc33-4b4f-88ea-cb7dcd2d94a8 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:02.770882 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1183/2367] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:01:02 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 16:01:02.774974 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952d6ce-f937-476b-99a8-7d63f423a445 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:02.786616 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952d6ce-f937-476b-99a8-7d63f423a445 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:02.792281 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cac9c-fd81-40aa-87ae-c9bbd2cb2f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:02.793008 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cac9c-fd81-40aa-87ae-c9bbd2cb2f24 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:02.793280 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cac9c-fd81-40aa-87ae-c9bbd2cb2f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:02.793567 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cac9c-fd81-40aa-87ae-c9bbd2cb2f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:02.794308 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788cac9c-fd81-40aa-87ae-c9bbd2cb2f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:02.795939 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788cac9c-fd81-40aa-87ae-c9bbd2cb2f24 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:02.805996 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1185/2368] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:01:02 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:01:02.810260 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be840db-dc33-4b4f-88ea-cb7dcd2d94a8 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:02.820059 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be840db-dc33-4b4f-88ea-cb7dcd2d94a8 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:02.824678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0fc02-4ab2-4110-91b1-a3641cf60e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:02.825553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0fc02-4ab2-4110-91b1-a3641cf60e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:02.825839 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0fc02-4ab2-4110-91b1-a3641cf60e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:02.826117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0fc02-4ab2-4110-91b1-a3641cf60e75 admin admin] PATH_INFO: `/v3/projects/1207210005f34c4aabbe6966e469c1a0/users/56191d451ddf4fba953c27dd79484723/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:02.841600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0fc02-4ab2-4110-91b1-a3641cf60e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1207210005f34c4aabbe6966e469c1a0, user_id=56191d451ddf4fba953c27dd79484723, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:02.844317 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0fc02-4ab2-4110-91b1-a3641cf60e75 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:02.946749 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1184/2369] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:01:02 2022] PUT /identity/v3/projects/1207210005f34c4aabbe6966e469c1a0/users/56191d451ddf4fba953c27dd79484723/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:01:02.952245 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570c293-c480-41e0-b611-0ea757eeba25 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:02.952631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570c293-c480-41e0-b611-0ea757eeba25 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:02.952916 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570c293-c480-41e0-b611-0ea757eeba25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:02.971685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-a570c293-c480-41e0-b611-0ea757eeba25 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:01:02.972920 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-a570c293-c480-41e0-b611-0ea757eeba25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:03.033319 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1186/2370] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:01:03.043357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0fc02-4ab2-4110-91b1-a3641cf60e75 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:03.045104 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-89c0fc02-4ab2-4110-91b1-a3641cf60e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:03.067043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:03.102049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0fc02-4ab2-4110-91b1-a3641cf60e75 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:03.106592 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c570b-0f64-40ff-8023-19f815fa9f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:03.107242 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c570b-0f64-40ff-8023-19f815fa9f22 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:03.107526 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c570b-0f64-40ff-8023-19f815fa9f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:03.107803 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c570b-0f64-40ff-8023-19f815fa9f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:03.116973 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c570b-0f64-40ff-8023-19f815fa9f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:03.118379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c570b-0f64-40ff-8023-19f815fa9f22 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:03.127710 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1185/2371] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:01:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:01:08.580353 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f0bf7-cc92-447f-a871-24ada4f8cd93 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:08.582156 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f0bf7-cc92-447f-a871-24ada4f8cd93 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:08.582556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f0bf7-cc92-447f-a871-24ada4f8cd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:08.616518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-589f0bf7-cc92-447f-a871-24ada4f8cd93 None None] MFA Rules not processed for user `56191d451ddf4fba953c27dd79484723`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:01:08.617950 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-589f0bf7-cc92-447f-a871-24ada4f8cd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:08.639748 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:08.706232 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1187/2372] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:01:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:01:08.711589 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c570b-0f64-40ff-8023-19f815fa9f22 service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:08.724369 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c570b-0f64-40ff-8023-19f815fa9f22 service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:08.730789 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e4cc6-e117-4bd7-88b9-32ab92e7abcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:08.731651 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e4cc6-e117-4bd7-88b9-32ab92e7abcf admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:08.732058 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e4cc6-e117-4bd7-88b9-32ab92e7abcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:08.732460 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e4cc6-e117-4bd7-88b9-32ab92e7abcf admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:08.733337 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e4cc6-e117-4bd7-88b9-32ab92e7abcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:08.735360 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e4cc6-e117-4bd7-88b9-32ab92e7abcf admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:08.822976 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1186/2373] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:01:08 2022] POST /identity/v3/projects => generated 380 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:01:08.827045 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f0bf7-cc92-447f-a871-24ada4f8cd93 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:08.840231 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f0bf7-cc92-447f-a871-24ada4f8cd93 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:08.902854 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fc2a9-f5f7-4cb0-94bb-e0589b937099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:08.903552 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fc2a9-f5f7-4cb0-94bb-e0589b937099 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:08.903845 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fc2a9-f5f7-4cb0-94bb-e0589b937099 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:08.904149 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fc2a9-f5f7-4cb0-94bb-e0589b937099 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:08.904938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fc2a9-f5f7-4cb0-94bb-e0589b937099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:08.906841 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fc2a9-f5f7-4cb0-94bb-e0589b937099 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:09.038311 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1188/2374] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:01:08 2022] POST /identity/v3/users => generated 297 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:01:09.042519 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e4cc6-e117-4bd7-88b9-32ab92e7abcf admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:09.054313 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e4cc6-e117-4bd7-88b9-32ab92e7abcf admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:09.059868 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac4fb8-e9db-4dbc-9fa2-d458247510ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:09.060674 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac4fb8-e9db-4dbc-9fa2-d458247510ba admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:09.060959 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac4fb8-e9db-4dbc-9fa2-d458247510ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:09.061239 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac4fb8-e9db-4dbc-9fa2-d458247510ba admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:09.061976 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac4fb8-e9db-4dbc-9fa2-d458247510ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:09.063586 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac4fb8-e9db-4dbc-9fa2-d458247510ba admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:09.075988 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1187/2375] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:01:09 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:01:09.080332 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fc2a9-f5f7-4cb0-94bb-e0589b937099 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:09.091349 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fc2a9-f5f7-4cb0-94bb-e0589b937099 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:09.096296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63533cee-899d-4ab8-80b5-1803b0af71c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:09.097199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63533cee-899d-4ab8-80b5-1803b0af71c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:09.097488 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63533cee-899d-4ab8-80b5-1803b0af71c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:09.097793 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63533cee-899d-4ab8-80b5-1803b0af71c3 admin admin] PATH_INFO: `/v3/projects/52bdafc550094324b057bcfc23de296b/users/e55f8058527d463da06fd8fddb31adf4/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:09.114817 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63533cee-899d-4ab8-80b5-1803b0af71c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52bdafc550094324b057bcfc23de296b, user_id=e55f8058527d463da06fd8fddb31adf4, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:09.117552 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63533cee-899d-4ab8-80b5-1803b0af71c3 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:09.219634 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1189/2376] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:01:09 2022] PUT /identity/v3/projects/52bdafc550094324b057bcfc23de296b/users/e55f8058527d463da06fd8fddb31adf4/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:01:09.219971 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac4fb8-e9db-4dbc-9fa2-d458247510ba admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:09.226051 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac4fb8-e9db-4dbc-9fa2-d458247510ba admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:09.285165 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89673f62-02ba-4f86-8c5f-e2a3186dbcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:09.285827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89673f62-02ba-4f86-8c5f-e2a3186dbcf8 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:09.286117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89673f62-02ba-4f86-8c5f-e2a3186dbcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:09.286395 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89673f62-02ba-4f86-8c5f-e2a3186dbcf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:09.287129 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89673f62-02ba-4f86-8c5f-e2a3186dbcf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:09.294018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89673f62-02ba-4f86-8c5f-e2a3186dbcf8 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:09.299610 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1188/2377] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:01:09 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:01:09.305337 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63533cee-899d-4ab8-80b5-1803b0af71c3 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:09.316566 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63533cee-899d-4ab8-80b5-1803b0af71c3 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:09.321318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bdacc-35cd-430b-8278-ed1c44604e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:09.322862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bdacc-35cd-430b-8278-ed1c44604e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:09.323187 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bdacc-35cd-430b-8278-ed1c44604e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:09.323455 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bdacc-35cd-430b-8278-ed1c44604e91 admin admin] PATH_INFO: `/v3/projects/52bdafc550094324b057bcfc23de296b/users/e55f8058527d463da06fd8fddb31adf4/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:09.325561 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575bdacc-35cd-430b-8278-ed1c44604e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52bdafc550094324b057bcfc23de296b, user_id=e55f8058527d463da06fd8fddb31adf4, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:09.328485 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575bdacc-35cd-430b-8278-ed1c44604e91 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:09.340435 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1190/2378] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:01:09 2022] PUT /identity/v3/projects/52bdafc550094324b057bcfc23de296b/users/e55f8058527d463da06fd8fddb31adf4/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:01:15.579787 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195c5b6-4120-4512-b19b-31de2c8aec94 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:15.580313 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195c5b6-4120-4512-b19b-31de2c8aec94 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:15.580404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195c5b6-4120-4512-b19b-31de2c8aec94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:15.615619 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-1195c5b6-4120-4512-b19b-31de2c8aec94 None None] MFA Rules not processed for user `e55f8058527d463da06fd8fddb31adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:01:15.617009 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-1195c5b6-4120-4512-b19b-31de2c8aec94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:15.716476 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1189/2379] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:01:15 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:01:15.732667 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bdacc-35cd-430b-8278-ed1c44604e91 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:15.732667 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-575bdacc-35cd-430b-8278-ed1c44604e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:15.810877 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bdacc-35cd-430b-8278-ed1c44604e91 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:15.816523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25fc496-2d6c-45e1-b0a4-0f8de6cdd6fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:15.817197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fc496-2d6c-45e1-b0a4-0f8de6cdd6fc service nova] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:15.817498 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fc496-2d6c-45e1-b0a4-0f8de6cdd6fc service nova] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:15.817779 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fc496-2d6c-45e1-b0a4-0f8de6cdd6fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:15.824282 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:15.876475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25fc496-2d6c-45e1-b0a4-0f8de6cdd6fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:15.878083 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25fc496-2d6c-45e1-b0a4-0f8de6cdd6fc service nova] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:15.888068 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1191/2380] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:01:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:01:25.704460 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:26.358338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=24 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:37.277765 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195c5b6-4120-4512-b19b-31de2c8aec94 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:37.279222 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-1195c5b6-4120-4512-b19b-31de2c8aec94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:37.294909 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195c5b6-4120-4512-b19b-31de2c8aec94 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:37.300392 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124c501-1643-4077-be2a-be8527b65305 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:37.301038 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124c501-1643-4077-be2a-be8527b65305 service nova] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:37.301328 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124c501-1643-4077-be2a-be8527b65305 service nova] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:37.301611 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124c501-1643-4077-be2a-be8527b65305 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:37.303330 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-0124c501-1643-4077-be2a-be8527b65305 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:37.363828 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124c501-1643-4077-be2a-be8527b65305 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:37.365507 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124c501-1643-4077-be2a-be8527b65305 service nova] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:37.375451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1190/2381] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:01:37 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:01:37.426650 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25fc496-2d6c-45e1-b0a4-0f8de6cdd6fc service nova] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:37.428057 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-d25fc496-2d6c-45e1-b0a4-0f8de6cdd6fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:37.486579 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25fc496-2d6c-45e1-b0a4-0f8de6cdd6fc service nova] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:37.490266 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc054c1-e6cc-47a9-b8e7-b244a408c6aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:37.490929 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc054c1-e6cc-47a9-b8e7-b244a408c6aa service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:37.491220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc054c1-e6cc-47a9-b8e7-b244a408c6aa service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:37.491500 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc054c1-e6cc-47a9-b8e7-b244a408c6aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:37.493376 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-5fc054c1-e6cc-47a9-b8e7-b244a408c6aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:37.508486 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc054c1-e6cc-47a9-b8e7-b244a408c6aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:37.512728 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc054c1-e6cc-47a9-b8e7-b244a408c6aa service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:37.528005 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1192/2382] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:01:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:01:47.370901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=28 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:47.522419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=26 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:53.454163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124c501-1643-4077-be2a-be8527b65305 service nova] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:53.464537 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124c501-1643-4077-be2a-be8527b65305 service nova] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:53.468086 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a60f33-f1db-4581-b412-b5f45ad82850 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:53.468753 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a60f33-f1db-4581-b412-b5f45ad82850 service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:53.469041 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a60f33-f1db-4581-b412-b5f45ad82850 service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:53.469319 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a60f33-f1db-4581-b412-b5f45ad82850 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:53.471101 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-02a60f33-f1db-4581-b412-b5f45ad82850 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:53.484880 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a60f33-f1db-4581-b412-b5f45ad82850 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:53.486255 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a60f33-f1db-4581-b412-b5f45ad82850 service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:53.497347 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1191/2383] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:01:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:01:55.927677 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f243c31-6e21-4cba-8136-28d5499cfe45 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:55.928224 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f243c31-6e21-4cba-8136-28d5499cfe45 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:55.928333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f243c31-6e21-4cba-8136-28d5499cfe45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:55.946050 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-7f243c31-6e21-4cba-8136-28d5499cfe45 None None] MFA Rules not processed for user `56191d451ddf4fba953c27dd79484723`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:01:55.947270 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-7f243c31-6e21-4cba-8136-28d5499cfe45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:55.954985 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1193/2384] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:01:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:01:56.283689 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a60f33-f1db-4581-b412-b5f45ad82850 service cinder] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:56.340923 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a60f33-f1db-4581-b412-b5f45ad82850 service cinder] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:56.344781 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13970abb-54c8-4944-bbc1-e4e871c8fa7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:56.345437 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13970abb-54c8-4944-bbc1-e4e871c8fa7d service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:56.345727 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13970abb-54c8-4944-bbc1-e4e871c8fa7d service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:56.346010 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13970abb-54c8-4944-bbc1-e4e871c8fa7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:56.347832 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-13970abb-54c8-4944-bbc1-e4e871c8fa7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:56.358211 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13970abb-54c8-4944-bbc1-e4e871c8fa7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:56.368477 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13970abb-54c8-4944-bbc1-e4e871c8fa7d service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:56.368477 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1192/2385] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:01:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:01:57.185224 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f243c31-6e21-4cba-8136-28d5499cfe45 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:57.187182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-7f243c31-6e21-4cba-8136-28d5499cfe45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:57.261739 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f243c31-6e21-4cba-8136-28d5499cfe45 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:57.266776 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68abc2-c195-4602-8099-73fab10d8d0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716cbbfeede34885b0411e5b9b25df47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:57.267425 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68abc2-c195-4602-8099-73fab10d8d0e service placement] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:57.267714 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68abc2-c195-4602-8099-73fab10d8d0e service placement] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:57.267996 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68abc2-c195-4602-8099-73fab10d8d0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:57.269809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-0a68abc2-c195-4602-8099-73fab10d8d0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:57.281951 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68abc2-c195-4602-8099-73fab10d8d0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:01:57.283472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68abc2-c195-4602-8099-73fab10d8d0e service placement] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:01:57.293449 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1194/2386] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:01:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:02:06.364146 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=32 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:07.289091 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=35 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:17.556336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331449d2-44b5-4783-af89-0efd9f5b119b None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:02:17.556873 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331449d2-44b5-4783-af89-0efd9f5b119b None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:02:17.556976 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331449d2-44b5-4783-af89-0efd9f5b119b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:02:17.587140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-331449d2-44b5-4783-af89-0efd9f5b119b None None] MFA Rules not processed for user `f891f70cc0e34e1f98116dec9c09cc5f`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:02:17.588407 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-331449d2-44b5-4783-af89-0efd9f5b119b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:02:17.651103 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1193/2387] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:02:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:02:21.378084 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68abc2-c195-4602-8099-73fab10d8d0e service placement] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:02:21.379611 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-0a68abc2-c195-4602-8099-73fab10d8d0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:02:21.391777 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68abc2-c195-4602-8099-73fab10d8d0e service placement] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:02:21.395625 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29114f-a096-4f84-ab4f-8b997b1cbf87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:02:21.396311 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29114f-a096-4f84-ab4f-8b997b1cbf87 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:02:21.396628 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29114f-a096-4f84-ab4f-8b997b1cbf87 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:02:21.396920 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29114f-a096-4f84-ab4f-8b997b1cbf87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:02:21.398713 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-1e29114f-a096-4f84-ab4f-8b997b1cbf87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:02:21.409900 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29114f-a096-4f84-ab4f-8b997b1cbf87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:02:21.411458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29114f-a096-4f84-ab4f-8b997b1cbf87 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:02:21.420884 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1195/2388] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:02:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:02:22.434072 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331449d2-44b5-4783-af89-0efd9f5b119b None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:02:22.447554 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331449d2-44b5-4783-af89-0efd9f5b119b None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:02:22.453089 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84318b0c-cc74-4f2e-bda2-124fdbd94e9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:02:22.453733 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84318b0c-cc74-4f2e-bda2-124fdbd94e9f service nova] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:02:22.454023 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84318b0c-cc74-4f2e-bda2-124fdbd94e9f service nova] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:02:22.454306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84318b0c-cc74-4f2e-bda2-124fdbd94e9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:02:22.456083 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-84318b0c-cc74-4f2e-bda2-124fdbd94e9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:02:22.468454 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84318b0c-cc74-4f2e-bda2-124fdbd94e9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:02:22.470076 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84318b0c-cc74-4f2e-bda2-124fdbd94e9f service nova] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:02:22.481531 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1194/2389] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:02:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:02:25.049202 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b51e14-abe1-4ff2-9568-eb5d4dab8ac0 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:02:25.049752 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b51e14-abe1-4ff2-9568-eb5d4dab8ac0 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:02:25.049752 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b51e14-abe1-4ff2-9568-eb5d4dab8ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:02:25.069824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-d0b51e14-abe1-4ff2-9568-eb5d4dab8ac0 None None] MFA Rules not processed for user `fe6f58bedd87454bad46b0c48697eec9`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:02:25.071184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-d0b51e14-abe1-4ff2-9568-eb5d4dab8ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:02:25.080342 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1196/2390] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:02:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:02:28.202217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84318b0c-cc74-4f2e-bda2-124fdbd94e9f service nova] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:02:28.215760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84318b0c-cc74-4f2e-bda2-124fdbd94e9f service nova] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:02:28.223723 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ff37e-bd76-4560-a02d-e06a2dd3cdc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:02:28.237800 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ff37e-bd76-4560-a02d-e06a2dd3cdc1 service nova] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:02:28.238194 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ff37e-bd76-4560-a02d-e06a2dd3cdc1 service nova] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:02:28.238965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ff37e-bd76-4560-a02d-e06a2dd3cdc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:02:28.245290 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-356ff37e-bd76-4560-a02d-e06a2dd3cdc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:02:28.263060 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ff37e-bd76-4560-a02d-e06a2dd3cdc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:02:28.265674 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ff37e-bd76-4560-a02d-e06a2dd3cdc1 service nova] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:02:28.286599 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1195/2391] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:02:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:02:28.486621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b51e14-abe1-4ff2-9568-eb5d4dab8ac0 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:02:28.496797 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b51e14-abe1-4ff2-9568-eb5d4dab8ac0 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:02:28.507532 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302e161-14bf-4769-863a-999df3821f5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:02:28.507532 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302e161-14bf-4769-863a-999df3821f5e service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:02:28.507532 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302e161-14bf-4769-863a-999df3821f5e service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:02:28.507532 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302e161-14bf-4769-863a-999df3821f5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:02:28.522449 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302e161-14bf-4769-863a-999df3821f5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:02:28.524075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302e161-14bf-4769-863a-999df3821f5e service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:02:28.534961 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1197/2392] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:02:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:02:38.280022 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=37 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:38.530067 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=15 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:09.847131 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ff37e-bd76-4560-a02d-e06a2dd3cdc1 service nova] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:09.859810 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ff37e-bd76-4560-a02d-e06a2dd3cdc1 service nova] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:09.866525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefe342-b93d-4c28-8c14-2a15c3032c26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:09.867169 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefe342-b93d-4c28-8c14-2a15c3032c26 service nova] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:09.867456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefe342-b93d-4c28-8c14-2a15c3032c26 service nova] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:09.867736 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefe342-b93d-4c28-8c14-2a15c3032c26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:09.870011 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-eeefe342-b93d-4c28-8c14-2a15c3032c26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:03:09.930674 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefe342-b93d-4c28-8c14-2a15c3032c26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:09.932290 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefe342-b93d-4c28-8c14-2a15c3032c26 service nova] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:09.941508 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1196/2393] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:03:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:03:19.937097 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=28 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:21.566323 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302e161-14bf-4769-863a-999df3821f5e service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:21.578452 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302e161-14bf-4769-863a-999df3821f5e service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:21.584399 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf78111-ee15-453d-8493-3792681aa3a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:21.585058 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf78111-ee15-453d-8493-3792681aa3a0 service nova] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:21.585407 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf78111-ee15-453d-8493-3792681aa3a0 service nova] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:21.585699 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf78111-ee15-453d-8493-3792681aa3a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:21.587439 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-bcf78111-ee15-453d-8493-3792681aa3a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:03:21.600162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf78111-ee15-453d-8493-3792681aa3a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:21.601733 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf78111-ee15-453d-8493-3792681aa3a0 service nova] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:21.612030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1198/2394] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:03:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:03:31.607705 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=6 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:40.101044 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefe342-b93d-4c28-8c14-2a15c3032c26 service nova] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:40.112207 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefe342-b93d-4c28-8c14-2a15c3032c26 service nova] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:40.118490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b42cb-f355-4601-be0a-445393ca57e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:40.119115 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b42cb-f355-4601-be0a-445393ca57e1 service nova] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:40.119426 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b42cb-f355-4601-be0a-445393ca57e1 service nova] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:40.119714 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b42cb-f355-4601-be0a-445393ca57e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:40.121609 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b35b42cb-f355-4601-be0a-445393ca57e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:03:40.180254 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b42cb-f355-4601-be0a-445393ca57e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:40.181864 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b42cb-f355-4601-be0a-445393ca57e1 service nova] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:40.191060 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1197/2395] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:03:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:03:50.186819 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=28 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:58.427342 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf78111-ee15-453d-8493-3792681aa3a0 service nova] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:58.432533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf78111-ee15-453d-8493-3792681aa3a0 service nova] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:58.437598 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d828514-005f-443b-af55-c38baf439451 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716cbbfeede34885b0411e5b9b25df47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:58.438251 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d828514-005f-443b-af55-c38baf439451 service placement] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:58.438543 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d828514-005f-443b-af55-c38baf439451 service placement] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:58.438828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d828514-005f-443b-af55-c38baf439451 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:58.440703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-5d828514-005f-443b-af55-c38baf439451 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:03:58.454048 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d828514-005f-443b-af55-c38baf439451 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:58.455715 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d828514-005f-443b-af55-c38baf439451 service placement] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:58.467521 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1199/2396] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:03:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:03:58.565357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b42cb-f355-4601-be0a-445393ca57e1 service nova] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:58.566868 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b35b42cb-f355-4601-be0a-445393ca57e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:03:58.633881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b42cb-f355-4601-be0a-445393ca57e1 service nova] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:58.638492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23171cdb-cb11-44d1-b191-daa0518dadc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:58.639366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23171cdb-cb11-44d1-b191-daa0518dadc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:58.639668 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23171cdb-cb11-44d1-b191-daa0518dadc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:58.639931 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23171cdb-cb11-44d1-b191-daa0518dadc6 admin admin] PATH_INFO: `/v3/users/f891f70cc0e34e1f98116dec9c09cc5f` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:58.641137 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23171cdb-cb11-44d1-b191-daa0518dadc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f891f70cc0e34e1f98116dec9c09cc5f)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:58.643337 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23171cdb-cb11-44d1-b191-daa0518dadc6 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:58.836936 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-23171cdb-cb11-44d1-b191-daa0518dadc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f891f70cc0e34e1f98116dec9c09cc5f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:03:58.849713 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-23171cdb-cb11-44d1-b191-daa0518dadc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f891f70cc0e34e1f98116dec9c09cc5f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:03:58.856785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-23171cdb-cb11-44d1-b191-daa0518dadc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f891f70cc0e34e1f98116dec9c09cc5f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:03:58.857493 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-23171cdb-cb11-44d1-b191-daa0518dadc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f891f70cc0e34e1f98116dec9c09cc5f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:03:58.958960 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-23171cdb-cb11-44d1-b191-daa0518dadc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f891f70cc0e34e1f98116dec9c09cc5f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:03:58.965934 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1198/2397] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:03:58 2022] DELETE /identity/v3/users/f891f70cc0e34e1f98116dec9c09cc5f => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:03:59.222113 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d828514-005f-443b-af55-c38baf439451 service placement] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:59.233966 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d828514-005f-443b-af55-c38baf439451 service placement] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:59.294404 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6ac70-7bb9-4098-abea-fc6ef76ef6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:59.295305 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6ac70-7bb9-4098-abea-fc6ef76ef6b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:59.295597 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6ac70-7bb9-4098-abea-fc6ef76ef6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:59.295875 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6ac70-7bb9-4098-abea-fc6ef76ef6b8 admin admin] PATH_INFO: `/v3/projects/a02d8a2f826a4475982abb77ccc636f5` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:59.297099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6ac70-7bb9-4098-abea-fc6ef76ef6b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a02d8a2f826a4475982abb77ccc636f5)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:59.299012 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6ac70-7bb9-4098-abea-fc6ef76ef6b8 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:59.479928 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-56a6ac70-7bb9-4098-abea-fc6ef76ef6b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a02d8a2f826a4475982abb77ccc636f5', 'request_id': 'req-56a6ac70-7bb9-4098-abea-fc6ef76ef6b8'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:03:59.486019 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-56a6ac70-7bb9-4098-abea-fc6ef76ef6b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a02d8a2f826a4475982abb77ccc636f5', 'request_id': 'req-56a6ac70-7bb9-4098-abea-fc6ef76ef6b8'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:03:59.492415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-56a6ac70-7bb9-4098-abea-fc6ef76ef6b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a02d8a2f826a4475982abb77ccc636f5', 'request_id': 'req-56a6ac70-7bb9-4098-abea-fc6ef76ef6b8'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:03:59.617058 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-56a6ac70-7bb9-4098-abea-fc6ef76ef6b8 admin admin] The token cache is being invalidate because project a02d8a2f826a4475982abb77ccc636f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:03:59.617354 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-56a6ac70-7bb9-4098-abea-fc6ef76ef6b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:03:59.617997 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-56a6ac70-7bb9-4098-abea-fc6ef76ef6b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:03:59.619564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1200/2398] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:03:59 2022] DELETE /identity/v3/projects/a02d8a2f826a4475982abb77ccc636f5 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:03:59.624539 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e07268-bca4-486b-b3de-be41050151b5 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:59.625003 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e07268-bca4-486b-b3de-be41050151b5 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:59.625116 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e07268-bca4-486b-b3de-be41050151b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:59.643225 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-20e07268-bca4-486b-b3de-be41050151b5 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:03:59.644492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-20e07268-bca4-486b-b3de-be41050151b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:03:59.703738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1199/2399] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:03:59.712015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0f411-0cea-4226-a492-596c8f57a964 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:59.712398 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0f411-0cea-4226-a492-596c8f57a964 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:59.712687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0f411-0cea-4226-a492-596c8f57a964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:59.731837 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-1cc0f411-0cea-4226-a492-596c8f57a964 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:03:59.733003 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-1cc0f411-0cea-4226-a492-596c8f57a964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:03:59.741571 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1201/2400] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:03:59.745824 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e07268-bca4-486b-b3de-be41050151b5 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:59.755339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e07268-bca4-486b-b3de-be41050151b5 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:59.760518 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388e6be-a59a-44da-b258-f0afc81812c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:59.761177 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388e6be-a59a-44da-b258-f0afc81812c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:59.761461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388e6be-a59a-44da-b258-f0afc81812c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:59.761738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388e6be-a59a-44da-b258-f0afc81812c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:59.762463 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d388e6be-a59a-44da-b258-f0afc81812c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:03:59.762769 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d388e6be-a59a-44da-b258-f0afc81812c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:59.764432 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d388e6be-a59a-44da-b258-f0afc81812c1 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:59.776201 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1200/2401] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 16:03:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:03:59.780207 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0f411-0cea-4226-a492-596c8f57a964 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:59.789495 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0f411-0cea-4226-a492-596c8f57a964 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:59.794173 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa135f7-4663-43bd-8a98-3464261b3962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:59.794819 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa135f7-4663-43bd-8a98-3464261b3962 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:59.795106 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa135f7-4663-43bd-8a98-3464261b3962 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:59.795390 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa135f7-4663-43bd-8a98-3464261b3962 admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:59.796074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa135f7-4663-43bd-8a98-3464261b3962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:59.798001 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa135f7-4663-43bd-8a98-3464261b3962 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:59.902786 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1202/2402] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:03:59 2022] POST /identity/v3/projects => generated 392 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:03:59.907171 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388e6be-a59a-44da-b258-f0afc81812c1 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:59.918003 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388e6be-a59a-44da-b258-f0afc81812c1 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:59.921619 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:59.978980 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339e735-d272-470b-927e-658b8e111d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:59.987630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339e735-d272-470b-927e-658b8e111d7f admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:59.987630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339e735-d272-470b-927e-658b8e111d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:59.987630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339e735-d272-470b-927e-658b8e111d7f admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:59.987630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339e735-d272-470b-927e-658b8e111d7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:59.987630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339e735-d272-470b-927e-658b8e111d7f admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:00.165570 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1201/2403] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:03:59 2022] POST /identity/v3/users => generated 297 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:04:00.170759 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa135f7-4663-43bd-8a98-3464261b3962 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:00.181636 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa135f7-4663-43bd-8a98-3464261b3962 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:00.186426 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb83ce-f633-4d48-95c7-cab070e57da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:00.187124 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb83ce-f633-4d48-95c7-cab070e57da4 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:00.187415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb83ce-f633-4d48-95c7-cab070e57da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:00.187764 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb83ce-f633-4d48-95c7-cab070e57da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:00.188569 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb83ce-f633-4d48-95c7-cab070e57da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:00.190226 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb83ce-f633-4d48-95c7-cab070e57da4 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:00.202719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1203/2404] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:04:00 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:04:00.206747 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339e735-d272-470b-927e-658b8e111d7f admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:00.217432 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339e735-d272-470b-927e-658b8e111d7f admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:00.222145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ad947-be97-43d4-9aeb-c15b787dac68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:00.222882 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ad947-be97-43d4-9aeb-c15b787dac68 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:00.223204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ad947-be97-43d4-9aeb-c15b787dac68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:00.223486 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ad947-be97-43d4-9aeb-c15b787dac68 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:00.224249 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ad947-be97-43d4-9aeb-c15b787dac68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:00.226625 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ad947-be97-43d4-9aeb-c15b787dac68 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:00.237094 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1202/2405] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:04:00 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:04:00.249597 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb83ce-f633-4d48-95c7-cab070e57da4 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:00.260713 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb83ce-f633-4d48-95c7-cab070e57da4 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:00.265700 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941aba3-5b74-4fce-b6b9-4f460b7a0781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:00.267057 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941aba3-5b74-4fce-b6b9-4f460b7a0781 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:00.267057 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941aba3-5b74-4fce-b6b9-4f460b7a0781 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:00.267312 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941aba3-5b74-4fce-b6b9-4f460b7a0781 admin admin] PATH_INFO: `/v3/projects/39eaef0f0c034d0a992ce5386c490e0d/users/eec8ef8565d54447bd666aeb762be4dc/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:00.282899 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941aba3-5b74-4fce-b6b9-4f460b7a0781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39eaef0f0c034d0a992ce5386c490e0d, user_id=eec8ef8565d54447bd666aeb762be4dc, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:00.285643 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941aba3-5b74-4fce-b6b9-4f460b7a0781 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:00.493975 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1204/2406] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:04:00 2022] PUT /identity/v3/projects/39eaef0f0c034d0a992ce5386c490e0d/users/eec8ef8565d54447bd666aeb762be4dc/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:04:00.522378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c5a94-7295-4c94-acca-e5b03cf7ef61 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:00.522378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c5a94-7295-4c94-acca-e5b03cf7ef61 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:00.522378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c5a94-7295-4c94-acca-e5b03cf7ef61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:00.546444 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-ea7c5a94-7295-4c94-acca-e5b03cf7ef61 None None] MFA Rules not processed for user `eec8ef8565d54447bd666aeb762be4dc`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:04:00.547709 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-ea7c5a94-7295-4c94-acca-e5b03cf7ef61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:00.615383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1203/2407] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:04:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:04:00.627126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941aba3-5b74-4fce-b6b9-4f460b7a0781 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:00.628866 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-2941aba3-5b74-4fce-b6b9-4f460b7a0781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:00.644292 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:00.688930 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941aba3-5b74-4fce-b6b9-4f460b7a0781 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:00.692680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7787fd2-8bcc-4524-b0b4-23d1f939b42f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:00.693328 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7787fd2-8bcc-4524-b0b4-23d1f939b42f service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:00.693615 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7787fd2-8bcc-4524-b0b4-23d1f939b42f service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:00.693895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7787fd2-8bcc-4524-b0b4-23d1f939b42f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:00.703386 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7787fd2-8bcc-4524-b0b4-23d1f939b42f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:00.704916 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7787fd2-8bcc-4524-b0b4-23d1f939b42f service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:00.714626 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1205/2408] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:04:00 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:04:04.438528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea212dce-d57e-44e9-9d40-f7ff6fe1657a None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:04.439009 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea212dce-d57e-44e9-9d40-f7ff6fe1657a None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:04.439151 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea212dce-d57e-44e9-9d40-f7ff6fe1657a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:04.457210 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-ea212dce-d57e-44e9-9d40-f7ff6fe1657a None None] MFA Rules not processed for user `b0d02887422a43e4bb69566a2d64e890`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:04:04.458423 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-ea212dce-d57e-44e9-9d40-f7ff6fe1657a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:04.521524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1204/2409] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:04:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:04:11.645279 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=20 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:14.514793 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:28.849144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7787fd2-8bcc-4524-b0b4-23d1f939b42f service cinder] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:28.960197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7787fd2-8bcc-4524-b0b4-23d1f939b42f service cinder] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:28.966701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf502cb-84b4-4043-aece-da2046a1aeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:28.967607 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf502cb-84b4-4043-aece-da2046a1aeb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:28.967927 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf502cb-84b4-4043-aece-da2046a1aeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:28.968285 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf502cb-84b4-4043-aece-da2046a1aeb9 admin admin] PATH_INFO: `/v3/users/eec8ef8565d54447bd666aeb762be4dc` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:28.970319 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf502cb-84b4-4043-aece-da2046a1aeb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eec8ef8565d54447bd666aeb762be4dc)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:28.973069 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf502cb-84b4-4043-aece-da2046a1aeb9 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:29.249641 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-1cf502cb-84b4-4043-aece-da2046a1aeb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eec8ef8565d54447bd666aeb762be4dc'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:04:29.250315 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-1cf502cb-84b4-4043-aece-da2046a1aeb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eec8ef8565d54447bd666aeb762be4dc'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:04:29.263966 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-1cf502cb-84b4-4043-aece-da2046a1aeb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eec8ef8565d54447bd666aeb762be4dc'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:04:29.272161 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-1cf502cb-84b4-4043-aece-da2046a1aeb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eec8ef8565d54447bd666aeb762be4dc'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:04:29.272893 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-1cf502cb-84b4-4043-aece-da2046a1aeb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eec8ef8565d54447bd666aeb762be4dc'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:04:29.378052 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1206/2410] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:04:28 2022] DELETE /identity/v3/users/eec8ef8565d54447bd666aeb762be4dc => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:04:29.382668 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab012e-794f-44b1-935c-2231e1827477 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:29.383169 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab012e-794f-44b1-935c-2231e1827477 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:29.383396 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab012e-794f-44b1-935c-2231e1827477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:29.434061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-40ab012e-794f-44b1-935c-2231e1827477 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:04:29.435323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-40ab012e-794f-44b1-935c-2231e1827477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:29.508780 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1205/2411] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:04:29.522624 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf502cb-84b4-4043-aece-da2046a1aeb9 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:29.529965 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-1cf502cb-84b4-4043-aece-da2046a1aeb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:29.594838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:29.648885 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf502cb-84b4-4043-aece-da2046a1aeb9 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:29.652737 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d9047-4514-45f6-8fc4-aad0f1e0e2b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:29.653382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d9047-4514-45f6-8fc4-aad0f1e0e2b9 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:29.653669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d9047-4514-45f6-8fc4-aad0f1e0e2b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:29.653947 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d9047-4514-45f6-8fc4-aad0f1e0e2b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:29.663327 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d9047-4514-45f6-8fc4-aad0f1e0e2b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:29.664818 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d9047-4514-45f6-8fc4-aad0f1e0e2b9 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:29.675273 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1207/2412] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:04:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:04:30.304260 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab012e-794f-44b1-935c-2231e1827477 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:30.306574 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-40ab012e-794f-44b1-935c-2231e1827477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:30.320985 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab012e-794f-44b1-935c-2231e1827477 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:30.328370 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f5335-651e-4321-8570-8f2c947592e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:30.329735 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f5335-651e-4321-8570-8f2c947592e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:30.330022 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f5335-651e-4321-8570-8f2c947592e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:30.330296 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f5335-651e-4321-8570-8f2c947592e5 admin admin] PATH_INFO: `/v3/projects/39eaef0f0c034d0a992ce5386c490e0d` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:30.331563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f5335-651e-4321-8570-8f2c947592e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39eaef0f0c034d0a992ce5386c490e0d)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:30.333891 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f5335-651e-4321-8570-8f2c947592e5 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:30.476071 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-1e2f5335-651e-4321-8570-8f2c947592e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39eaef0f0c034d0a992ce5386c490e0d', 'request_id': 'req-1e2f5335-651e-4321-8570-8f2c947592e5'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:04:30.482989 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-1e2f5335-651e-4321-8570-8f2c947592e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39eaef0f0c034d0a992ce5386c490e0d', 'request_id': 'req-1e2f5335-651e-4321-8570-8f2c947592e5'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:04:30.586625 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-1e2f5335-651e-4321-8570-8f2c947592e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39eaef0f0c034d0a992ce5386c490e0d', 'request_id': 'req-1e2f5335-651e-4321-8570-8f2c947592e5'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:04:30.598913 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-1e2f5335-651e-4321-8570-8f2c947592e5 admin admin] The token cache is being invalidate because project 39eaef0f0c034d0a992ce5386c490e0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:04:30.599205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-1e2f5335-651e-4321-8570-8f2c947592e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:04:30.599886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-1e2f5335-651e-4321-8570-8f2c947592e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:04:30.601471 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1206/2413] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:04:30 2022] DELETE /identity/v3/projects/39eaef0f0c034d0a992ce5386c490e0d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:04:30.606986 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb9c94-9c74-413f-8f18-f0217b237380 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:30.607472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb9c94-9c74-413f-8f18-f0217b237380 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:30.607569 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb9c94-9c74-413f-8f18-f0217b237380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:30.659433 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-c7fb9c94-9c74-413f-8f18-f0217b237380 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:04:30.660697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-c7fb9c94-9c74-413f-8f18-f0217b237380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:30.722884 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1208/2414] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:04:30.730967 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94aabd-7dce-4329-a16d-596b3f8fbf6c None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:30.731148 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94aabd-7dce-4329-a16d-596b3f8fbf6c None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:30.731435 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94aabd-7dce-4329-a16d-596b3f8fbf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:30.750880 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-2f94aabd-7dce-4329-a16d-596b3f8fbf6c None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:04:30.752390 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-2f94aabd-7dce-4329-a16d-596b3f8fbf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:30.764718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1207/2415] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:04:30.765972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb9c94-9c74-413f-8f18-f0217b237380 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:30.776217 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb9c94-9c74-413f-8f18-f0217b237380 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:30.781479 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3cf37-a36a-4279-bb3b-4d2b7b0b2153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:30.782166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3cf37-a36a-4279-bb3b-4d2b7b0b2153 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:30.782438 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3cf37-a36a-4279-bb3b-4d2b7b0b2153 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:30.788519 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3cf37-a36a-4279-bb3b-4d2b7b0b2153 admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:30.788519 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3cf37-a36a-4279-bb3b-4d2b7b0b2153 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:04:30.788519 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3cf37-a36a-4279-bb3b-4d2b7b0b2153 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:30.788519 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3cf37-a36a-4279-bb3b-4d2b7b0b2153 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:30.798466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1209/2416] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 16:04:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:04:30.802639 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94aabd-7dce-4329-a16d-596b3f8fbf6c None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:30.812650 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94aabd-7dce-4329-a16d-596b3f8fbf6c None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:30.817378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45aa74-1972-4344-a504-eda6917e524a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:30.817976 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45aa74-1972-4344-a504-eda6917e524a admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:30.818262 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45aa74-1972-4344-a504-eda6917e524a admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:30.818541 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45aa74-1972-4344-a504-eda6917e524a admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:30.819235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45aa74-1972-4344-a504-eda6917e524a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:30.821282 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45aa74-1972-4344-a504-eda6917e524a admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:30.927445 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1208/2417] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:04:30 2022] POST /identity/v3/projects => generated 374 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:04:30.931466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3cf37-a36a-4279-bb3b-4d2b7b0b2153 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:30.942014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3cf37-a36a-4279-bb3b-4d2b7b0b2153 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:30.999799 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b471c-3241-4be9-a59a-6d10a4bc1311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:31.000516 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b471c-3241-4be9-a59a-6d10a4bc1311 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:31.000803 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b471c-3241-4be9-a59a-6d10a4bc1311 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:31.001082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b471c-3241-4be9-a59a-6d10a4bc1311 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:31.001771 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b471c-3241-4be9-a59a-6d10a4bc1311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:31.003753 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b471c-3241-4be9-a59a-6d10a4bc1311 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:31.085919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:31.092352 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1210/2418] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:04:30 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:04:31.096584 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45aa74-1972-4344-a504-eda6917e524a admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:31.107492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45aa74-1972-4344-a504-eda6917e524a admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:31.112351 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b87814-10e8-4c66-a909-d11dae9a0b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:31.113752 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b87814-10e8-4c66-a909-d11dae9a0b34 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:31.113752 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b87814-10e8-4c66-a909-d11dae9a0b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:31.113752 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b87814-10e8-4c66-a909-d11dae9a0b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:31.114397 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b87814-10e8-4c66-a909-d11dae9a0b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:31.116001 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b87814-10e8-4c66-a909-d11dae9a0b34 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:31.127291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1209/2419] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:04:31 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:04:31.131438 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b471c-3241-4be9-a59a-6d10a4bc1311 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:31.141430 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b471c-3241-4be9-a59a-6d10a4bc1311 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:31.146073 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9d0f8-83cf-422a-aae4-96d7131560a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:31.146735 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9d0f8-83cf-422a-aae4-96d7131560a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:31.147025 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9d0f8-83cf-422a-aae4-96d7131560a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:31.147313 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9d0f8-83cf-422a-aae4-96d7131560a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:31.148073 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9d0f8-83cf-422a-aae4-96d7131560a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:31.149693 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9d0f8-83cf-422a-aae4-96d7131560a8 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:31.160371 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1211/2420] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:04:31 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:04:31.164617 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b87814-10e8-4c66-a909-d11dae9a0b34 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:31.175553 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b87814-10e8-4c66-a909-d11dae9a0b34 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:31.180670 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611059bb-668e-48cf-ae30-6339977c1c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:31.181600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611059bb-668e-48cf-ae30-6339977c1c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:31.182006 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611059bb-668e-48cf-ae30-6339977c1c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:31.182368 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611059bb-668e-48cf-ae30-6339977c1c0c admin admin] PATH_INFO: `/v3/projects/7469c47f14be40df88cc57050d28e8ba/users/c78eff78e8564d0ba386bcd02137aa35/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:31.199071 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611059bb-668e-48cf-ae30-6339977c1c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7469c47f14be40df88cc57050d28e8ba, user_id=c78eff78e8564d0ba386bcd02137aa35, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:31.201838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611059bb-668e-48cf-ae30-6339977c1c0c admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:31.204092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:31.296537 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1210/2421] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:04:31 2022] PUT /identity/v3/projects/7469c47f14be40df88cc57050d28e8ba/users/c78eff78e8564d0ba386bcd02137aa35/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:04:31.301881 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e59b06-1f70-47da-8791-09def6a09195 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:31.302208 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e59b06-1f70-47da-8791-09def6a09195 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:31.302512 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e59b06-1f70-47da-8791-09def6a09195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:31.320351 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-f4e59b06-1f70-47da-8791-09def6a09195 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:04:31.321544 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f4e59b06-1f70-47da-8791-09def6a09195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:31.394309 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1212/2422] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:04:31.408201 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611059bb-668e-48cf-ae30-6339977c1c0c admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:31.409947 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-611059bb-668e-48cf-ae30-6339977c1c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:31.472877 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611059bb-668e-48cf-ae30-6339977c1c0c admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:31.477349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f39dd-8ae6-4400-80f5-5ee5dda0fdfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:31.478005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f39dd-8ae6-4400-80f5-5ee5dda0fdfd service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:31.478291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f39dd-8ae6-4400-80f5-5ee5dda0fdfd service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:31.478568 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f39dd-8ae6-4400-80f5-5ee5dda0fdfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:31.489273 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f39dd-8ae6-4400-80f5-5ee5dda0fdfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:31.490738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f39dd-8ae6-4400-80f5-5ee5dda0fdfd service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:31.500855 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1211/2423] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:04:38.959613 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af9abb-294e-4d5b-8c88-d36a09a89779 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:38.960071 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af9abb-294e-4d5b-8c88-d36a09a89779 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:38.960293 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af9abb-294e-4d5b-8c88-d36a09a89779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:38.992331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-30af9abb-294e-4d5b-8c88-d36a09a89779 None None] MFA Rules not processed for user `c78eff78e8564d0ba386bcd02137aa35`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:04:38.999901 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-30af9abb-294e-4d5b-8c88-d36a09a89779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:39.073635 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1213/2424] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:04:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:04:39.078887 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f39dd-8ae6-4400-80f5-5ee5dda0fdfd service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:39.089303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f39dd-8ae6-4400-80f5-5ee5dda0fdfd service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:39.094956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfdf02-3c54-4a1c-a8e8-d256d15f2a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:39.095664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfdf02-3c54-4a1c-a8e8-d256d15f2a69 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:39.095952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfdf02-3c54-4a1c-a8e8-d256d15f2a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:39.096443 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfdf02-3c54-4a1c-a8e8-d256d15f2a69 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:39.097156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdfdf02-3c54-4a1c-a8e8-d256d15f2a69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:39.099060 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdfdf02-3c54-4a1c-a8e8-d256d15f2a69 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:39.264208 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1212/2425] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:04:39 2022] POST /identity/v3/projects => generated 372 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:04:39.268179 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af9abb-294e-4d5b-8c88-d36a09a89779 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:39.280027 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af9abb-294e-4d5b-8c88-d36a09a89779 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:39.338267 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff68a7-b729-4da0-b23d-eb28f02a669d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:39.338942 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff68a7-b729-4da0-b23d-eb28f02a669d admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:39.339510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff68a7-b729-4da0-b23d-eb28f02a669d admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:39.339909 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff68a7-b729-4da0-b23d-eb28f02a669d admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:39.340767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff68a7-b729-4da0-b23d-eb28f02a669d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:39.342687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff68a7-b729-4da0-b23d-eb28f02a669d admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:39.433220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1214/2426] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:04:39 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:04:39.438486 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfdf02-3c54-4a1c-a8e8-d256d15f2a69 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:39.449203 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfdf02-3c54-4a1c-a8e8-d256d15f2a69 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:39.453808 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5ee45-cd6d-47d5-aad9-67ddf9b2ff08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:39.454461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5ee45-cd6d-47d5-aad9-67ddf9b2ff08 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:39.454748 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5ee45-cd6d-47d5-aad9-67ddf9b2ff08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:39.455035 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5ee45-cd6d-47d5-aad9-67ddf9b2ff08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:39.455758 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5ee45-cd6d-47d5-aad9-67ddf9b2ff08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:39.457443 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5ee45-cd6d-47d5-aad9-67ddf9b2ff08 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:39.469049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1213/2427] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:04:39 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:04:39.472864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff68a7-b729-4da0-b23d-eb28f02a669d admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:39.484200 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff68a7-b729-4da0-b23d-eb28f02a669d admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:39.489312 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d105ff-ef5a-4a34-b6bd-5817d1f748ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:39.490153 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d105ff-ef5a-4a34-b6bd-5817d1f748ca admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:39.490440 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d105ff-ef5a-4a34-b6bd-5817d1f748ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:39.490719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d105ff-ef5a-4a34-b6bd-5817d1f748ca admin admin] PATH_INFO: `/v3/projects/158c6a33129b47d9945e8d69d0bf7f5a/users/8a763155fe1046719676ed693aaf8d4b/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:39.493276 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:39.507123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d105ff-ef5a-4a34-b6bd-5817d1f748ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=158c6a33129b47d9945e8d69d0bf7f5a, user_id=8a763155fe1046719676ed693aaf8d4b, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:39.512369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d105ff-ef5a-4a34-b6bd-5817d1f748ca admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:39.628089 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1215/2428] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:04:39 2022] PUT /identity/v3/projects/158c6a33129b47d9945e8d69d0bf7f5a/users/8a763155fe1046719676ed693aaf8d4b/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:04:39.632271 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5ee45-cd6d-47d5-aad9-67ddf9b2ff08 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:39.643018 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5ee45-cd6d-47d5-aad9-67ddf9b2ff08 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:39.708087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4e1cc-6966-4c29-a83d-caf3a4ce5a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:39.708825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4e1cc-6966-4c29-a83d-caf3a4ce5a75 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:39.709108 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4e1cc-6966-4c29-a83d-caf3a4ce5a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:39.709404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4e1cc-6966-4c29-a83d-caf3a4ce5a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:39.710351 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4e1cc-6966-4c29-a83d-caf3a4ce5a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:39.711931 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4e1cc-6966-4c29-a83d-caf3a4ce5a75 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:39.726524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1214/2429] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:04:39 2022] GET /identity/v3/roles => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:04:39.727773 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d105ff-ef5a-4a34-b6bd-5817d1f748ca admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:39.740313 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d105ff-ef5a-4a34-b6bd-5817d1f748ca admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:39.745095 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5bb92-f968-4e47-b1b7-5a45a0367e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:39.746658 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5bb92-f968-4e47-b1b7-5a45a0367e52 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:39.746955 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5bb92-f968-4e47-b1b7-5a45a0367e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:39.747245 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5bb92-f968-4e47-b1b7-5a45a0367e52 admin admin] PATH_INFO: `/v3/projects/158c6a33129b47d9945e8d69d0bf7f5a/users/8a763155fe1046719676ed693aaf8d4b/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:39.749315 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5bb92-f968-4e47-b1b7-5a45a0367e52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=158c6a33129b47d9945e8d69d0bf7f5a, user_id=8a763155fe1046719676ed693aaf8d4b, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:39.751965 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5bb92-f968-4e47-b1b7-5a45a0367e52 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:39.763155 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1216/2430] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:04:39 2022] PUT /identity/v3/projects/158c6a33129b47d9945e8d69d0bf7f5a/users/8a763155fe1046719676ed693aaf8d4b/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:04:41.034333 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4e1cc-6966-4c29-a83d-caf3a4ce5a75 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:41.115089 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4e1cc-6966-4c29-a83d-caf3a4ce5a75 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:41.130316 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:41.175448 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee539f4-8b01-428d-876f-5302078fcb16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:41.176143 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee539f4-8b01-428d-876f-5302078fcb16 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:41.176521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee539f4-8b01-428d-876f-5302078fcb16 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:41.176808 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee539f4-8b01-428d-876f-5302078fcb16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:41.178628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-1ee539f4-8b01-428d-876f-5302078fcb16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:41.245886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee539f4-8b01-428d-876f-5302078fcb16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:41.247364 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee539f4-8b01-428d-876f-5302078fcb16 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:41.258024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1215/2431] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:04:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:04:46.677420 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5bb92-f968-4e47-b1b7-5a45a0367e52 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:46.680258 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-44c5bb92-f968-4e47-b1b7-5a45a0367e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:46.712971 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5bb92-f968-4e47-b1b7-5a45a0367e52 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:46.731023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5c376-6103-46a9-9424-19333c03872d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:46.731023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5c376-6103-46a9-9424-19333c03872d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:46.731023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5c376-6103-46a9-9424-19333c03872d admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:46.731023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5c376-6103-46a9-9424-19333c03872d admin admin] PATH_INFO: `/v3/users/fe6f58bedd87454bad46b0c48697eec9` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:46.731669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5c376-6103-46a9-9424-19333c03872d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe6f58bedd87454bad46b0c48697eec9)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:46.736579 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5c376-6103-46a9-9424-19333c03872d admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:47.009787 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa80897-075e-4b7f-a606-f2adf364c9b8 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:47.010300 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa80897-075e-4b7f-a606-f2adf364c9b8 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:47.010395 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa80897-075e-4b7f-a606-f2adf364c9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:47.045632 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-afa80897-075e-4b7f-a606-f2adf364c9b8 None None] MFA Rules not processed for user `8a763155fe1046719676ed693aaf8d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:04:47.047788 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-afa80897-075e-4b7f-a606-f2adf364c9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:47.052881 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-19e5c376-6103-46a9-9424-19333c03872d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe6f58bedd87454bad46b0c48697eec9'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:04:47.053633 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-19e5c376-6103-46a9-9424-19333c03872d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe6f58bedd87454bad46b0c48697eec9'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:04:47.073605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-19e5c376-6103-46a9-9424-19333c03872d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe6f58bedd87454bad46b0c48697eec9'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:04:47.083020 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-19e5c376-6103-46a9-9424-19333c03872d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe6f58bedd87454bad46b0c48697eec9'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:04:47.085738 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-19e5c376-6103-46a9-9424-19333c03872d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe6f58bedd87454bad46b0c48697eec9'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:04:47.143484 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1216/2432] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:04:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:04:47.158342 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa80897-075e-4b7f-a606-f2adf364c9b8 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:47.159738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-afa80897-075e-4b7f-a606-f2adf364c9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:47.219256 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:47.257746 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1217/2433] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:04:46 2022] DELETE /identity/v3/users/fe6f58bedd87454bad46b0c48697eec9 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:04:47.271628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa80897-075e-4b7f-a606-f2adf364c9b8 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:47.340039 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bd21f-7a90-437f-a2d8-e014afbe2c23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:47.340732 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bd21f-7a90-437f-a2d8-e014afbe2c23 service nova] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:47.341023 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bd21f-7a90-437f-a2d8-e014afbe2c23 service nova] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:47.341312 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bd21f-7a90-437f-a2d8-e014afbe2c23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:47.343118 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-696bd21f-7a90-437f-a2d8-e014afbe2c23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:47.410459 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696bd21f-7a90-437f-a2d8-e014afbe2c23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:47.412063 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696bd21f-7a90-437f-a2d8-e014afbe2c23 service nova] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:47.421770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1217/2434] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:04:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:04:47.590697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5c376-6103-46a9-9424-19333c03872d admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:47.592580 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-19e5c376-6103-46a9-9424-19333c03872d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:47.663822 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5c376-6103-46a9-9424-19333c03872d admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:47.668931 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c19f8f-2795-45b3-a12a-1902ba313cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:47.669813 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c19f8f-2795-45b3-a12a-1902ba313cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:47.670098 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c19f8f-2795-45b3-a12a-1902ba313cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:47.670378 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c19f8f-2795-45b3-a12a-1902ba313cf9 admin admin] PATH_INFO: `/v3/projects/2604fe90997b48439ed17360fa15f24a` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:47.671560 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c19f8f-2795-45b3-a12a-1902ba313cf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2604fe90997b48439ed17360fa15f24a)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:47.673577 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c19f8f-2795-45b3-a12a-1902ba313cf9 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:47.852909 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=84,keystone:INSERT=3,keystone:DELETE=13 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:47.857351 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-41c19f8f-2795-45b3-a12a-1902ba313cf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2604fe90997b48439ed17360fa15f24a', 'request_id': 'req-41c19f8f-2795-45b3-a12a-1902ba313cf9'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:04:47.875636 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-41c19f8f-2795-45b3-a12a-1902ba313cf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2604fe90997b48439ed17360fa15f24a', 'request_id': 'req-41c19f8f-2795-45b3-a12a-1902ba313cf9'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:04:47.881609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-41c19f8f-2795-45b3-a12a-1902ba313cf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2604fe90997b48439ed17360fa15f24a', 'request_id': 'req-41c19f8f-2795-45b3-a12a-1902ba313cf9'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:04:48.016604 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-41c19f8f-2795-45b3-a12a-1902ba313cf9 admin admin] The token cache is being invalidate because project 2604fe90997b48439ed17360fa15f24a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:04:48.020205 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-41c19f8f-2795-45b3-a12a-1902ba313cf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:04:48.020205 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-41c19f8f-2795-45b3-a12a-1902ba313cf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:04:48.020205 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1218/2435] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:04:47 2022] DELETE /identity/v3/projects/2604fe90997b48439ed17360fa15f24a => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:04:48.024128 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a32af5-6507-4093-bac9-de9080789143 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:48.024583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a32af5-6507-4093-bac9-de9080789143 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:48.024727 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a32af5-6507-4093-bac9-de9080789143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:48.042427 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-05a32af5-6507-4093-bac9-de9080789143 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:04:48.044456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-05a32af5-6507-4093-bac9-de9080789143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:48.096559 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:48.106349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1218/2436] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:04:48.114152 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182897cf-1829-475b-98d0-04ab0cba9865 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:48.114454 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182897cf-1829-475b-98d0-04ab0cba9865 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:48.114743 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182897cf-1829-475b-98d0-04ab0cba9865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:48.134098 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-182897cf-1829-475b-98d0-04ab0cba9865 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:04:48.135325 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-182897cf-1829-475b-98d0-04ab0cba9865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:48.143610 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1219/2437] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:04:48.147917 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a32af5-6507-4093-bac9-de9080789143 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:48.158730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a32af5-6507-4093-bac9-de9080789143 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:48.164296 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79ae9e-be57-41cb-a3c7-332b51f2a3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:48.165068 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79ae9e-be57-41cb-a3c7-332b51f2a3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:48.165363 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79ae9e-be57-41cb-a3c7-332b51f2a3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:48.165646 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79ae9e-be57-41cb-a3c7-332b51f2a3d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:48.166386 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79ae9e-be57-41cb-a3c7-332b51f2a3d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:04:48.166702 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79ae9e-be57-41cb-a3c7-332b51f2a3d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:48.169033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79ae9e-be57-41cb-a3c7-332b51f2a3d5 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:48.181272 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1219/2438] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 16:04:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:04:48.186340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182897cf-1829-475b-98d0-04ab0cba9865 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:48.196071 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182897cf-1829-475b-98d0-04ab0cba9865 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:48.201455 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5982bb-2884-4e9c-b533-15f58321fc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:48.202138 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5982bb-2884-4e9c-b533-15f58321fc8d admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:48.202426 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5982bb-2884-4e9c-b533-15f58321fc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:48.202701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5982bb-2884-4e9c-b533-15f58321fc8d admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:48.203406 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5982bb-2884-4e9c-b533-15f58321fc8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:48.205330 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5982bb-2884-4e9c-b533-15f58321fc8d admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:48.360944 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1220/2439] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:04:48 2022] POST /identity/v3/projects => generated 390 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:04:48.362057 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79ae9e-be57-41cb-a3c7-332b51f2a3d5 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:48.373064 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79ae9e-be57-41cb-a3c7-332b51f2a3d5 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:48.438797 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686a0b9-84a6-47cb-ab15-603cc38b3b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:48.439604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686a0b9-84a6-47cb-ab15-603cc38b3b8f admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:48.440021 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686a0b9-84a6-47cb-ab15-603cc38b3b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:48.440436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686a0b9-84a6-47cb-ab15-603cc38b3b8f admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:48.441213 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686a0b9-84a6-47cb-ab15-603cc38b3b8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:48.443223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686a0b9-84a6-47cb-ab15-603cc38b3b8f admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:48.574999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1220/2440] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:04:48 2022] POST /identity/v3/users => generated 296 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:04:48.576220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5982bb-2884-4e9c-b533-15f58321fc8d admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:48.586721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5982bb-2884-4e9c-b533-15f58321fc8d admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:48.592188 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8c746-0653-42e1-a691-f1bb06c846c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:48.592937 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8c746-0653-42e1-a691-f1bb06c846c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:48.593329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8c746-0653-42e1-a691-f1bb06c846c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:48.593615 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8c746-0653-42e1-a691-f1bb06c846c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:48.594354 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8c746-0653-42e1-a691-f1bb06c846c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:48.595954 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8c746-0653-42e1-a691-f1bb06c846c4 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:48.608576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1221/2441] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:04:48 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:04:48.612663 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686a0b9-84a6-47cb-ab15-603cc38b3b8f admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:48.624574 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686a0b9-84a6-47cb-ab15-603cc38b3b8f admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:48.630010 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418a5cd-5fac-4973-9ee1-ed783091368e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:48.630827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418a5cd-5fac-4973-9ee1-ed783091368e admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:48.631213 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418a5cd-5fac-4973-9ee1-ed783091368e admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:48.631600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418a5cd-5fac-4973-9ee1-ed783091368e admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:48.637903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418a5cd-5fac-4973-9ee1-ed783091368e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:48.639416 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418a5cd-5fac-4973-9ee1-ed783091368e admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:48.651345 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1221/2442] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:04:48 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:04:48.656440 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8c746-0653-42e1-a691-f1bb06c846c4 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:48.668381 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8c746-0653-42e1-a691-f1bb06c846c4 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:48.675183 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627e31e-eaf0-4e4f-9a79-649cfc2fcf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:48.676113 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627e31e-eaf0-4e4f-9a79-649cfc2fcf85 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:48.676444 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627e31e-eaf0-4e4f-9a79-649cfc2fcf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:48.676723 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627e31e-eaf0-4e4f-9a79-649cfc2fcf85 admin admin] PATH_INFO: `/v3/projects/f50528750c0e4504aaafba1ebae3f707/users/8874a26203f0408f8d8c9f26b2818b59/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:48.712350 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627e31e-eaf0-4e4f-9a79-649cfc2fcf85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f50528750c0e4504aaafba1ebae3f707, user_id=8874a26203f0408f8d8c9f26b2818b59, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:48.712350 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627e31e-eaf0-4e4f-9a79-649cfc2fcf85 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:48.868748 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1222/2443] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:04:48 2022] PUT /identity/v3/projects/f50528750c0e4504aaafba1ebae3f707/users/8874a26203f0408f8d8c9f26b2818b59/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:04:48.874288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2773a-5c9b-4d3c-9dbc-78d7b3ff1fd9 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:48.874608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2773a-5c9b-4d3c-9dbc-78d7b3ff1fd9 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:48.874890 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2773a-5c9b-4d3c-9dbc-78d7b3ff1fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:48.894833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-61d2773a-5c9b-4d3c-9dbc-78d7b3ff1fd9 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:04:48.899367 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-61d2773a-5c9b-4d3c-9dbc-78d7b3ff1fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:48.965845 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1222/2444] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:04:48.975275 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627e31e-eaf0-4e4f-9a79-649cfc2fcf85 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:48.976933 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-9627e31e-eaf0-4e4f-9a79-649cfc2fcf85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:49.051077 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627e31e-eaf0-4e4f-9a79-649cfc2fcf85 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:49.055665 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d2899-ff39-4075-993e-86f17125e467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:49.056535 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d2899-ff39-4075-993e-86f17125e467 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:49.056845 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d2899-ff39-4075-993e-86f17125e467 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:49.057188 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d2899-ff39-4075-993e-86f17125e467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:49.068454 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d2899-ff39-4075-993e-86f17125e467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:49.069976 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d2899-ff39-4075-993e-86f17125e467 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:49.080751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1223/2445] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:04:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:04:50.934997 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2773a-5c9b-4d3c-9dbc-78d7b3ff1fd9 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:50.937240 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-61d2773a-5c9b-4d3c-9dbc-78d7b3ff1fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:51.032043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:51.038893 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2773a-5c9b-4d3c-9dbc-78d7b3ff1fd9 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:51.045947 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d10e7a-c481-41e9-a021-fbe6f46f1b7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:51.046705 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d10e7a-c481-41e9-a021-fbe6f46f1b7b service nova] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:51.046998 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d10e7a-c481-41e9-a021-fbe6f46f1b7b service nova] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:51.047283 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d10e7a-c481-41e9-a021-fbe6f46f1b7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:51.049427 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-c0d10e7a-c481-41e9-a021-fbe6f46f1b7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:51.081540 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f853b-9531-4a94-8788-23e83b6d7181 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:51.082134 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f853b-9531-4a94-8788-23e83b6d7181 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:51.082134 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f853b-9531-4a94-8788-23e83b6d7181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:51.118745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-9a6f853b-9531-4a94-8788-23e83b6d7181 None None] MFA Rules not processed for user `c78eff78e8564d0ba386bcd02137aa35`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:04:51.120205 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-9a6f853b-9531-4a94-8788-23e83b6d7181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:51.128812 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d10e7a-c481-41e9-a021-fbe6f46f1b7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:51.130760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d10e7a-c481-41e9-a021-fbe6f46f1b7b service nova] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:51.144398 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1223/2446] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:04:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:04:51.212209 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1224/2447] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:04:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:04:57.245174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47b4c3-3bf5-4f08-a6e7-0d06a48f734a None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:57.245174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47b4c3-3bf5-4f08-a6e7-0d06a48f734a None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:57.245174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47b4c3-3bf5-4f08-a6e7-0d06a48f734a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:57.270092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-2c47b4c3-3bf5-4f08-a6e7-0d06a48f734a None None] MFA Rules not processed for user `8874a26203f0408f8d8c9f26b2818b59`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:04:57.271002 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-2c47b4c3-3bf5-4f08-a6e7-0d06a48f734a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:57.349700 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1224/2448] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:04:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:04:57.365500 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f853b-9531-4a94-8788-23e83b6d7181 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:04:57.367003 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-9a6f853b-9531-4a94-8788-23e83b6d7181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:04:57.385263 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f853b-9531-4a94-8788-23e83b6d7181 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:04:57.391385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf691c-4c0f-4002-a8d6-2b4d91e3171b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:04:57.392141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf691c-4c0f-4002-a8d6-2b4d91e3171b service nova] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:04:57.392434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf691c-4c0f-4002-a8d6-2b4d91e3171b service nova] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:04:57.392717 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf691c-4c0f-4002-a8d6-2b4d91e3171b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:04:57.401775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf691c-4c0f-4002-a8d6-2b4d91e3171b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:04:57.403696 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf691c-4c0f-4002-a8d6-2b4d91e3171b service nova] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:04:57.414067 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1225/2449] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:04:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:05:00.739600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6874c-9815-47ca-8ed0-29334864fe81 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:05:00.739600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6874c-9815-47ca-8ed0-29334864fe81 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:05:00.739600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6874c-9815-47ca-8ed0-29334864fe81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:05:00.757711 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-6ee6874c-9815-47ca-8ed0-29334864fe81 None None] MFA Rules not processed for user `8874a26203f0408f8d8c9f26b2818b59`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:05:00.758998 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-6ee6874c-9815-47ca-8ed0-29334864fe81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:05:00.772936 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1225/2450] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:05:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:05:03.592140 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf691c-4c0f-4002-a8d6-2b4d91e3171b service nova] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:05:03.593880 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-7fdf691c-4c0f-4002-a8d6-2b4d91e3171b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:05:03.616140 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:03.682790 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6874c-9815-47ca-8ed0-29334864fe81 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:05:03.682790 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-6ee6874c-9815-47ca-8ed0-29334864fe81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:05:03.720123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf691c-4c0f-4002-a8d6-2b4d91e3171b service nova] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:05:03.727457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b507f7-cc96-43b1-8071-c0f0b34cde3a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716cbbfeede34885b0411e5b9b25df47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:05:03.728293 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b507f7-cc96-43b1-8071-c0f0b34cde3a service placement] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:05:03.728589 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b507f7-cc96-43b1-8071-c0f0b34cde3a service placement] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:05:03.729205 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b507f7-cc96-43b1-8071-c0f0b34cde3a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:05:03.732415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-01b507f7-cc96-43b1-8071-c0f0b34cde3a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:05:03.745613 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b507f7-cc96-43b1-8071-c0f0b34cde3a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:05:03.748346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b507f7-cc96-43b1-8071-c0f0b34cde3a service placement] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:05:03.762356 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6874c-9815-47ca-8ed0-29334864fe81 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:05:03.762976 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1226/2451] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:05:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:05:03.767955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719caad-4841-47fd-af07-626a2ef0bfe7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716cbbfeede34885b0411e5b9b25df47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:05:03.768780 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719caad-4841-47fd-af07-626a2ef0bfe7 service placement] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:05:03.769161 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719caad-4841-47fd-af07-626a2ef0bfe7 service placement] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:05:03.769538 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719caad-4841-47fd-af07-626a2ef0bfe7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:05:03.779358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719caad-4841-47fd-af07-626a2ef0bfe7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:05:03.781289 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719caad-4841-47fd-af07-626a2ef0bfe7 service placement] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:05:03.795061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1226/2452] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:05:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:05:05.941294 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b476423-f5c0-4103-8541-1fec70b353a2 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:05:05.941840 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b476423-f5c0-4103-8541-1fec70b353a2 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:05:05.941984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b476423-f5c0-4103-8541-1fec70b353a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:05:05.973513 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-5b476423-f5c0-4103-8541-1fec70b353a2 None None] MFA Rules not processed for user `4a1474b39e0b477daff5833491cd6df5`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:05:05.974653 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-5b476423-f5c0-4103-8541-1fec70b353a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:05:06.035276 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1227/2453] 10.222.0.119 () {58 vars in 972 bytes} [Thu Jul 14 16:05:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:05:06.206539 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719caad-4841-47fd-af07-626a2ef0bfe7 service placement] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:05:06.208704 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-9719caad-4841-47fd-af07-626a2ef0bfe7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:05:06.233451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:06.288066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719caad-4841-47fd-af07-626a2ef0bfe7 service placement] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:05:06.294263 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e9329-4bea-4efb-ab8b-46049df27839 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a5c169576e432c8174a562ae358e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:05:06.294967 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e9329-4bea-4efb-ab8b-46049df27839 service swift] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:05:06.295226 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e9329-4bea-4efb-ab8b-46049df27839 service swift] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:05:06.295513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e9329-4bea-4efb-ab8b-46049df27839 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:05:06.306743 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e9329-4bea-4efb-ab8b-46049df27839 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:05:06.308473 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e9329-4bea-4efb-ab8b-46049df27839 service swift] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:05:06.320262 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1227/2454] 10.222.0.119 () {60 vars in 1389 bytes} [Thu Jul 14 16:05:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 16:05:07.782223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b476423-f5c0-4103-8541-1fec70b353a2 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:05:07.792068 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b476423-f5c0-4103-8541-1fec70b353a2 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:05:07.796736 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405d1a7-5b17-4d3d-80a8-7812ca6ecc87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:05:07.802237 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405d1a7-5b17-4d3d-80a8-7812ca6ecc87 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:05:07.802237 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405d1a7-5b17-4d3d-80a8-7812ca6ecc87 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:05:07.802237 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405d1a7-5b17-4d3d-80a8-7812ca6ecc87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:05:07.802237 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-6405d1a7-5b17-4d3d-80a8-7812ca6ecc87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:05:07.812679 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405d1a7-5b17-4d3d-80a8-7812ca6ecc87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:05:07.814411 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405d1a7-5b17-4d3d-80a8-7812ca6ecc87 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:05:07.825022 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1228/2455] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:05:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:05:10.128363 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395672e-d321-4f68-9b8b-eb16f7a85a2c None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:05:10.128853 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395672e-d321-4f68-9b8b-eb16f7a85a2c None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:05:10.128998 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395672e-d321-4f68-9b8b-eb16f7a85a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:05:10.148830 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-2395672e-d321-4f68-9b8b-eb16f7a85a2c None None] MFA Rules not processed for user `6bbbf243c1334013ac235aa5b0853621`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:05:10.150354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-2395672e-d321-4f68-9b8b-eb16f7a85a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:05:10.214350 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1228/2456] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:05:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:05:10.846184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405d1a7-5b17-4d3d-80a8-7812ca6ecc87 service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:05:10.856359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405d1a7-5b17-4d3d-80a8-7812ca6ecc87 service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:05:10.861440 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4e947-8f21-45d2-b99e-d5b2a49b36fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:05:10.861975 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4e947-8f21-45d2-b99e-d5b2a49b36fd service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:05:10.862265 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4e947-8f21-45d2-b99e-d5b2a49b36fd service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:05:10.862546 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4e947-8f21-45d2-b99e-d5b2a49b36fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:05:10.864376 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-e4c4e947-8f21-45d2-b99e-d5b2a49b36fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:05:10.875481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4e947-8f21-45d2-b99e-d5b2a49b36fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:05:10.877229 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4e947-8f21-45d2-b99e-d5b2a49b36fd service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:05:10.887867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1229/2457] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:05:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:05:17.204735 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395672e-d321-4f68-9b8b-eb16f7a85a2c None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:05:17.217205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395672e-d321-4f68-9b8b-eb16f7a85a2c None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:05:17.222365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74241b1-8542-4a89-bf1a-eb1f484274ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716cbbfeede34885b0411e5b9b25df47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:05:17.223012 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74241b1-8542-4a89-bf1a-eb1f484274ac service placement] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:05:17.223298 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74241b1-8542-4a89-bf1a-eb1f484274ac service placement] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:05:17.223576 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74241b1-8542-4a89-bf1a-eb1f484274ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:05:17.225336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-f74241b1-8542-4a89-bf1a-eb1f484274ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:05:17.238162 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74241b1-8542-4a89-bf1a-eb1f484274ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:05:17.239804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74241b1-8542-4a89-bf1a-eb1f484274ac service placement] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:05:17.250764 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1229/2458] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:05:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:05:17.408805 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4e947-8f21-45d2-b99e-d5b2a49b36fd service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:05:17.410249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-e4c4e947-8f21-45d2-b99e-d5b2a49b36fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:05:17.428338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4e947-8f21-45d2-b99e-d5b2a49b36fd service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:05:17.436174 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5a06e-cc0b-4b1a-b81d-c807dc99df16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:05:17.437202 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5a06e-cc0b-4b1a-b81d-c807dc99df16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:05:17.437494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5a06e-cc0b-4b1a-b81d-c807dc99df16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:05:17.437775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5a06e-cc0b-4b1a-b81d-c807dc99df16 admin admin] PATH_INFO: `/v3/users/aad6767795b0402cb72f249b4c3a8039` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:05:17.439849 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5a06e-cc0b-4b1a-b81d-c807dc99df16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aad6767795b0402cb72f249b4c3a8039)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:05:17.442251 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5a06e-cc0b-4b1a-b81d-c807dc99df16 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:05:17.659227 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:17.669784 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-aab5a06e-cc0b-4b1a-b81d-c807dc99df16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aad6767795b0402cb72f249b4c3a8039'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:05:17.670716 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-aab5a06e-cc0b-4b1a-b81d-c807dc99df16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aad6767795b0402cb72f249b4c3a8039'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:05:17.687313 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-aab5a06e-cc0b-4b1a-b81d-c807dc99df16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aad6767795b0402cb72f249b4c3a8039'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:05:17.724335 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-aab5a06e-cc0b-4b1a-b81d-c807dc99df16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aad6767795b0402cb72f249b4c3a8039'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:05:17.724335 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-aab5a06e-cc0b-4b1a-b81d-c807dc99df16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aad6767795b0402cb72f249b4c3a8039'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:05:17.834313 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1230/2459] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:05:17 2022] DELETE /identity/v3/users/aad6767795b0402cb72f249b4c3a8039 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:05:18.418585 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74241b1-8542-4a89-bf1a-eb1f484274ac service placement] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:05:18.430918 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74241b1-8542-4a89-bf1a-eb1f484274ac service placement] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:05:18.501600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d9e09-d48c-4f1a-9710-81ae31b49795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:05:18.502924 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d9e09-d48c-4f1a-9710-81ae31b49795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:05:18.503219 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d9e09-d48c-4f1a-9710-81ae31b49795 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:05:18.503499 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d9e09-d48c-4f1a-9710-81ae31b49795 admin admin] PATH_INFO: `/v3/projects/cffc3cae7b014c62b9b58207cb7ef3aa` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:05:18.504742 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d9e09-d48c-4f1a-9710-81ae31b49795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cffc3cae7b014c62b9b58207cb7ef3aa)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:05:18.506902 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d9e09-d48c-4f1a-9710-81ae31b49795 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:05:18.635441 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:18.643748 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-707d9e09-d48c-4f1a-9710-81ae31b49795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'request_id': 'req-707d9e09-d48c-4f1a-9710-81ae31b49795'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:05:18.650109 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-707d9e09-d48c-4f1a-9710-81ae31b49795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'request_id': 'req-707d9e09-d48c-4f1a-9710-81ae31b49795'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:05:18.708627 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-707d9e09-d48c-4f1a-9710-81ae31b49795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cffc3cae7b014c62b9b58207cb7ef3aa', 'request_id': 'req-707d9e09-d48c-4f1a-9710-81ae31b49795'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:05:18.722274 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-707d9e09-d48c-4f1a-9710-81ae31b49795 admin admin] The token cache is being invalidate because project cffc3cae7b014c62b9b58207cb7ef3aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:05:18.722568 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-707d9e09-d48c-4f1a-9710-81ae31b49795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:05:18.723225 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-707d9e09-d48c-4f1a-9710-81ae31b49795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:05:18.725098 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1230/2460] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:05:18 2022] DELETE /identity/v3/projects/cffc3cae7b014c62b9b58207cb7ef3aa => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:05:18.728965 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5a06e-cc0b-4b1a-b81d-c807dc99df16 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:05:18.732502 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-aab5a06e-cc0b-4b1a-b81d-c807dc99df16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:05:18.750503 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5a06e-cc0b-4b1a-b81d-c807dc99df16 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:05:18.833049 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b395de1-8bcd-42ce-8b83-b086b4126c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:05:18.833938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b395de1-8bcd-42ce-8b83-b086b4126c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:05:18.834225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b395de1-8bcd-42ce-8b83-b086b4126c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:05:18.834507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b395de1-8bcd-42ce-8b83-b086b4126c94 admin admin] PATH_INFO: `/v3/users/d16f30a4de9d4b738d8ac1b8bf587e5f` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:05:18.835747 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b395de1-8bcd-42ce-8b83-b086b4126c94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d16f30a4de9d4b738d8ac1b8bf587e5f)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:05:18.837710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b395de1-8bcd-42ce-8b83-b086b4126c94 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:05:19.056536 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-4b395de1-8bcd-42ce-8b83-b086b4126c94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd16f30a4de9d4b738d8ac1b8bf587e5f'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:05:19.057757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-4b395de1-8bcd-42ce-8b83-b086b4126c94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd16f30a4de9d4b738d8ac1b8bf587e5f'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:05:19.078756 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-4b395de1-8bcd-42ce-8b83-b086b4126c94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd16f30a4de9d4b738d8ac1b8bf587e5f'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:05:19.091270 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-4b395de1-8bcd-42ce-8b83-b086b4126c94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd16f30a4de9d4b738d8ac1b8bf587e5f'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:05:19.092022 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-4b395de1-8bcd-42ce-8b83-b086b4126c94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd16f30a4de9d4b738d8ac1b8bf587e5f'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:05:19.172664 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1231/2461] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:05:18 2022] DELETE /identity/v3/users/d16f30a4de9d4b738d8ac1b8bf587e5f => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:05:19.420354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d9e09-d48c-4f1a-9710-81ae31b49795 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:05:19.421872 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-707d9e09-d48c-4f1a-9710-81ae31b49795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:05:19.458159 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d9e09-d48c-4f1a-9710-81ae31b49795 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:05:19.552093 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b55a4-624d-479a-8b91-6208f0a044a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:05:19.552572 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b55a4-624d-479a-8b91-6208f0a044a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:05:19.552999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b55a4-624d-479a-8b91-6208f0a044a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:05:19.553287 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b55a4-624d-479a-8b91-6208f0a044a1 admin admin] PATH_INFO: `/v3/projects/d1f02c2820eb4688829932f3177e9c3a` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:05:19.557031 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b55a4-624d-479a-8b91-6208f0a044a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1f02c2820eb4688829932f3177e9c3a)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:05:19.561524 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b55a4-624d-479a-8b91-6208f0a044a1 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:05:19.679446 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-4c8b55a4-624d-479a-8b91-6208f0a044a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1f02c2820eb4688829932f3177e9c3a', 'request_id': 'req-4c8b55a4-624d-479a-8b91-6208f0a044a1'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:05:19.689367 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-4c8b55a4-624d-479a-8b91-6208f0a044a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1f02c2820eb4688829932f3177e9c3a', 'request_id': 'req-4c8b55a4-624d-479a-8b91-6208f0a044a1'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:05:19.764388 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-4c8b55a4-624d-479a-8b91-6208f0a044a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1f02c2820eb4688829932f3177e9c3a', 'request_id': 'req-4c8b55a4-624d-479a-8b91-6208f0a044a1'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:05:19.775566 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-4c8b55a4-624d-479a-8b91-6208f0a044a1 admin admin] The token cache is being invalidate because project d1f02c2820eb4688829932f3177e9c3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:05:19.775858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-4c8b55a4-624d-479a-8b91-6208f0a044a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:05:19.776555 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-4c8b55a4-624d-479a-8b91-6208f0a044a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:05:19.778379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1231/2462] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:05:19 2022] DELETE /identity/v3/projects/d1f02c2820eb4688829932f3177e9c3a => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:05:29.168011 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=68,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:29.774240 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=61,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:38.895114 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b9255-02ba-44de-b447-f819325fa7db None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:05:38.895665 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b9255-02ba-44de-b447-f819325fa7db None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:05:38.895665 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b9255-02ba-44de-b447-f819325fa7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:05:38.915100 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-9b2b9255-02ba-44de-b447-f819325fa7db None None] MFA Rules not processed for user `56191d451ddf4fba953c27dd79484723`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:05:38.916455 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-9b2b9255-02ba-44de-b447-f819325fa7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:05:38.973086 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1232/2463] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:05:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:05:43.492377 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b55a4-624d-479a-8b91-6208f0a044a1 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:05:43.493946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-4c8b55a4-624d-479a-8b91-6208f0a044a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:05:43.555581 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b55a4-624d-479a-8b91-6208f0a044a1 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:05:43.559615 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea646117-ee03-4827-ac9a-17b5f096532b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:05:43.560327 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea646117-ee03-4827-ac9a-17b5f096532b service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:05:43.560617 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea646117-ee03-4827-ac9a-17b5f096532b service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:05:43.560900 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea646117-ee03-4827-ac9a-17b5f096532b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:05:43.562726 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-ea646117-ee03-4827-ac9a-17b5f096532b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:05:43.631542 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea646117-ee03-4827-ac9a-17b5f096532b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:05:43.633241 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea646117-ee03-4827-ac9a-17b5f096532b service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:05:43.643462 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1232/2464] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:05:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:05:48.965418 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=25 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:53.638790 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=50 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:29.168044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6623f-2379-44a8-a1bc-eba25d065b2a None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:06:29.168598 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6623f-2379-44a8-a1bc-eba25d065b2a None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:06:29.168686 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6623f-2379-44a8-a1bc-eba25d065b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:06:29.210726 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-b0a6623f-2379-44a8-a1bc-eba25d065b2a None None] MFA Rules not processed for user `b0d02887422a43e4bb69566a2d64e890`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:06:29.211954 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-b0a6623f-2379-44a8-a1bc-eba25d065b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:06:29.268295 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1233/2465] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:06:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:06:36.805602 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea646117-ee03-4827-ac9a-17b5f096532b service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:06:36.807103 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-ea646117-ee03-4827-ac9a-17b5f096532b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:06:36.818568 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea646117-ee03-4827-ac9a-17b5f096532b service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:06:36.822175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ccf63-7ba2-4941-917e-e36e61690002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:06:36.822858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ccf63-7ba2-4941-917e-e36e61690002 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:06:36.823158 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ccf63-7ba2-4941-917e-e36e61690002 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:06:36.823473 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ccf63-7ba2-4941-917e-e36e61690002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:06:36.825610 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b33ccf63-7ba2-4941-917e-e36e61690002 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:06:36.897606 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ccf63-7ba2-4941-917e-e36e61690002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:06:36.899032 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ccf63-7ba2-4941-917e-e36e61690002 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:06:36.915243 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1233/2466] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:06:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:06:39.261531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=34 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:46.906808 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=34 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:57.100191 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6623f-2379-44a8-a1bc-eba25d065b2a None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:06:57.101565 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-b0a6623f-2379-44a8-a1bc-eba25d065b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:06:57.162929 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6623f-2379-44a8-a1bc-eba25d065b2a None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:06:57.168412 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48095b01-4e84-4dcd-977d-c5653e69423e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b236c66c184d3ca40c2069dc316664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:06:57.171894 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48095b01-4e84-4dcd-977d-c5653e69423e service glance] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:06:57.172202 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48095b01-4e84-4dcd-977d-c5653e69423e service glance] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:06:57.172482 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48095b01-4e84-4dcd-977d-c5653e69423e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:06:57.174339 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-48095b01-4e84-4dcd-977d-c5653e69423e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:06:57.188050 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48095b01-4e84-4dcd-977d-c5653e69423e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:06:57.189540 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48095b01-4e84-4dcd-977d-c5653e69423e service glance] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:06:57.200333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1234/2467] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:06:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:07:07.195578 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=26 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:23.446142 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c568d-d9a3-4a9d-a19b-779d3f6f11eb None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:23.446673 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c568d-d9a3-4a9d-a19b-779d3f6f11eb None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:23.446783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c568d-d9a3-4a9d-a19b-779d3f6f11eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:23.500013 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-235c568d-d9a3-4a9d-a19b-779d3f6f11eb None None] MFA Rules not processed for user `4a1474b39e0b477daff5833491cd6df5`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:07:23.501271 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-235c568d-d9a3-4a9d-a19b-779d3f6f11eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:23.576347 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1234/2468] 10.222.0.119 () {58 vars in 1014 bytes} [Thu Jul 14 16:07:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:07:23.720719 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48095b01-4e84-4dcd-977d-c5653e69423e service glance] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:23.722134 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-48095b01-4e84-4dcd-977d-c5653e69423e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:23.817231 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48095b01-4e84-4dcd-977d-c5653e69423e service glance] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:23.828332 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670d921-b899-4e2b-9c3d-f358cfc6f62b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a5c169576e432c8174a562ae358e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:23.829006 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670d921-b899-4e2b-9c3d-f358cfc6f62b service swift] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:23.829296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670d921-b899-4e2b-9c3d-f358cfc6f62b service swift] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:23.829576 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670d921-b899-4e2b-9c3d-f358cfc6f62b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:23.838434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670d921-b899-4e2b-9c3d-f358cfc6f62b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:23.840025 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670d921-b899-4e2b-9c3d-f358cfc6f62b service swift] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:23.848766 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1235/2469] 10.222.0.119 () {60 vars in 1389 bytes} [Thu Jul 14 16:07:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 16:07:28.876403 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c568d-d9a3-4a9d-a19b-779d3f6f11eb None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:28.888857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c568d-d9a3-4a9d-a19b-779d3f6f11eb None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:28.892960 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ce402-415f-41fd-9b98-c386e17e45f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:28.893624 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ce402-415f-41fd-9b98-c386e17e45f0 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:28.895021 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ce402-415f-41fd-9b98-c386e17e45f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:28.895021 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ce402-415f-41fd-9b98-c386e17e45f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:28.896321 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-616ce402-415f-41fd-9b98-c386e17e45f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:28.908038 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ce402-415f-41fd-9b98-c386e17e45f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:28.909803 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ce402-415f-41fd-9b98-c386e17e45f0 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:28.920019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1235/2470] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:07:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:07:33.845464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=41 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:38.916823 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=46 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:40.603728 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670d921-b899-4e2b-9c3d-f358cfc6f62b service swift] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:40.605241 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-a670d921-b899-4e2b-9c3d-f358cfc6f62b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:40.622010 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670d921-b899-4e2b-9c3d-f358cfc6f62b service swift] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:40.631978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1f964-2074-4335-9fd8-05c59db1e449 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:40.631978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1f964-2074-4335-9fd8-05c59db1e449 service nova] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:40.631978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1f964-2074-4335-9fd8-05c59db1e449 service nova] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:40.631978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1f964-2074-4335-9fd8-05c59db1e449 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:40.632468 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-1ac1f964-2074-4335-9fd8-05c59db1e449 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:40.642704 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1f964-2074-4335-9fd8-05c59db1e449 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:40.644360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1f964-2074-4335-9fd8-05c59db1e449 service nova] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:40.655711 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1236/2471] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:07:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:07:42.911185 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ce402-415f-41fd-9b98-c386e17e45f0 service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:42.919900 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ce402-415f-41fd-9b98-c386e17e45f0 service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:42.923744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b71045-8b0d-4b5d-8149-96f151f6536c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:42.924448 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b71045-8b0d-4b5d-8149-96f151f6536c service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:42.924741 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b71045-8b0d-4b5d-8149-96f151f6536c service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:42.925025 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b71045-8b0d-4b5d-8149-96f151f6536c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:42.926824 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b5b71045-8b0d-4b5d-8149-96f151f6536c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:42.937359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b71045-8b0d-4b5d-8149-96f151f6536c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:42.938786 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b71045-8b0d-4b5d-8149-96f151f6536c service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:42.946982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1236/2472] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:07:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:07:43.331177 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c8a83-1587-4bef-87fa-9d78f5ae8245 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:43.333671 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c8a83-1587-4bef-87fa-9d78f5ae8245 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:43.333671 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c8a83-1587-4bef-87fa-9d78f5ae8245 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:43.333901 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1237/2473] 10.222.0.119 () {54 vars in 926 bytes} [Thu Jul 14 16:07:43 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 16:07:43.340149 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953a5fb-db9d-48e0-b6be-8f8ec992a21a None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:43.340450 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953a5fb-db9d-48e0-b6be-8f8ec992a21a None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:43.340730 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953a5fb-db9d-48e0-b6be-8f8ec992a21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:43.380323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-5953a5fb-db9d-48e0-b6be-8f8ec992a21a None None] MFA Rules not processed for user `a1e4c833a4684561ab52eda5734a7766`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:07:43.381562 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-5953a5fb-db9d-48e0-b6be-8f8ec992a21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:43.391506 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1237/2474] 10.222.0.119 () {58 vars in 1023 bytes} [Thu Jul 14 16:07:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:07:43.403171 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c8a83-1587-4bef-87fa-9d78f5ae8245 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:43.426977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c8a83-1587-4bef-87fa-9d78f5ae8245 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:43.430568 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6e61c-b8d4-4db7-9f7d-6e481a22de97 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b236c66c184d3ca40c2069dc316664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:43.436526 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6e61c-b8d4-4db7-9f7d-6e481a22de97 service glance] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:43.436526 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6e61c-b8d4-4db7-9f7d-6e481a22de97 service glance] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:43.436526 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6e61c-b8d4-4db7-9f7d-6e481a22de97 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:43.442505 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6e61c-b8d4-4db7-9f7d-6e481a22de97 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:43.443928 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6e61c-b8d4-4db7-9f7d-6e481a22de97 service glance] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:43.454772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1238/2475] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:07:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:07:43.700346 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46dba0-fb71-4472-bfa8-9a7e978aabcd None None] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:43.700836 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46dba0-fb71-4472-bfa8-9a7e978aabcd None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:43.701199 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46dba0-fb71-4472-bfa8-9a7e978aabcd None None] PATH_INFO: `/` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:43.702597 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1238/2476] 10.222.0.119 () {54 vars in 926 bytes} [Thu Jul 14 16:07:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 16:07:43.708180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a599e4-f391-4d98-8a9e-727ca4dbc8ea None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:43.708483 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a599e4-f391-4d98-8a9e-727ca4dbc8ea None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:43.708770 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a599e4-f391-4d98-8a9e-727ca4dbc8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:43.749089 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-56a599e4-f391-4d98-8a9e-727ca4dbc8ea None None] MFA Rules not processed for user `70559c2ce32043dd9a902837ab444622`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:07:43.750418 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-56a599e4-f391-4d98-8a9e-727ca4dbc8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:43.756997 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1239/2477] 10.222.0.119 () {58 vars in 1023 bytes} [Thu Jul 14 16:07:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:07:43.769176 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46dba0-fb71-4472-bfa8-9a7e978aabcd None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:43.781565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46dba0-fb71-4472-bfa8-9a7e978aabcd None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:43.785465 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39377ee-2cf6-45ee-a445-9509b7ed054c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:43.786126 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39377ee-2cf6-45ee-a445-9509b7ed054c service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:43.786421 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39377ee-2cf6-45ee-a445-9509b7ed054c service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:43.786708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39377ee-2cf6-45ee-a445-9509b7ed054c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:43.794721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39377ee-2cf6-45ee-a445-9509b7ed054c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:43.796186 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39377ee-2cf6-45ee-a445-9509b7ed054c service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:43.803970 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1239/2478] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:07:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:07:43.886390 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdb7bf-8b39-4abf-a5ef-5e5f21c04bc2 None None] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:43.886691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdb7bf-8b39-4abf-a5ef-5e5f21c04bc2 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:43.886976 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdb7bf-8b39-4abf-a5ef-5e5f21c04bc2 None None] PATH_INFO: `/` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:43.888910 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1240/2479] 10.222.0.119 () {54 vars in 926 bytes} [Thu Jul 14 16:07:43 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 14 16:07:43.894249 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c21c7-5113-4543-8d27-466ff7d29679 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:43.894580 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c21c7-5113-4543-8d27-466ff7d29679 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:43.894864 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c21c7-5113-4543-8d27-466ff7d29679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:43.917639 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-737c21c7-5113-4543-8d27-466ff7d29679 None None] MFA Rules not processed for user `a1e4c833a4684561ab52eda5734a7766`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:07:43.918879 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-737c21c7-5113-4543-8d27-466ff7d29679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:43.929102 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1240/2480] 10.222.0.119 () {58 vars in 1023 bytes} [Thu Jul 14 16:07:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:07:43.939666 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdb7bf-8b39-4abf-a5ef-5e5f21c04bc2 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:43.951506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdb7bf-8b39-4abf-a5ef-5e5f21c04bc2 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:43.955650 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516a5d8-d105-4c74-8464-0e544c6f143e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:43.956330 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516a5d8-d105-4c74-8464-0e544c6f143e service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:43.956620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516a5d8-d105-4c74-8464-0e544c6f143e service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:43.956901 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516a5d8-d105-4c74-8464-0e544c6f143e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:43.967934 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516a5d8-d105-4c74-8464-0e544c6f143e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:43.969939 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516a5d8-d105-4c74-8464-0e544c6f143e service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:43.989398 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1241/2481] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:07:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:07:44.065204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c21c7-5113-4543-8d27-466ff7d29679 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:44.066588 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-737c21c7-5113-4543-8d27-466ff7d29679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:44.133543 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c21c7-5113-4543-8d27-466ff7d29679 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:44.138541 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33513490-79f3-4b75-9226-20a05730f8f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716cbbfeede34885b0411e5b9b25df47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:44.139309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33513490-79f3-4b75-9226-20a05730f8f6 service placement] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:44.147438 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33513490-79f3-4b75-9226-20a05730f8f6 service placement] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:44.147438 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33513490-79f3-4b75-9226-20a05730f8f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:44.147438 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-33513490-79f3-4b75-9226-20a05730f8f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:44.154527 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33513490-79f3-4b75-9226-20a05730f8f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:44.157291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33513490-79f3-4b75-9226-20a05730f8f6 service placement] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:44.167779 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1241/2482] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:07:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:07:48.684582 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499ce81-bf17-43af-99c0-56bf3289c1f4 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:48.686246 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499ce81-bf17-43af-99c0-56bf3289c1f4 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:48.686246 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499ce81-bf17-43af-99c0-56bf3289c1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:48.704458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-f499ce81-bf17-43af-99c0-56bf3289c1f4 None None] MFA Rules not processed for user `4a1474b39e0b477daff5833491cd6df5`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:07:48.705690 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f499ce81-bf17-43af-99c0-56bf3289c1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:48.712977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1242/2483] 10.222.0.119 () {58 vars in 1014 bytes} [Thu Jul 14 16:07:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:07:48.725676 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33513490-79f3-4b75-9226-20a05730f8f6 service placement] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:48.737526 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33513490-79f3-4b75-9226-20a05730f8f6 service placement] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:48.742593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477797e-f1bb-496b-bfb7-8ba377647627 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a5c169576e432c8174a562ae358e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:48.743267 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477797e-f1bb-496b-bfb7-8ba377647627 service swift] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:48.743555 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477797e-f1bb-496b-bfb7-8ba377647627 service swift] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:48.743837 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477797e-f1bb-496b-bfb7-8ba377647627 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:48.753354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477797e-f1bb-496b-bfb7-8ba377647627 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:48.754956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477797e-f1bb-496b-bfb7-8ba377647627 service swift] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:48.764822 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1242/2484] 10.222.0.119 () {60 vars in 1389 bytes} [Thu Jul 14 16:07:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 16:07:53.321669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499ce81-bf17-43af-99c0-56bf3289c1f4 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:53.331755 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499ce81-bf17-43af-99c0-56bf3289c1f4 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:53.335465 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc8067-f145-4954-9385-85cc0c656a8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:53.336373 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc8067-f145-4954-9385-85cc0c656a8a service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:53.336852 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc8067-f145-4954-9385-85cc0c656a8a service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:53.337316 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc8067-f145-4954-9385-85cc0c656a8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:53.339170 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f3dc8067-f145-4954-9385-85cc0c656a8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:53.414008 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc8067-f145-4954-9385-85cc0c656a8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:53.415744 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc8067-f145-4954-9385-85cc0c656a8a service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:53.427785 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1243/2485] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:07:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:07:58.029174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477797e-f1bb-496b-bfb7-8ba377647627 service swift] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:58.029174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-8477797e-f1bb-496b-bfb7-8ba377647627 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:58.051156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477797e-f1bb-496b-bfb7-8ba377647627 service swift] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:58.057791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01190f6a-fdcc-455b-a06f-9c1c1fe2df2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:58.059189 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01190f6a-fdcc-455b-a06f-9c1c1fe2df2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:58.059704 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01190f6a-fdcc-455b-a06f-9c1c1fe2df2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:58.061514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01190f6a-fdcc-455b-a06f-9c1c1fe2df2b admin admin] PATH_INFO: `/v3/users/6bbbf243c1334013ac235aa5b0853621` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:58.082773 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01190f6a-fdcc-455b-a06f-9c1c1fe2df2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bbbf243c1334013ac235aa5b0853621)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:58.085839 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01190f6a-fdcc-455b-a06f-9c1c1fe2df2b admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:58.463312 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-01190f6a-fdcc-455b-a06f-9c1c1fe2df2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bbbf243c1334013ac235aa5b0853621'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:58.476234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-01190f6a-fdcc-455b-a06f-9c1c1fe2df2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bbbf243c1334013ac235aa5b0853621'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:58.478343 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:58.490598 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-01190f6a-fdcc-455b-a06f-9c1c1fe2df2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bbbf243c1334013ac235aa5b0853621'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:58.491417 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-01190f6a-fdcc-455b-a06f-9c1c1fe2df2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bbbf243c1334013ac235aa5b0853621'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:58.601399 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-01190f6a-fdcc-455b-a06f-9c1c1fe2df2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bbbf243c1334013ac235aa5b0853621'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:58.608021 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1243/2486] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:07:58 2022] DELETE /identity/v3/users/6bbbf243c1334013ac235aa5b0853621 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:07:58.889296 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc8067-f145-4954-9385-85cc0c656a8a service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:58.899951 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc8067-f145-4954-9385-85cc0c656a8a service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:58.962803 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55720733-7deb-492a-ac53-4b5716cc226b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:58.963700 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55720733-7deb-492a-ac53-4b5716cc226b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:58.963991 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55720733-7deb-492a-ac53-4b5716cc226b admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:58.964307 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55720733-7deb-492a-ac53-4b5716cc226b admin admin] PATH_INFO: `/v3/projects/550bd9d36a324331a157f3cd2de42ca3` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:58.975935 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55720733-7deb-492a-ac53-4b5716cc226b admin admin] RBAC: Authorizing `identity:delete_project(project_id=550bd9d36a324331a157f3cd2de42ca3)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:58.977930 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55720733-7deb-492a-ac53-4b5716cc226b admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:58.989197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:59.070344 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-55720733-7deb-492a-ac53-4b5716cc226b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '550bd9d36a324331a157f3cd2de42ca3', 'request_id': 'req-55720733-7deb-492a-ac53-4b5716cc226b'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:59.079367 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-55720733-7deb-492a-ac53-4b5716cc226b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '550bd9d36a324331a157f3cd2de42ca3', 'request_id': 'req-55720733-7deb-492a-ac53-4b5716cc226b'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:59.085155 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-55720733-7deb-492a-ac53-4b5716cc226b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '550bd9d36a324331a157f3cd2de42ca3', 'request_id': 'req-55720733-7deb-492a-ac53-4b5716cc226b'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:59.165113 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-55720733-7deb-492a-ac53-4b5716cc226b admin admin] The token cache is being invalidate because project 550bd9d36a324331a157f3cd2de42ca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:07:59.165325 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-55720733-7deb-492a-ac53-4b5716cc226b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:59.165984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-55720733-7deb-492a-ac53-4b5716cc226b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:59.167580 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1244/2487] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:07:58 2022] DELETE /identity/v3/projects/550bd9d36a324331a157f3cd2de42ca3 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:07:59.172902 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ee877-306d-4961-8e3b-cb347b89a4d2 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:59.177040 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ee877-306d-4961-8e3b-cb347b89a4d2 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:59.177040 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ee877-306d-4961-8e3b-cb347b89a4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:59.191863 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-e33ee877-306d-4961-8e3b-cb347b89a4d2 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:07:59.193121 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-e33ee877-306d-4961-8e3b-cb347b89a4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:59.253724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1244/2488] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:07:59.261451 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80d32c-8e95-4337-8f5f-0e4f6da973fb None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:59.261744 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80d32c-8e95-4337-8f5f-0e4f6da973fb None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:59.262028 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80d32c-8e95-4337-8f5f-0e4f6da973fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:59.280059 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-db80d32c-8e95-4337-8f5f-0e4f6da973fb None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:07:59.281324 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-db80d32c-8e95-4337-8f5f-0e4f6da973fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:59.289524 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1245/2489] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:07:59.293607 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ee877-306d-4961-8e3b-cb347b89a4d2 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:59.303504 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ee877-306d-4961-8e3b-cb347b89a4d2 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:59.308055 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b2ede-3496-466e-93af-3a564d73eb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:59.308773 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b2ede-3496-466e-93af-3a564d73eb31 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:59.309060 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b2ede-3496-466e-93af-3a564d73eb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:59.309342 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b2ede-3496-466e-93af-3a564d73eb31 admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:59.310593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b2ede-3496-466e-93af-3a564d73eb31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:07:59.310979 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b2ede-3496-466e-93af-3a564d73eb31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:59.312630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b2ede-3496-466e-93af-3a564d73eb31 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:59.324464 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1245/2490] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 16:07:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 16:07:59.329385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80d32c-8e95-4337-8f5f-0e4f6da973fb None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:59.338757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80d32c-8e95-4337-8f5f-0e4f6da973fb None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:59.344329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fe5c4-12a5-477c-abee-64b74f761f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:59.345060 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fe5c4-12a5-477c-abee-64b74f761f51 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:59.345354 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fe5c4-12a5-477c-abee-64b74f761f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:59.345637 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fe5c4-12a5-477c-abee-64b74f761f51 admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:59.346465 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fe5c4-12a5-477c-abee-64b74f761f51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:59.348312 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fe5c4-12a5-477c-abee-64b74f761f51 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:59.505540 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1246/2491] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:07:59 2022] POST /identity/v3/projects => generated 374 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:07:59.517888 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b2ede-3496-466e-93af-3a564d73eb31 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:59.528269 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b2ede-3496-466e-93af-3a564d73eb31 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:59.585169 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f170c76-71de-4212-ba3e-5c74dd2339cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:59.585844 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f170c76-71de-4212-ba3e-5c74dd2339cf admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:59.586133 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f170c76-71de-4212-ba3e-5c74dd2339cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:59.586415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f170c76-71de-4212-ba3e-5c74dd2339cf admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:59.587108 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f170c76-71de-4212-ba3e-5c74dd2339cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:59.589076 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f170c76-71de-4212-ba3e-5c74dd2339cf admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:59.704920 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1246/2492] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:07:59 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:07:59.709201 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fe5c4-12a5-477c-abee-64b74f761f51 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:59.721229 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fe5c4-12a5-477c-abee-64b74f761f51 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:59.725915 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8fc0b-6d06-4b36-9329-f9a0d86da954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:59.726588 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8fc0b-6d06-4b36-9329-f9a0d86da954 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:59.726881 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8fc0b-6d06-4b36-9329-f9a0d86da954 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:59.727166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8fc0b-6d06-4b36-9329-f9a0d86da954 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:59.727901 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8fc0b-6d06-4b36-9329-f9a0d86da954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:59.729563 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8fc0b-6d06-4b36-9329-f9a0d86da954 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:59.740019 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1247/2493] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:07:59 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:07:59.744023 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f170c76-71de-4212-ba3e-5c74dd2339cf admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:59.754484 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f170c76-71de-4212-ba3e-5c74dd2339cf admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:59.759216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789453c-9878-4d70-ae24-367e5da1b211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:59.759886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789453c-9878-4d70-ae24-367e5da1b211 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:59.760256 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789453c-9878-4d70-ae24-367e5da1b211 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:59.760546 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789453c-9878-4d70-ae24-367e5da1b211 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:59.761281 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789453c-9878-4d70-ae24-367e5da1b211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:59.762894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789453c-9878-4d70-ae24-367e5da1b211 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:59.774176 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1247/2494] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:07:59 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:07:59.778269 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8fc0b-6d06-4b36-9329-f9a0d86da954 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:59.789274 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8fc0b-6d06-4b36-9329-f9a0d86da954 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:59.793934 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f9de8-7430-4dfc-84f3-4eea0add1f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:59.794903 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f9de8-7430-4dfc-84f3-4eea0add1f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:59.795192 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f9de8-7430-4dfc-84f3-4eea0add1f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:59.795473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f9de8-7430-4dfc-84f3-4eea0add1f45 admin admin] PATH_INFO: `/v3/projects/7938bf23083846c2a3c51dd5184d6747/users/c71382751acf4cefaed60144b84894a2/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:59.810425 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f9de8-7430-4dfc-84f3-4eea0add1f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7938bf23083846c2a3c51dd5184d6747, user_id=c71382751acf4cefaed60144b84894a2, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:59.813182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f9de8-7430-4dfc-84f3-4eea0add1f45 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:59.898281 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1248/2495] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:07:59 2022] PUT /identity/v3/projects/7938bf23083846c2a3c51dd5184d6747/users/c71382751acf4cefaed60144b84894a2/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:07:59.909511 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad3f4b-ad28-42c2-9ab4-335398aa784d None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:59.910814 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad3f4b-ad28-42c2-9ab4-335398aa784d None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:59.910814 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad3f4b-ad28-42c2-9ab4-335398aa784d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:59.937728 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-3cad3f4b-ad28-42c2-9ab4-335398aa784d None None] MFA Rules not processed for user `c71382751acf4cefaed60144b84894a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:07:59.938943 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-3cad3f4b-ad28-42c2-9ab4-335398aa784d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:59.979480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:00.010286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1248/2496] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:07:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:08:00.022160 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f9de8-7430-4dfc-84f3-4eea0add1f45 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:00.024092 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-671f9de8-7430-4dfc-84f3-4eea0add1f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:00.102964 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f9de8-7430-4dfc-84f3-4eea0add1f45 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:00.109173 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b31dc-a50b-4647-be73-0b701dfa67a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:00.109826 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b31dc-a50b-4647-be73-0b701dfa67a8 service nova] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:00.110123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b31dc-a50b-4647-be73-0b701dfa67a8 service nova] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:00.110411 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b31dc-a50b-4647-be73-0b701dfa67a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:00.118415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b31dc-a50b-4647-be73-0b701dfa67a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:00.120016 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b31dc-a50b-4647-be73-0b701dfa67a8 service nova] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:00.129978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1249/2497] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:08:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:08:05.418784 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad3f4b-ad28-42c2-9ab4-335398aa784d None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:05.483427 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad3f4b-ad28-42c2-9ab4-335398aa784d None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:05.488250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c519f32-b613-428d-ad81-44ac64159f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:05.489139 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c519f32-b613-428d-ad81-44ac64159f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:05.489424 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c519f32-b613-428d-ad81-44ac64159f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:05.489701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c519f32-b613-428d-ad81-44ac64159f34 admin admin] PATH_INFO: `/v3/users/c71382751acf4cefaed60144b84894a2` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:05.490900 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c519f32-b613-428d-ad81-44ac64159f34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c71382751acf4cefaed60144b84894a2)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:05.492993 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c519f32-b613-428d-ad81-44ac64159f34 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:05.690310 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-0c519f32-b613-428d-ad81-44ac64159f34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c71382751acf4cefaed60144b84894a2'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:05.702831 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-0c519f32-b613-428d-ad81-44ac64159f34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c71382751acf4cefaed60144b84894a2'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:05.709874 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-0c519f32-b613-428d-ad81-44ac64159f34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c71382751acf4cefaed60144b84894a2'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:05.710545 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-0c519f32-b613-428d-ad81-44ac64159f34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c71382751acf4cefaed60144b84894a2'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:05.796392 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-0c519f32-b613-428d-ad81-44ac64159f34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c71382751acf4cefaed60144b84894a2'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:05.803021 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1249/2498] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:08:05 2022] DELETE /identity/v3/users/c71382751acf4cefaed60144b84894a2 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:08:05.807823 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c51685-62bc-47ca-9f19-210b4cbd2a5c None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:05.808339 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c51685-62bc-47ca-9f19-210b4cbd2a5c None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:05.808437 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c51685-62bc-47ca-9f19-210b4cbd2a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:05.828288 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-b0c51685-62bc-47ca-9f19-210b4cbd2a5c None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:05.829546 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-b0c51685-62bc-47ca-9f19-210b4cbd2a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:05.838699 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:05.895323 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1250/2499] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:08:05.906548 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c519f32-b613-428d-ad81-44ac64159f34 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:05.907967 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-0c519f32-b613-428d-ad81-44ac64159f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:05.968981 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c519f32-b613-428d-ad81-44ac64159f34 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:05.972794 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf2ec3-6617-48c8-9f06-4f681b57c9c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:05.973460 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf2ec3-6617-48c8-9f06-4f681b57c9c0 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:05.973740 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf2ec3-6617-48c8-9f06-4f681b57c9c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:05.974022 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf2ec3-6617-48c8-9f06-4f681b57c9c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:05.984060 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf2ec3-6617-48c8-9f06-4f681b57c9c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:05.985509 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf2ec3-6617-48c8-9f06-4f681b57c9c0 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:05.995060 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1250/2500] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:08:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:08:06.391906 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c51685-62bc-47ca-9f19-210b4cbd2a5c None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:06.393490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-b0c51685-62bc-47ca-9f19-210b4cbd2a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:06.406563 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c51685-62bc-47ca-9f19-210b4cbd2a5c None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:06.411170 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d1c52-2712-43f7-b022-d4d0be244db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:06.412316 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d1c52-2712-43f7-b022-d4d0be244db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:06.412607 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d1c52-2712-43f7-b022-d4d0be244db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:06.412889 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d1c52-2712-43f7-b022-d4d0be244db4 admin admin] PATH_INFO: `/v3/projects/7938bf23083846c2a3c51dd5184d6747` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:06.414108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d1c52-2712-43f7-b022-d4d0be244db4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7938bf23083846c2a3c51dd5184d6747)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:06.416064 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d1c52-2712-43f7-b022-d4d0be244db4 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:06.540077 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-995d1c52-2712-43f7-b022-d4d0be244db4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7938bf23083846c2a3c51dd5184d6747', 'request_id': 'req-995d1c52-2712-43f7-b022-d4d0be244db4'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:06.546749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-995d1c52-2712-43f7-b022-d4d0be244db4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7938bf23083846c2a3c51dd5184d6747', 'request_id': 'req-995d1c52-2712-43f7-b022-d4d0be244db4'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:06.552608 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-995d1c52-2712-43f7-b022-d4d0be244db4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7938bf23083846c2a3c51dd5184d6747', 'request_id': 'req-995d1c52-2712-43f7-b022-d4d0be244db4'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:06.612565 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-995d1c52-2712-43f7-b022-d4d0be244db4 admin admin] The token cache is being invalidate because project 7938bf23083846c2a3c51dd5184d6747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:08:06.612892 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-995d1c52-2712-43f7-b022-d4d0be244db4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:06.613507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-995d1c52-2712-43f7-b022-d4d0be244db4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:06.615038 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1251/2501] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:08:06 2022] DELETE /identity/v3/projects/7938bf23083846c2a3c51dd5184d6747 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:08:06.620073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a976f-58df-4de2-85ea-342b547ce2ae None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:06.620603 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a976f-58df-4de2-85ea-342b547ce2ae None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:06.620712 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a976f-58df-4de2-85ea-342b547ce2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:06.627548 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:06.640394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-299a976f-58df-4de2-85ea-342b547ce2ae None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:06.641564 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-299a976f-58df-4de2-85ea-342b547ce2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:06.702021 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1251/2502] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:08:06.710656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c3cfe-e2c6-44d9-a27c-d1d83332605d None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:06.710957 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c3cfe-e2c6-44d9-a27c-d1d83332605d None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:06.713478 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c3cfe-e2c6-44d9-a27c-d1d83332605d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:06.730588 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-5f4c3cfe-e2c6-44d9-a27c-d1d83332605d None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:06.731832 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-5f4c3cfe-e2c6-44d9-a27c-d1d83332605d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:06.740531 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1252/2503] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:08:06.744786 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a976f-58df-4de2-85ea-342b547ce2ae None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:06.755472 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a976f-58df-4de2-85ea-342b547ce2ae None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:06.760039 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19752516-cfaa-43ed-a4e5-1142a6d5bd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:06.760722 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19752516-cfaa-43ed-a4e5-1142a6d5bd94 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:06.761012 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19752516-cfaa-43ed-a4e5-1142a6d5bd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:06.761296 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19752516-cfaa-43ed-a4e5-1142a6d5bd94 admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:06.762035 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19752516-cfaa-43ed-a4e5-1142a6d5bd94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:08:06.762349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19752516-cfaa-43ed-a4e5-1142a6d5bd94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:06.765075 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19752516-cfaa-43ed-a4e5-1142a6d5bd94 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:06.776559 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1252/2504] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 16:08:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:08:06.781156 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c3cfe-e2c6-44d9-a27c-d1d83332605d None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:06.791200 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c3cfe-e2c6-44d9-a27c-d1d83332605d None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:06.796389 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973b7d6-1ccf-4748-a29f-275414c3b8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:06.797091 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973b7d6-1ccf-4748-a29f-275414c3b8fa admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:06.797377 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973b7d6-1ccf-4748-a29f-275414c3b8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:06.797655 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973b7d6-1ccf-4748-a29f-275414c3b8fa admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:06.798403 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973b7d6-1ccf-4748-a29f-275414c3b8fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:06.800652 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973b7d6-1ccf-4748-a29f-275414c3b8fa admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:06.883541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1253/2505] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:08:06 2022] POST /identity/v3/projects => generated 368 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:08:06.887487 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19752516-cfaa-43ed-a4e5-1142a6d5bd94 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:06.898296 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19752516-cfaa-43ed-a4e5-1142a6d5bd94 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:06.955661 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de8f1e-50d8-45e8-a38f-683a9be3541d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:06.956373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de8f1e-50d8-45e8-a38f-683a9be3541d admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:06.956665 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de8f1e-50d8-45e8-a38f-683a9be3541d admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:06.956951 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de8f1e-50d8-45e8-a38f-683a9be3541d admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:06.957647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de8f1e-50d8-45e8-a38f-683a9be3541d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:06.959551 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de8f1e-50d8-45e8-a38f-683a9be3541d admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:07.065331 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1253/2506] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:08:06 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:08:07.069257 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973b7d6-1ccf-4748-a29f-275414c3b8fa admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:07.079839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973b7d6-1ccf-4748-a29f-275414c3b8fa admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:07.084494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad56894-ef91-427c-acfc-e3d8f89b2c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:07.085155 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad56894-ef91-427c-acfc-e3d8f89b2c0e admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:07.085447 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad56894-ef91-427c-acfc-e3d8f89b2c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:07.085769 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad56894-ef91-427c-acfc-e3d8f89b2c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:07.086517 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad56894-ef91-427c-acfc-e3d8f89b2c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:07.088170 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad56894-ef91-427c-acfc-e3d8f89b2c0e admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:07.099136 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1254/2507] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:08:07 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:08:07.103181 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de8f1e-50d8-45e8-a38f-683a9be3541d admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:07.113724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de8f1e-50d8-45e8-a38f-683a9be3541d admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:07.118335 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0fd9f-d3e7-4a6b-b344-3a2e2d0acc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:07.118991 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0fd9f-d3e7-4a6b-b344-3a2e2d0acc5a admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:07.119274 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0fd9f-d3e7-4a6b-b344-3a2e2d0acc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:07.119551 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0fd9f-d3e7-4a6b-b344-3a2e2d0acc5a admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:07.120312 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0fd9f-d3e7-4a6b-b344-3a2e2d0acc5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:07.121930 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0fd9f-d3e7-4a6b-b344-3a2e2d0acc5a admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:07.132333 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1254/2508] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:08:07 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:08:07.136397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad56894-ef91-427c-acfc-e3d8f89b2c0e admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:07.146680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad56894-ef91-427c-acfc-e3d8f89b2c0e admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:07.151311 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b063cea-0667-445d-a3a9-b97b0eb1d21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:07.152176 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b063cea-0667-445d-a3a9-b97b0eb1d21b admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:07.152464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b063cea-0667-445d-a3a9-b97b0eb1d21b admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:07.152739 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b063cea-0667-445d-a3a9-b97b0eb1d21b admin admin] PATH_INFO: `/v3/projects/bcd31926555648fdbe6a4407eba3440b/users/0d855087c47b4d089eb8933a1aa9bc59/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:07.167255 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b063cea-0667-445d-a3a9-b97b0eb1d21b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcd31926555648fdbe6a4407eba3440b, user_id=0d855087c47b4d089eb8933a1aa9bc59, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:07.170586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b063cea-0667-445d-a3a9-b97b0eb1d21b admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:07.281378 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1255/2509] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:08:07 2022] PUT /identity/v3/projects/bcd31926555648fdbe6a4407eba3440b/users/0d855087c47b4d089eb8933a1aa9bc59/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:08:07.292408 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce826045-6e6a-4cb0-a0bf-781cadd96bca None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:07.292710 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce826045-6e6a-4cb0-a0bf-781cadd96bca None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:07.293002 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce826045-6e6a-4cb0-a0bf-781cadd96bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:07.321285 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-ce826045-6e6a-4cb0-a0bf-781cadd96bca None None] MFA Rules not processed for user `0d855087c47b4d089eb8933a1aa9bc59`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:07.322506 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-ce826045-6e6a-4cb0-a0bf-781cadd96bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:07.381320 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:07.386442 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1255/2510] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:08:07.397481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b063cea-0667-445d-a3a9-b97b0eb1d21b admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:07.399168 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-8b063cea-0667-445d-a3a9-b97b0eb1d21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:07.441411 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:07.483481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b063cea-0667-445d-a3a9-b97b0eb1d21b admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:07.487345 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408121c-6d23-4061-a8f4-f8bcbadca1a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:07.488002 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408121c-6d23-4061-a8f4-f8bcbadca1a1 service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:07.488341 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408121c-6d23-4061-a8f4-f8bcbadca1a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:07.488629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408121c-6d23-4061-a8f4-f8bcbadca1a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:07.497195 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408121c-6d23-4061-a8f4-f8bcbadca1a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:07.499177 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408121c-6d23-4061-a8f4-f8bcbadca1a1 service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:07.508451 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1256/2511] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:08:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:08:15.899651 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b6d35-6d8c-4357-9ead-223658bd43f0 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:15.900897 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b6d35-6d8c-4357-9ead-223658bd43f0 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:15.900897 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b6d35-6d8c-4357-9ead-223658bd43f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:15.920556 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-494b6d35-6d8c-4357-9ead-223658bd43f0 None None] MFA Rules not processed for user `4a1474b39e0b477daff5833491cd6df5`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:15.921787 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-494b6d35-6d8c-4357-9ead-223658bd43f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:15.980720 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1256/2512] 10.222.0.119 () {58 vars in 972 bytes} [Thu Jul 14 16:08:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:08:15.993518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408121c-6d23-4061-a8f4-f8bcbadca1a1 service cinder] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:15.994989 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-2408121c-6d23-4061-a8f4-f8bcbadca1a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:16.069233 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408121c-6d23-4061-a8f4-f8bcbadca1a1 service cinder] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:16.074751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e27c42-8ca6-4a74-856e-9ce41f9034d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a5c169576e432c8174a562ae358e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:16.075597 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e27c42-8ca6-4a74-856e-9ce41f9034d2 service swift] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:16.076495 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e27c42-8ca6-4a74-856e-9ce41f9034d2 service swift] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:16.076936 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e27c42-8ca6-4a74-856e-9ce41f9034d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:16.085396 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e27c42-8ca6-4a74-856e-9ce41f9034d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:16.087039 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e27c42-8ca6-4a74-856e-9ce41f9034d2 service swift] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:16.096080 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1257/2513] 10.222.0.119 () {60 vars in 1389 bytes} [Thu Jul 14 16:08:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 16:08:18.007473 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b6d35-6d8c-4357-9ead-223658bd43f0 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:18.017380 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b6d35-6d8c-4357-9ead-223658bd43f0 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:18.021558 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e15dc2-0940-4d8b-b3cb-142dec014721 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:18.022268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e15dc2-0940-4d8b-b3cb-142dec014721 service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:18.022611 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e15dc2-0940-4d8b-b3cb-142dec014721 service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:18.022917 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e15dc2-0940-4d8b-b3cb-142dec014721 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:18.024717 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-c3e15dc2-0940-4d8b-b3cb-142dec014721 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:18.114778 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e15dc2-0940-4d8b-b3cb-142dec014721 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:18.116820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e15dc2-0940-4d8b-b3cb-142dec014721 service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:18.126469 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1257/2514] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:08:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:08:18.556156 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e27c42-8ca6-4a74-856e-9ce41f9034d2 service swift] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:18.624567 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e27c42-8ca6-4a74-856e-9ce41f9034d2 service swift] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:18.628623 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7740d340-eeaf-4dbc-af9f-6fd0341daf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:18.632675 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740d340-eeaf-4dbc-af9f-6fd0341daf2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:18.632675 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740d340-eeaf-4dbc-af9f-6fd0341daf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:18.632675 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740d340-eeaf-4dbc-af9f-6fd0341daf2f admin admin] PATH_INFO: `/v3/users/0d855087c47b4d089eb8933a1aa9bc59` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:18.632675 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7740d340-eeaf-4dbc-af9f-6fd0341daf2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d855087c47b4d089eb8933a1aa9bc59)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:18.633210 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7740d340-eeaf-4dbc-af9f-6fd0341daf2f admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:18.839616 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7740d340-eeaf-4dbc-af9f-6fd0341daf2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d855087c47b4d089eb8933a1aa9bc59'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:18.840419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7740d340-eeaf-4dbc-af9f-6fd0341daf2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d855087c47b4d089eb8933a1aa9bc59'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:18.841623 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:18.854104 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7740d340-eeaf-4dbc-af9f-6fd0341daf2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d855087c47b4d089eb8933a1aa9bc59'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:18.861586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7740d340-eeaf-4dbc-af9f-6fd0341daf2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d855087c47b4d089eb8933a1aa9bc59'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:18.862301 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7740d340-eeaf-4dbc-af9f-6fd0341daf2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d855087c47b4d089eb8933a1aa9bc59'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:18.961633 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1258/2515] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:08:18 2022] DELETE /identity/v3/users/0d855087c47b4d089eb8933a1aa9bc59 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:08:18.966492 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab8342-5aab-44cc-9805-904de712d812 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:18.966700 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab8342-5aab-44cc-9805-904de712d812 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:18.966987 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab8342-5aab-44cc-9805-904de712d812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:18.994211 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-22ab8342-5aab-44cc-9805-904de712d812 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:18.995404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-22ab8342-5aab-44cc-9805-904de712d812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:19.053658 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1258/2516] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:08:19.063996 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7740d340-eeaf-4dbc-af9f-6fd0341daf2f admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:19.065491 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-7740d340-eeaf-4dbc-af9f-6fd0341daf2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:19.124960 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7740d340-eeaf-4dbc-af9f-6fd0341daf2f admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:19.128608 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63508c-41d2-4abc-bca9-9327d73bf478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:19.129285 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63508c-41d2-4abc-bca9-9327d73bf478 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:19.129570 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63508c-41d2-4abc-bca9-9327d73bf478 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:19.129848 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63508c-41d2-4abc-bca9-9327d73bf478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:19.138896 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63508c-41d2-4abc-bca9-9327d73bf478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:19.140365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63508c-41d2-4abc-bca9-9327d73bf478 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:19.149795 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1259/2517] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:08:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:08:19.625939 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab8342-5aab-44cc-9805-904de712d812 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:19.627517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-22ab8342-5aab-44cc-9805-904de712d812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:19.643244 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab8342-5aab-44cc-9805-904de712d812 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:19.648435 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f3001-b32e-45d9-8e65-0222a841ecce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:19.649313 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f3001-b32e-45d9-8e65-0222a841ecce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:19.649593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f3001-b32e-45d9-8e65-0222a841ecce admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:19.649870 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f3001-b32e-45d9-8e65-0222a841ecce admin admin] PATH_INFO: `/v3/projects/bcd31926555648fdbe6a4407eba3440b` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:19.651975 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f3001-b32e-45d9-8e65-0222a841ecce admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcd31926555648fdbe6a4407eba3440b)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:19.654950 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f3001-b32e-45d9-8e65-0222a841ecce admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:19.776053 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:19.785311 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-8e2f3001-b32e-45d9-8e65-0222a841ecce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcd31926555648fdbe6a4407eba3440b', 'request_id': 'req-8e2f3001-b32e-45d9-8e65-0222a841ecce'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:19.791706 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-8e2f3001-b32e-45d9-8e65-0222a841ecce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcd31926555648fdbe6a4407eba3440b', 'request_id': 'req-8e2f3001-b32e-45d9-8e65-0222a841ecce'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:19.858659 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-8e2f3001-b32e-45d9-8e65-0222a841ecce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcd31926555648fdbe6a4407eba3440b', 'request_id': 'req-8e2f3001-b32e-45d9-8e65-0222a841ecce'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:19.869320 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-8e2f3001-b32e-45d9-8e65-0222a841ecce admin admin] The token cache is being invalidate because project bcd31926555648fdbe6a4407eba3440b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:08:19.869815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-8e2f3001-b32e-45d9-8e65-0222a841ecce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:19.870942 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-8e2f3001-b32e-45d9-8e65-0222a841ecce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:19.874017 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1259/2518] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:08:19 2022] DELETE /identity/v3/projects/bcd31926555648fdbe6a4407eba3440b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:08:19.878097 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061a3f3-8af3-4c16-b269-a03b9e164ac4 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:19.878541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061a3f3-8af3-4c16-b269-a03b9e164ac4 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:19.878712 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061a3f3-8af3-4c16-b269-a03b9e164ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:19.897677 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-9061a3f3-8af3-4c16-b269-a03b9e164ac4 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:19.899041 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-9061a3f3-8af3-4c16-b269-a03b9e164ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:19.963607 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1260/2519] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:08:19.972810 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0c9d2-7c43-40c6-96a0-652945b94d69 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:19.973101 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0c9d2-7c43-40c6-96a0-652945b94d69 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:19.973380 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0c9d2-7c43-40c6-96a0-652945b94d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:19.992356 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-a0a0c9d2-7c43-40c6-96a0-652945b94d69 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:19.993610 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-a0a0c9d2-7c43-40c6-96a0-652945b94d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:20.002397 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1260/2520] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:08:20.014599 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061a3f3-8af3-4c16-b269-a03b9e164ac4 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:20.026676 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061a3f3-8af3-4c16-b269-a03b9e164ac4 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:20.033656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab9592-94f8-42f6-8f9a-cce1c28510b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:20.034335 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab9592-94f8-42f6-8f9a-cce1c28510b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:20.034631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab9592-94f8-42f6-8f9a-cce1c28510b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:20.034918 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab9592-94f8-42f6-8f9a-cce1c28510b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:20.035669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab9592-94f8-42f6-8f9a-cce1c28510b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:08:20.035987 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab9592-94f8-42f6-8f9a-cce1c28510b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:20.037635 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab9592-94f8-42f6-8f9a-cce1c28510b7 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:20.050524 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1261/2521] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 16:08:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:08:20.055039 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0c9d2-7c43-40c6-96a0-652945b94d69 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:20.064786 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0c9d2-7c43-40c6-96a0-652945b94d69 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:20.069544 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c79498-8aa8-4171-bbf7-ec59e26affda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:20.070197 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c79498-8aa8-4171-bbf7-ec59e26affda admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:20.070487 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c79498-8aa8-4171-bbf7-ec59e26affda admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:20.070763 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c79498-8aa8-4171-bbf7-ec59e26affda admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:20.071459 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c79498-8aa8-4171-bbf7-ec59e26affda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:20.073394 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c79498-8aa8-4171-bbf7-ec59e26affda admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:20.163013 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1261/2522] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:08:20 2022] POST /identity/v3/projects => generated 394 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:08:20.167346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab9592-94f8-42f6-8f9a-cce1c28510b7 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:20.177900 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab9592-94f8-42f6-8f9a-cce1c28510b7 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:20.229156 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:20.238450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf433cb-a16d-48c2-b57a-d9a8371e5c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:20.243704 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf433cb-a16d-48c2-b57a-d9a8371e5c2d admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:20.243704 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf433cb-a16d-48c2-b57a-d9a8371e5c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:20.243704 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf433cb-a16d-48c2-b57a-d9a8371e5c2d admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:20.243704 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf433cb-a16d-48c2-b57a-d9a8371e5c2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:20.243704 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf433cb-a16d-48c2-b57a-d9a8371e5c2d admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:20.366249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1262/2523] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:08:20 2022] POST /identity/v3/users => generated 298 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:08:20.370382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c79498-8aa8-4171-bbf7-ec59e26affda admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:20.381264 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c79498-8aa8-4171-bbf7-ec59e26affda admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:20.385872 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ef731-7bbd-4bf5-9672-3f6aa4e76c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:20.386526 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ef731-7bbd-4bf5-9672-3f6aa4e76c27 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:20.386812 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ef731-7bbd-4bf5-9672-3f6aa4e76c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:20.387090 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ef731-7bbd-4bf5-9672-3f6aa4e76c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:20.387832 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ef731-7bbd-4bf5-9672-3f6aa4e76c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:20.390406 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ef731-7bbd-4bf5-9672-3f6aa4e76c27 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:20.401786 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1262/2524] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:08:20 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:08:20.405831 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf433cb-a16d-48c2-b57a-d9a8371e5c2d admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:20.415899 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf433cb-a16d-48c2-b57a-d9a8371e5c2d admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:20.420604 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750ce6c-6617-4986-9a3d-18c1b53c35a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:20.421266 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750ce6c-6617-4986-9a3d-18c1b53c35a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:20.421554 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750ce6c-6617-4986-9a3d-18c1b53c35a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:20.421835 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750ce6c-6617-4986-9a3d-18c1b53c35a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:20.422564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750ce6c-6617-4986-9a3d-18c1b53c35a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:20.424192 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750ce6c-6617-4986-9a3d-18c1b53c35a9 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:20.435725 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1263/2525] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:08:20 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:08:20.441343 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ef731-7bbd-4bf5-9672-3f6aa4e76c27 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:20.451962 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ef731-7bbd-4bf5-9672-3f6aa4e76c27 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:20.456531 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28152bb6-9c9d-40dd-a2d0-a14ff7cb250a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:20.457410 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28152bb6-9c9d-40dd-a2d0-a14ff7cb250a admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:20.457696 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28152bb6-9c9d-40dd-a2d0-a14ff7cb250a admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:20.457977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28152bb6-9c9d-40dd-a2d0-a14ff7cb250a admin admin] PATH_INFO: `/v3/projects/9daeb2c2384c46f0b0a0d1a54446e118/users/b1406a178e9a47e09fb9a98ecd751813/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:20.473208 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28152bb6-9c9d-40dd-a2d0-a14ff7cb250a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9daeb2c2384c46f0b0a0d1a54446e118, user_id=b1406a178e9a47e09fb9a98ecd751813, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:20.478684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28152bb6-9c9d-40dd-a2d0-a14ff7cb250a admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:20.590587 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1263/2526] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:08:20 2022] PUT /identity/v3/projects/9daeb2c2384c46f0b0a0d1a54446e118/users/b1406a178e9a47e09fb9a98ecd751813/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:08:20.607237 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25fac1-39ad-4e15-94ca-a3dcb2029e3f None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:20.607553 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25fac1-39ad-4e15-94ca-a3dcb2029e3f None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:20.607837 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25fac1-39ad-4e15-94ca-a3dcb2029e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:20.634467 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-bf25fac1-39ad-4e15-94ca-a3dcb2029e3f None None] MFA Rules not processed for user `b1406a178e9a47e09fb9a98ecd751813`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:20.635627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-bf25fac1-39ad-4e15-94ca-a3dcb2029e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:20.698014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1264/2527] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:08:20.703380 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28152bb6-9c9d-40dd-a2d0-a14ff7cb250a admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:20.765665 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28152bb6-9c9d-40dd-a2d0-a14ff7cb250a admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:20.770428 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f890146-499f-4a12-9c5e-7cce13235223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:20.771106 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f890146-499f-4a12-9c5e-7cce13235223 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:20.771398 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f890146-499f-4a12-9c5e-7cce13235223 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:20.771681 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f890146-499f-4a12-9c5e-7cce13235223 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:20.772432 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f890146-499f-4a12-9c5e-7cce13235223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:20.774347 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f890146-499f-4a12-9c5e-7cce13235223 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:20.859258 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1264/2528] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:08:20 2022] POST /identity/v3/projects => generated 394 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:08:20.863361 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25fac1-39ad-4e15-94ca-a3dcb2029e3f None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:20.874530 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25fac1-39ad-4e15-94ca-a3dcb2029e3f None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:20.930153 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0a6ea-f1ed-4be0-b43b-b5ca34fe4d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:20.930782 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0a6ea-f1ed-4be0-b43b-b5ca34fe4d8f admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:20.931028 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0a6ea-f1ed-4be0-b43b-b5ca34fe4d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:20.931310 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0a6ea-f1ed-4be0-b43b-b5ca34fe4d8f admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:20.932002 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0a6ea-f1ed-4be0-b43b-b5ca34fe4d8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:20.933954 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0a6ea-f1ed-4be0-b43b-b5ca34fe4d8f admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:21.048199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1265/2529] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:08:20 2022] POST /identity/v3/users => generated 304 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:08:21.053346 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f890146-499f-4a12-9c5e-7cce13235223 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:21.070531 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f890146-499f-4a12-9c5e-7cce13235223 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:21.075286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befda0cb-e359-4778-a6c3-2d511f3050a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:21.076991 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befda0cb-e359-4778-a6c3-2d511f3050a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:21.077140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befda0cb-e359-4778-a6c3-2d511f3050a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:21.077410 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befda0cb-e359-4778-a6c3-2d511f3050a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:21.078123 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befda0cb-e359-4778-a6c3-2d511f3050a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:21.079945 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befda0cb-e359-4778-a6c3-2d511f3050a2 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:21.091291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1265/2530] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:08:21 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:08:21.096473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0a6ea-f1ed-4be0-b43b-b5ca34fe4d8f admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:21.106645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0a6ea-f1ed-4be0-b43b-b5ca34fe4d8f admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:21.111973 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16f4e6-6d6a-4d17-8bc5-4acf1bd77fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:21.112909 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16f4e6-6d6a-4d17-8bc5-4acf1bd77fae admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:21.113200 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16f4e6-6d6a-4d17-8bc5-4acf1bd77fae admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:21.113503 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16f4e6-6d6a-4d17-8bc5-4acf1bd77fae admin admin] PATH_INFO: `/v3/projects/a450147dc83a42dc8a4c5cd287a7915d/users/7baef22149724d83be1c07ff3078ea79/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:21.130151 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16f4e6-6d6a-4d17-8bc5-4acf1bd77fae admin admin] RBAC: Authorizing `identity:create_grant(project_id=a450147dc83a42dc8a4c5cd287a7915d, user_id=7baef22149724d83be1c07ff3078ea79, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:21.132859 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16f4e6-6d6a-4d17-8bc5-4acf1bd77fae admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:21.219206 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1266/2531] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:08:21 2022] PUT /identity/v3/projects/a450147dc83a42dc8a4c5cd287a7915d/users/7baef22149724d83be1c07ff3078ea79/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:08:21.223038 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befda0cb-e359-4778-a6c3-2d511f3050a2 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:21.233653 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befda0cb-e359-4778-a6c3-2d511f3050a2 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:21.266216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:21.289529 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11102f3-e9ff-4b92-8c38-baf4a2ffe4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:21.290213 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11102f3-e9ff-4b92-8c38-baf4a2ffe4df admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:21.290710 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11102f3-e9ff-4b92-8c38-baf4a2ffe4df admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:21.291214 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11102f3-e9ff-4b92-8c38-baf4a2ffe4df admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:21.292015 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11102f3-e9ff-4b92-8c38-baf4a2ffe4df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:21.294150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11102f3-e9ff-4b92-8c38-baf4a2ffe4df admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:21.305022 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1266/2532] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:08:21 2022] GET /identity/v3/roles => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:08:21.309441 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16f4e6-6d6a-4d17-8bc5-4acf1bd77fae admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:21.320568 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16f4e6-6d6a-4d17-8bc5-4acf1bd77fae admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:21.325444 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f88cf3-f071-42b7-a6c5-c0eaef681659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:21.326404 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f88cf3-f071-42b7-a6c5-c0eaef681659 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:21.326690 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f88cf3-f071-42b7-a6c5-c0eaef681659 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:21.326974 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f88cf3-f071-42b7-a6c5-c0eaef681659 admin admin] PATH_INFO: `/v3/projects/a450147dc83a42dc8a4c5cd287a7915d/users/7baef22149724d83be1c07ff3078ea79/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:21.329014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f88cf3-f071-42b7-a6c5-c0eaef681659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a450147dc83a42dc8a4c5cd287a7915d, user_id=7baef22149724d83be1c07ff3078ea79, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:21.332047 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f88cf3-f071-42b7-a6c5-c0eaef681659 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:21.342319 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1267/2533] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:08:21 2022] PUT /identity/v3/projects/a450147dc83a42dc8a4c5cd287a7915d/users/7baef22149724d83be1c07ff3078ea79/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:08:21.352938 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbbf54-ebee-4c62-bbcd-6e3b63d86cfa None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:21.353231 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbbf54-ebee-4c62-bbcd-6e3b63d86cfa None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:21.353506 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbbf54-ebee-4c62-bbcd-6e3b63d86cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:21.380441 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-e7fbbf54-ebee-4c62-bbcd-6e3b63d86cfa None None] MFA Rules not processed for user `7baef22149724d83be1c07ff3078ea79`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:21.381650 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-e7fbbf54-ebee-4c62-bbcd-6e3b63d86cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:21.454208 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1267/2534] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:21 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:08:21.465128 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f88cf3-f071-42b7-a6c5-c0eaef681659 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:21.466945 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-e1f88cf3-f071-42b7-a6c5-c0eaef681659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:21.487143 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:21.526885 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f88cf3-f071-42b7-a6c5-c0eaef681659 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:21.530663 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f69e5c-56bd-4968-a02c-08bd177fd9d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:21.531331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f69e5c-56bd-4968-a02c-08bd177fd9d3 service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:21.531616 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f69e5c-56bd-4968-a02c-08bd177fd9d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:21.531893 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f69e5c-56bd-4968-a02c-08bd177fd9d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:21.540793 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f69e5c-56bd-4968-a02c-08bd177fd9d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:21.542225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f69e5c-56bd-4968-a02c-08bd177fd9d3 service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:21.555150 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1268/2535] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:08:21 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:08:21.601135 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbbf54-ebee-4c62-bbcd-6e3b63d86cfa None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:21.602541 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-e7fbbf54-ebee-4c62-bbcd-6e3b63d86cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:21.614843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbbf54-ebee-4c62-bbcd-6e3b63d86cfa None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:21.618847 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49b8de-7d27-4647-9be6-5eddd7378b3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:21.619549 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49b8de-7d27-4647-9be6-5eddd7378b3f service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:21.619838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49b8de-7d27-4647-9be6-5eddd7378b3f service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:21.620225 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49b8de-7d27-4647-9be6-5eddd7378b3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:21.677677 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49b8de-7d27-4647-9be6-5eddd7378b3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:21.679106 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49b8de-7d27-4647-9be6-5eddd7378b3f service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:21.688058 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1268/2536] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:08:21 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:08:30.832857 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f69e5c-56bd-4968-a02c-08bd177fd9d3 service cinder] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:30.910328 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f69e5c-56bd-4968-a02c-08bd177fd9d3 service cinder] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:30.915087 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01066b55-d754-44f8-8095-196249b4af33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:30.915979 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01066b55-d754-44f8-8095-196249b4af33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:30.916300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01066b55-d754-44f8-8095-196249b4af33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:30.916587 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01066b55-d754-44f8-8095-196249b4af33 admin admin] PATH_INFO: `/v3/users/b1406a178e9a47e09fb9a98ecd751813` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:30.917801 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01066b55-d754-44f8-8095-196249b4af33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1406a178e9a47e09fb9a98ecd751813)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:30.919786 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01066b55-d754-44f8-8095-196249b4af33 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:30.960615 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbf5f3-5433-44db-b922-79aee3e081c0 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:30.961132 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbf5f3-5433-44db-b922-79aee3e081c0 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:30.961236 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbf5f3-5433-44db-b922-79aee3e081c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:30.978801 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-0cfbf5f3-5433-44db-b922-79aee3e081c0 None None] MFA Rules not processed for user `56191d451ddf4fba953c27dd79484723`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:30.980033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-0cfbf5f3-5433-44db-b922-79aee3e081c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:31.030765 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:31.038241 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1269/2537] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:08:31.102975 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-01066b55-d754-44f8-8095-196249b4af33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1406a178e9a47e09fb9a98ecd751813'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:31.103717 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-01066b55-d754-44f8-8095-196249b4af33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1406a178e9a47e09fb9a98ecd751813'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:31.118266 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-01066b55-d754-44f8-8095-196249b4af33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1406a178e9a47e09fb9a98ecd751813'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:31.126475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-01066b55-d754-44f8-8095-196249b4af33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1406a178e9a47e09fb9a98ecd751813'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:31.127236 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-01066b55-d754-44f8-8095-196249b4af33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1406a178e9a47e09fb9a98ecd751813'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:31.241889 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1269/2538] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:08:30 2022] DELETE /identity/v3/users/b1406a178e9a47e09fb9a98ecd751813 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:08:31.246367 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fd1a1-a5d2-43bd-94ca-a8de979ce7ed None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:31.246732 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fd1a1-a5d2-43bd-94ca-a8de979ce7ed None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:31.247168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fd1a1-a5d2-43bd-94ca-a8de979ce7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:31.267036 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-a10fd1a1-a5d2-43bd-94ca-a8de979ce7ed None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:31.268391 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-a10fd1a1-a5d2-43bd-94ca-a8de979ce7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:31.335263 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1270/2539] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:08:31.348739 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01066b55-d754-44f8-8095-196249b4af33 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:31.350338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-01066b55-d754-44f8-8095-196249b4af33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:31.404506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:31.425560 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01066b55-d754-44f8-8095-196249b4af33 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:31.429626 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d2b4b-37dd-4f7a-99e8-15ae124e0d39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:31.430317 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d2b4b-37dd-4f7a-99e8-15ae124e0d39 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:31.430615 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d2b4b-37dd-4f7a-99e8-15ae124e0d39 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:31.430905 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d2b4b-37dd-4f7a-99e8-15ae124e0d39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:31.442893 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d2b4b-37dd-4f7a-99e8-15ae124e0d39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:31.444399 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d2b4b-37dd-4f7a-99e8-15ae124e0d39 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:31.454907 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1270/2540] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:08:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:08:31.913307 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10fd1a1-a5d2-43bd-94ca-a8de979ce7ed None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:31.914744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-a10fd1a1-a5d2-43bd-94ca-a8de979ce7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:31.929051 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10fd1a1-a5d2-43bd-94ca-a8de979ce7ed None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:31.933921 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad0915-eab3-4389-8993-988b46dd3e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:31.934872 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad0915-eab3-4389-8993-988b46dd3e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:31.935173 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad0915-eab3-4389-8993-988b46dd3e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:31.935643 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad0915-eab3-4389-8993-988b46dd3e82 admin admin] PATH_INFO: `/v3/projects/9daeb2c2384c46f0b0a0d1a54446e118` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:31.936954 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad0915-eab3-4389-8993-988b46dd3e82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9daeb2c2384c46f0b0a0d1a54446e118)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:31.939005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad0915-eab3-4389-8993-988b46dd3e82 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:32.038733 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-13ad0915-eab3-4389-8993-988b46dd3e82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9daeb2c2384c46f0b0a0d1a54446e118', 'request_id': 'req-13ad0915-eab3-4389-8993-988b46dd3e82'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:32.045489 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-13ad0915-eab3-4389-8993-988b46dd3e82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9daeb2c2384c46f0b0a0d1a54446e118', 'request_id': 'req-13ad0915-eab3-4389-8993-988b46dd3e82'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:32.163968 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-13ad0915-eab3-4389-8993-988b46dd3e82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9daeb2c2384c46f0b0a0d1a54446e118', 'request_id': 'req-13ad0915-eab3-4389-8993-988b46dd3e82'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:32.190937 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-13ad0915-eab3-4389-8993-988b46dd3e82 admin admin] The token cache is being invalidate because project 9daeb2c2384c46f0b0a0d1a54446e118 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:08:32.191234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-13ad0915-eab3-4389-8993-988b46dd3e82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:32.191893 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-13ad0915-eab3-4389-8993-988b46dd3e82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:32.193949 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1271/2541] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:08:31 2022] DELETE /identity/v3/projects/9daeb2c2384c46f0b0a0d1a54446e118 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:08:32.197747 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d2b4b-37dd-4f7a-99e8-15ae124e0d39 service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:32.208978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d2b4b-37dd-4f7a-99e8-15ae124e0d39 service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:32.281456 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf850a6-b9d3-4dec-8b94-180bd39ba748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:32.282342 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf850a6-b9d3-4dec-8b94-180bd39ba748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:32.282627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf850a6-b9d3-4dec-8b94-180bd39ba748 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:32.282908 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf850a6-b9d3-4dec-8b94-180bd39ba748 admin admin] PATH_INFO: `/v3/users/7baef22149724d83be1c07ff3078ea79` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:32.284125 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf850a6-b9d3-4dec-8b94-180bd39ba748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7baef22149724d83be1c07ff3078ea79)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:32.286080 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf850a6-b9d3-4dec-8b94-180bd39ba748 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:32.525334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-bcf850a6-b9d3-4dec-8b94-180bd39ba748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7baef22149724d83be1c07ff3078ea79'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:32.525996 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-bcf850a6-b9d3-4dec-8b94-180bd39ba748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7baef22149724d83be1c07ff3078ea79'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:32.538680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-bcf850a6-b9d3-4dec-8b94-180bd39ba748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7baef22149724d83be1c07ff3078ea79'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:32.546436 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-bcf850a6-b9d3-4dec-8b94-180bd39ba748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7baef22149724d83be1c07ff3078ea79'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:32.547211 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-bcf850a6-b9d3-4dec-8b94-180bd39ba748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7baef22149724d83be1c07ff3078ea79'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:32.664415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1271/2542] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:08:32 2022] DELETE /identity/v3/users/7baef22149724d83be1c07ff3078ea79 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:08:33.129460 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad0915-eab3-4389-8993-988b46dd3e82 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:33.130977 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-13ad0915-eab3-4389-8993-988b46dd3e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:33.146116 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad0915-eab3-4389-8993-988b46dd3e82 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:33.208364 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610ba60-0b63-44e3-8417-862840c3333b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:33.209155 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610ba60-0b63-44e3-8417-862840c3333b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:33.209440 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610ba60-0b63-44e3-8417-862840c3333b admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:33.209718 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610ba60-0b63-44e3-8417-862840c3333b admin admin] PATH_INFO: `/v3/projects/a450147dc83a42dc8a4c5cd287a7915d` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:33.210998 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610ba60-0b63-44e3-8417-862840c3333b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a450147dc83a42dc8a4c5cd287a7915d)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:33.212965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610ba60-0b63-44e3-8417-862840c3333b admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:33.322333 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:33.368399 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-4610ba60-0b63-44e3-8417-862840c3333b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a450147dc83a42dc8a4c5cd287a7915d', 'request_id': 'req-4610ba60-0b63-44e3-8417-862840c3333b'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:33.368399 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-4610ba60-0b63-44e3-8417-862840c3333b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a450147dc83a42dc8a4c5cd287a7915d', 'request_id': 'req-4610ba60-0b63-44e3-8417-862840c3333b'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:33.481572 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-4610ba60-0b63-44e3-8417-862840c3333b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a450147dc83a42dc8a4c5cd287a7915d', 'request_id': 'req-4610ba60-0b63-44e3-8417-862840c3333b'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:33.493633 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-4610ba60-0b63-44e3-8417-862840c3333b admin admin] The token cache is being invalidate because project a450147dc83a42dc8a4c5cd287a7915d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:08:33.493927 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-4610ba60-0b63-44e3-8417-862840c3333b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:33.494579 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-4610ba60-0b63-44e3-8417-862840c3333b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:33.496277 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1272/2543] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:08:33 2022] DELETE /identity/v3/projects/a450147dc83a42dc8a4c5cd287a7915d => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:08:33.501558 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc06e18-4ddb-44dd-abb5-f0042c78e4f8 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:33.502041 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc06e18-4ddb-44dd-abb5-f0042c78e4f8 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:33.502158 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc06e18-4ddb-44dd-abb5-f0042c78e4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:33.523925 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-0bc06e18-4ddb-44dd-abb5-f0042c78e4f8 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:33.532311 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-0bc06e18-4ddb-44dd-abb5-f0042c78e4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:33.584742 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:33.594359 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1272/2544] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:08:33.603264 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fa4bd-cd9b-45e6-99b4-79201e169103 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:33.603563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fa4bd-cd9b-45e6-99b4-79201e169103 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:33.603846 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fa4bd-cd9b-45e6-99b4-79201e169103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:33.625319 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-324fa4bd-cd9b-45e6-99b4-79201e169103 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:33.626604 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-324fa4bd-cd9b-45e6-99b4-79201e169103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:33.635358 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1273/2545] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:08:33.639762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc06e18-4ddb-44dd-abb5-f0042c78e4f8 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:33.649601 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc06e18-4ddb-44dd-abb5-f0042c78e4f8 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:33.655629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc8d22-5493-433a-83d4-d1f8588fa067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:33.656329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc8d22-5493-433a-83d4-d1f8588fa067 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:33.656621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc8d22-5493-433a-83d4-d1f8588fa067 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:33.656905 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc8d22-5493-433a-83d4-d1f8588fa067 admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:33.657645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc8d22-5493-433a-83d4-d1f8588fa067 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:08:33.658592 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc8d22-5493-433a-83d4-d1f8588fa067 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:33.660182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc8d22-5493-433a-83d4-d1f8588fa067 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:33.673640 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1273/2546] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 16:08:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:08:33.677841 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fa4bd-cd9b-45e6-99b4-79201e169103 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:33.689057 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fa4bd-cd9b-45e6-99b4-79201e169103 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:33.693867 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df9108-1f14-409d-8e65-65a9e2c95afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:33.694528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df9108-1f14-409d-8e65-65a9e2c95afd admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:33.694816 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df9108-1f14-409d-8e65-65a9e2c95afd admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:33.695099 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df9108-1f14-409d-8e65-65a9e2c95afd admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:33.695785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df9108-1f14-409d-8e65-65a9e2c95afd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:33.697833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df9108-1f14-409d-8e65-65a9e2c95afd admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:33.794631 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1274/2547] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:08:33 2022] POST /identity/v3/projects => generated 366 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:08:33.796912 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc8d22-5493-433a-83d4-d1f8588fa067 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:33.805451 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc8d22-5493-433a-83d4-d1f8588fa067 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:33.863691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe9457-681a-4d79-adcd-6187d1e90923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:33.864424 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe9457-681a-4d79-adcd-6187d1e90923 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:33.864712 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe9457-681a-4d79-adcd-6187d1e90923 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:33.864990 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe9457-681a-4d79-adcd-6187d1e90923 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:33.865690 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe9457-681a-4d79-adcd-6187d1e90923 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:33.867745 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe9457-681a-4d79-adcd-6187d1e90923 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:33.988809 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1274/2548] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:08:33 2022] POST /identity/v3/users => generated 284 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:08:33.990096 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df9108-1f14-409d-8e65-65a9e2c95afd admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:34.001694 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df9108-1f14-409d-8e65-65a9e2c95afd admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:34.007029 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0d4d9-0afa-4fdd-b71a-bb7d24f904ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:34.007731 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0d4d9-0afa-4fdd-b71a-bb7d24f904ea admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:34.008020 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0d4d9-0afa-4fdd-b71a-bb7d24f904ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:34.008332 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0d4d9-0afa-4fdd-b71a-bb7d24f904ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:34.009100 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0d4d9-0afa-4fdd-b71a-bb7d24f904ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:34.011015 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0d4d9-0afa-4fdd-b71a-bb7d24f904ea admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:34.023062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1275/2549] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:08:33 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:08:34.027190 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe9457-681a-4d79-adcd-6187d1e90923 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:34.037515 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe9457-681a-4d79-adcd-6187d1e90923 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:34.042212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5435f-301a-446a-aa5a-1c8d2c755c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:34.045676 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5435f-301a-446a-aa5a-1c8d2c755c4a admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:34.045676 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5435f-301a-446a-aa5a-1c8d2c755c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:34.045676 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5435f-301a-446a-aa5a-1c8d2c755c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:34.045676 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5435f-301a-446a-aa5a-1c8d2c755c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:34.046575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5435f-301a-446a-aa5a-1c8d2c755c4a admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:34.061788 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1275/2550] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:08:34 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:08:34.063085 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0d4d9-0afa-4fdd-b71a-bb7d24f904ea admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:34.080766 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0d4d9-0afa-4fdd-b71a-bb7d24f904ea admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:34.085381 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998e800-3e11-4765-9d56-aaef82f89047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:34.086345 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998e800-3e11-4765-9d56-aaef82f89047 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:34.086633 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998e800-3e11-4765-9d56-aaef82f89047 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:34.086912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998e800-3e11-4765-9d56-aaef82f89047 admin admin] PATH_INFO: `/v3/projects/b19d2758c8504f18be8f4e82b582f083/users/9a42bcf38dc542f9a2704b33ca94b3b0/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:34.116541 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998e800-3e11-4765-9d56-aaef82f89047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b19d2758c8504f18be8f4e82b582f083, user_id=9a42bcf38dc542f9a2704b33ca94b3b0, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:34.116541 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998e800-3e11-4765-9d56-aaef82f89047 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:34.242353 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1276/2551] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:08:34 2022] PUT /identity/v3/projects/b19d2758c8504f18be8f4e82b582f083/users/9a42bcf38dc542f9a2704b33ca94b3b0/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:08:34.253641 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053abc81-f751-4ddf-bdf3-e0c1b73b74b5 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:34.253942 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053abc81-f751-4ddf-bdf3-e0c1b73b74b5 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:34.254233 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053abc81-f751-4ddf-bdf3-e0c1b73b74b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:34.280258 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-053abc81-f751-4ddf-bdf3-e0c1b73b74b5 None None] MFA Rules not processed for user `9a42bcf38dc542f9a2704b33ca94b3b0`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:34.281507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-053abc81-f751-4ddf-bdf3-e0c1b73b74b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:34.347849 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1276/2552] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:08:34.352177 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998e800-3e11-4765-9d56-aaef82f89047 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:34.424430 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998e800-3e11-4765-9d56-aaef82f89047 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:34.430121 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36aea9-7126-4446-a28c-45bb7c14631c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:34.430803 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36aea9-7126-4446-a28c-45bb7c14631c admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:34.431088 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36aea9-7126-4446-a28c-45bb7c14631c admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:34.431365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36aea9-7126-4446-a28c-45bb7c14631c admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:34.432077 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36aea9-7126-4446-a28c-45bb7c14631c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:34.434040 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36aea9-7126-4446-a28c-45bb7c14631c admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:34.519390 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1277/2553] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:08:34 2022] POST /identity/v3/projects => generated 368 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:08:34.523858 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053abc81-f751-4ddf-bdf3-e0c1b73b74b5 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:34.536749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053abc81-f751-4ddf-bdf3-e0c1b73b74b5 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:34.587208 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:34.595063 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe9eb4-1fc1-4b51-b379-4716d74c6563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:34.595754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe9eb4-1fc1-4b51-b379-4716d74c6563 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:34.596044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe9eb4-1fc1-4b51-b379-4716d74c6563 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:34.596404 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe9eb4-1fc1-4b51-b379-4716d74c6563 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:34.597220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe9eb4-1fc1-4b51-b379-4716d74c6563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:34.599159 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe9eb4-1fc1-4b51-b379-4716d74c6563 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:34.716086 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1277/2554] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:08:34 2022] POST /identity/v3/users => generated 291 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:08:34.720987 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36aea9-7126-4446-a28c-45bb7c14631c admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:34.731236 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36aea9-7126-4446-a28c-45bb7c14631c admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:34.736620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83f9c8-e068-4758-bb04-b835127e7641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:34.737315 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83f9c8-e068-4758-bb04-b835127e7641 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:34.737620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83f9c8-e068-4758-bb04-b835127e7641 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:34.737903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83f9c8-e068-4758-bb04-b835127e7641 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:34.738629 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83f9c8-e068-4758-bb04-b835127e7641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:34.740246 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83f9c8-e068-4758-bb04-b835127e7641 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:34.751874 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1278/2555] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:08:34 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:08:34.756123 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe9eb4-1fc1-4b51-b379-4716d74c6563 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:34.767009 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe9eb4-1fc1-4b51-b379-4716d74c6563 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:34.771605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236c4c0-2b28-4b1a-b03b-86e47f51fbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:34.772522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236c4c0-2b28-4b1a-b03b-86e47f51fbd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:34.772808 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236c4c0-2b28-4b1a-b03b-86e47f51fbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:34.773088 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236c4c0-2b28-4b1a-b03b-86e47f51fbd4 admin admin] PATH_INFO: `/v3/projects/269e7590961a4f60a083d85fc87d7d03/users/144126b2d2f94997891926f395b1edcd/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:34.788691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236c4c0-2b28-4b1a-b03b-86e47f51fbd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=269e7590961a4f60a083d85fc87d7d03, user_id=144126b2d2f94997891926f395b1edcd, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:34.791325 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236c4c0-2b28-4b1a-b03b-86e47f51fbd4 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:34.979383 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1278/2556] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:08:34 2022] PUT /identity/v3/projects/269e7590961a4f60a083d85fc87d7d03/users/144126b2d2f94997891926f395b1edcd/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:08:34.983577 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83f9c8-e068-4758-bb04-b835127e7641 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:34.993810 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83f9c8-e068-4758-bb04-b835127e7641 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:35.015038 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:35.056699 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5943e27-1e2a-4d1b-8344-3fff9e9b3b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:35.057714 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5943e27-1e2a-4d1b-8344-3fff9e9b3b78 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:35.057923 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5943e27-1e2a-4d1b-8344-3fff9e9b3b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:35.058228 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5943e27-1e2a-4d1b-8344-3fff9e9b3b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:35.059032 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5943e27-1e2a-4d1b-8344-3fff9e9b3b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:35.060683 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5943e27-1e2a-4d1b-8344-3fff9e9b3b78 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:35.075044 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1279/2557] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:08:34 2022] GET /identity/v3/roles => generated 1427 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 16:08:35.076792 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236c4c0-2b28-4b1a-b03b-86e47f51fbd4 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:35.092759 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236c4c0-2b28-4b1a-b03b-86e47f51fbd4 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:35.098502 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec62a0f-bc9d-4470-984a-db79a8a38f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:35.099444 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec62a0f-bc9d-4470-984a-db79a8a38f57 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:35.099730 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec62a0f-bc9d-4470-984a-db79a8a38f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:35.100007 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec62a0f-bc9d-4470-984a-db79a8a38f57 admin admin] PATH_INFO: `/v3/projects/269e7590961a4f60a083d85fc87d7d03/users/144126b2d2f94997891926f395b1edcd/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:35.102261 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec62a0f-bc9d-4470-984a-db79a8a38f57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=269e7590961a4f60a083d85fc87d7d03, user_id=144126b2d2f94997891926f395b1edcd, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:35.106334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec62a0f-bc9d-4470-984a-db79a8a38f57 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:35.131747 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1279/2558] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:08:35 2022] PUT /identity/v3/projects/269e7590961a4f60a083d85fc87d7d03/users/144126b2d2f94997891926f395b1edcd/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:08:35.134262 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97451cfb-113d-471c-9a32-fc5086b62a89 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:35.134562 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97451cfb-113d-471c-9a32-fc5086b62a89 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:35.134847 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97451cfb-113d-471c-9a32-fc5086b62a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:35.166245 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-97451cfb-113d-471c-9a32-fc5086b62a89 None None] MFA Rules not processed for user `144126b2d2f94997891926f395b1edcd`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:35.167484 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-97451cfb-113d-471c-9a32-fc5086b62a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:35.250161 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1280/2559] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:08:35.261977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec62a0f-bc9d-4470-984a-db79a8a38f57 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:35.265233 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-4ec62a0f-bc9d-4470-984a-db79a8a38f57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:35.328524 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec62a0f-bc9d-4470-984a-db79a8a38f57 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:35.333746 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d6845-e1bf-4713-bdc3-a69175efb7e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:35.334511 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d6845-e1bf-4713-bdc3-a69175efb7e6 service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:35.334807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d6845-e1bf-4713-bdc3-a69175efb7e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:35.335237 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d6845-e1bf-4713-bdc3-a69175efb7e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:35.348796 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d6845-e1bf-4713-bdc3-a69175efb7e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:35.350243 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d6845-e1bf-4713-bdc3-a69175efb7e6 service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:35.360948 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1280/2560] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:08:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:08:35.662361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97451cfb-113d-471c-9a32-fc5086b62a89 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:35.673836 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97451cfb-113d-471c-9a32-fc5086b62a89 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:35.679979 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f433a-8dd3-441b-ac45-710604c3c57e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:35.680992 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f433a-8dd3-441b-ac45-710604c3c57e service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:35.681503 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f433a-8dd3-441b-ac45-710604c3c57e service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:35.682191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f433a-8dd3-441b-ac45-710604c3c57e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:35.757217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f433a-8dd3-441b-ac45-710604c3c57e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:35.758956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f433a-8dd3-441b-ac45-710604c3c57e service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:35.769696 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1281/2561] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:08:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:08:37.114803 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d6845-e1bf-4713-bdc3-a69175efb7e6 service cinder] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:37.116439 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f70d6845-e1bf-4713-bdc3-a69175efb7e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:37.224650 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d6845-e1bf-4713-bdc3-a69175efb7e6 service cinder] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:37.238617 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b4a5a-2ca3-4819-bc9e-69a7ed7e2e09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:37.239585 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b4a5a-2ca3-4819-bc9e-69a7ed7e2e09 service nova] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:37.239926 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b4a5a-2ca3-4819-bc9e-69a7ed7e2e09 service nova] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:37.240458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b4a5a-2ca3-4819-bc9e-69a7ed7e2e09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:37.242346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-279b4a5a-2ca3-4819-bc9e-69a7ed7e2e09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:37.256749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b4a5a-2ca3-4819-bc9e-69a7ed7e2e09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:37.260946 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b4a5a-2ca3-4819-bc9e-69a7ed7e2e09 service nova] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:37.270645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1281/2562] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:08:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:08:39.408448 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f433a-8dd3-441b-ac45-710604c3c57e service cinder] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:39.422597 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f433a-8dd3-441b-ac45-710604c3c57e service cinder] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:39.428185 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a39807-71b3-45a9-85d9-90d9af9dbe38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:39.428851 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a39807-71b3-45a9-85d9-90d9af9dbe38 service nova] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:39.429137 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a39807-71b3-45a9-85d9-90d9af9dbe38 service nova] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:39.429416 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a39807-71b3-45a9-85d9-90d9af9dbe38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:39.431163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-76a39807-71b3-45a9-85d9-90d9af9dbe38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:39.476605 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:39.497912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a39807-71b3-45a9-85d9-90d9af9dbe38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:39.499575 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a39807-71b3-45a9-85d9-90d9af9dbe38 service nova] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:39.521350 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1282/2563] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:08:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:08:43.671795 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b4a5a-2ca3-4819-bc9e-69a7ed7e2e09 service nova] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:43.711619 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:43.735879 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b4a5a-2ca3-4819-bc9e-69a7ed7e2e09 service nova] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:43.740732 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f9a1e-c8b9-4f7d-8a5d-221156a3430c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:43.741614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f9a1e-c8b9-4f7d-8a5d-221156a3430c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:43.741904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f9a1e-c8b9-4f7d-8a5d-221156a3430c admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:43.742188 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f9a1e-c8b9-4f7d-8a5d-221156a3430c admin admin] PATH_INFO: `/v3/users/9a42bcf38dc542f9a2704b33ca94b3b0` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:43.743378 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f9a1e-c8b9-4f7d-8a5d-221156a3430c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a42bcf38dc542f9a2704b33ca94b3b0)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:43.745821 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f9a1e-c8b9-4f7d-8a5d-221156a3430c admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:43.918133 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-722f9a1e-c8b9-4f7d-8a5d-221156a3430c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a42bcf38dc542f9a2704b33ca94b3b0'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:43.918721 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-722f9a1e-c8b9-4f7d-8a5d-221156a3430c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a42bcf38dc542f9a2704b33ca94b3b0'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:43.932340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-722f9a1e-c8b9-4f7d-8a5d-221156a3430c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a42bcf38dc542f9a2704b33ca94b3b0'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:43.939947 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-722f9a1e-c8b9-4f7d-8a5d-221156a3430c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a42bcf38dc542f9a2704b33ca94b3b0'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:43.940664 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-722f9a1e-c8b9-4f7d-8a5d-221156a3430c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a42bcf38dc542f9a2704b33ca94b3b0'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:44.047525 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1282/2564] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:08:43 2022] DELETE /identity/v3/users/9a42bcf38dc542f9a2704b33ca94b3b0 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:08:44.052120 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1ab15-2981-48a2-9acb-18e9474df7c3 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:44.052651 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1ab15-2981-48a2-9acb-18e9474df7c3 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:44.052771 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1ab15-2981-48a2-9acb-18e9474df7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:44.075425 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-24f1ab15-2981-48a2-9acb-18e9474df7c3 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:44.076696 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-24f1ab15-2981-48a2-9acb-18e9474df7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:44.145379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1283/2565] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:08:44.155095 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f9a1e-c8b9-4f7d-8a5d-221156a3430c admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:44.156741 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-722f9a1e-c8b9-4f7d-8a5d-221156a3430c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:44.217393 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f9a1e-c8b9-4f7d-8a5d-221156a3430c admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:44.221589 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f454f-b35f-450a-ae00-18fb21250fc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:44.222249 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f454f-b35f-450a-ae00-18fb21250fc7 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:44.222539 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f454f-b35f-450a-ae00-18fb21250fc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:44.222823 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f454f-b35f-450a-ae00-18fb21250fc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:44.232326 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f454f-b35f-450a-ae00-18fb21250fc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:44.234068 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f454f-b35f-450a-ae00-18fb21250fc7 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:44.244361 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1283/2566] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:08:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:08:44.666115 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1ab15-2981-48a2-9acb-18e9474df7c3 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:44.667556 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-24f1ab15-2981-48a2-9acb-18e9474df7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:44.681853 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1ab15-2981-48a2-9acb-18e9474df7c3 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:44.692068 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1ed2d-f9ac-4097-90cb-2a846c4d3101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:44.692068 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1ed2d-f9ac-4097-90cb-2a846c4d3101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:44.692068 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1ed2d-f9ac-4097-90cb-2a846c4d3101 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:44.692068 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1ed2d-f9ac-4097-90cb-2a846c4d3101 admin admin] PATH_INFO: `/v3/projects/b19d2758c8504f18be8f4e82b582f083` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:44.692785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1ed2d-f9ac-4097-90cb-2a846c4d3101 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b19d2758c8504f18be8f4e82b582f083)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:44.694711 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1ed2d-f9ac-4097-90cb-2a846c4d3101 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:44.801597 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-e6b1ed2d-f9ac-4097-90cb-2a846c4d3101 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b19d2758c8504f18be8f4e82b582f083', 'request_id': 'req-e6b1ed2d-f9ac-4097-90cb-2a846c4d3101'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:44.807880 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-e6b1ed2d-f9ac-4097-90cb-2a846c4d3101 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b19d2758c8504f18be8f4e82b582f083', 'request_id': 'req-e6b1ed2d-f9ac-4097-90cb-2a846c4d3101'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:44.933287 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-e6b1ed2d-f9ac-4097-90cb-2a846c4d3101 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b19d2758c8504f18be8f4e82b582f083', 'request_id': 'req-e6b1ed2d-f9ac-4097-90cb-2a846c4d3101'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:44.945995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-e6b1ed2d-f9ac-4097-90cb-2a846c4d3101 admin admin] The token cache is being invalidate because project b19d2758c8504f18be8f4e82b582f083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:08:44.946291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-e6b1ed2d-f9ac-4097-90cb-2a846c4d3101 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:44.946956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-e6b1ed2d-f9ac-4097-90cb-2a846c4d3101 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:44.951625 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1284/2567] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:08:44 2022] DELETE /identity/v3/projects/b19d2758c8504f18be8f4e82b582f083 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:08:44.954122 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f454f-b35f-450a-ae00-18fb21250fc7 service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:44.963831 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f454f-b35f-450a-ae00-18fb21250fc7 service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:45.019329 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:45.025723 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ce041-4cfc-4096-b695-e93d42793e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:45.026665 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ce041-4cfc-4096-b695-e93d42793e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:45.026952 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ce041-4cfc-4096-b695-e93d42793e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:45.027240 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ce041-4cfc-4096-b695-e93d42793e45 admin admin] PATH_INFO: `/v3/users/144126b2d2f94997891926f395b1edcd` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:45.028506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ce041-4cfc-4096-b695-e93d42793e45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=144126b2d2f94997891926f395b1edcd)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:45.030616 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ce041-4cfc-4096-b695-e93d42793e45 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:45.193428 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-815ce041-4cfc-4096-b695-e93d42793e45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '144126b2d2f94997891926f395b1edcd'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:45.194032 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-815ce041-4cfc-4096-b695-e93d42793e45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '144126b2d2f94997891926f395b1edcd'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:45.207989 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-815ce041-4cfc-4096-b695-e93d42793e45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '144126b2d2f94997891926f395b1edcd'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:45.215076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-815ce041-4cfc-4096-b695-e93d42793e45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '144126b2d2f94997891926f395b1edcd'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:45.215796 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-815ce041-4cfc-4096-b695-e93d42793e45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '144126b2d2f94997891926f395b1edcd'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:45.304244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1284/2568] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:08:44 2022] DELETE /identity/v3/users/144126b2d2f94997891926f395b1edcd => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:08:45.820627 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1ed2d-f9ac-4097-90cb-2a846c4d3101 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:45.822573 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-e6b1ed2d-f9ac-4097-90cb-2a846c4d3101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:45.836598 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1ed2d-f9ac-4097-90cb-2a846c4d3101 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:45.896289 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:45.903006 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b3985-cd1b-4614-a8de-922f411a454a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:45.903982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b3985-cd1b-4614-a8de-922f411a454a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:45.904448 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b3985-cd1b-4614-a8de-922f411a454a admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:45.904807 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b3985-cd1b-4614-a8de-922f411a454a admin admin] PATH_INFO: `/v3/projects/269e7590961a4f60a083d85fc87d7d03` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:45.906801 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b3985-cd1b-4614-a8de-922f411a454a admin admin] RBAC: Authorizing `identity:delete_project(project_id=269e7590961a4f60a083d85fc87d7d03)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:45.908875 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b3985-cd1b-4614-a8de-922f411a454a admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:46.085350 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-af2b3985-cd1b-4614-a8de-922f411a454a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '269e7590961a4f60a083d85fc87d7d03', 'request_id': 'req-af2b3985-cd1b-4614-a8de-922f411a454a'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:46.091953 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-af2b3985-cd1b-4614-a8de-922f411a454a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '269e7590961a4f60a083d85fc87d7d03', 'request_id': 'req-af2b3985-cd1b-4614-a8de-922f411a454a'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:46.195963 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-af2b3985-cd1b-4614-a8de-922f411a454a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '269e7590961a4f60a083d85fc87d7d03', 'request_id': 'req-af2b3985-cd1b-4614-a8de-922f411a454a'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:46.209608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-af2b3985-cd1b-4614-a8de-922f411a454a admin admin] The token cache is being invalidate because project 269e7590961a4f60a083d85fc87d7d03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:08:46.209608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-af2b3985-cd1b-4614-a8de-922f411a454a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:46.209608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-af2b3985-cd1b-4614-a8de-922f411a454a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:46.211279 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1285/2569] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:08:45 2022] DELETE /identity/v3/projects/269e7590961a4f60a083d85fc87d7d03 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:08:46.216144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b73623-e9cd-4528-9f2b-36e61919f9d7 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:46.216659 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b73623-e9cd-4528-9f2b-36e61919f9d7 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:46.216781 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b73623-e9cd-4528-9f2b-36e61919f9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:46.241781 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-20b73623-e9cd-4528-9f2b-36e61919f9d7 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:46.242999 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-20b73623-e9cd-4528-9f2b-36e61919f9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:46.304688 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1285/2570] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:08:46.312696 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0294fb-a8f7-4a3f-9478-4644c6684af5 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:46.312992 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0294fb-a8f7-4a3f-9478-4644c6684af5 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:46.313273 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0294fb-a8f7-4a3f-9478-4644c6684af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:46.331960 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-5c0294fb-a8f7-4a3f-9478-4644c6684af5 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:46.333201 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-5c0294fb-a8f7-4a3f-9478-4644c6684af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:46.342061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1286/2571] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:08:46.346951 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b73623-e9cd-4528-9f2b-36e61919f9d7 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:46.356878 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b73623-e9cd-4528-9f2b-36e61919f9d7 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:46.361875 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279900ad-582d-43a7-8aab-f01c62e07c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:46.362533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279900ad-582d-43a7-8aab-f01c62e07c68 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:46.362824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279900ad-582d-43a7-8aab-f01c62e07c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:46.363104 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279900ad-582d-43a7-8aab-f01c62e07c68 admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:46.363834 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279900ad-582d-43a7-8aab-f01c62e07c68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:08:46.364181 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279900ad-582d-43a7-8aab-f01c62e07c68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:46.365817 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279900ad-582d-43a7-8aab-f01c62e07c68 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:46.377879 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1286/2572] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 16:08:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:08:46.382270 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0294fb-a8f7-4a3f-9478-4644c6684af5 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:46.393165 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0294fb-a8f7-4a3f-9478-4644c6684af5 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:46.397955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a4fe3-69c2-4432-9cb8-a0c9e5fdcc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:46.398616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a4fe3-69c2-4432-9cb8-a0c9e5fdcc93 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:46.398903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a4fe3-69c2-4432-9cb8-a0c9e5fdcc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:46.399190 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a4fe3-69c2-4432-9cb8-a0c9e5fdcc93 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:46.399863 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a4fe3-69c2-4432-9cb8-a0c9e5fdcc93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:46.401813 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a4fe3-69c2-4432-9cb8-a0c9e5fdcc93 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:46.528041 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1287/2573] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:08:46 2022] POST /identity/v3/projects => generated 386 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:08:46.533121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279900ad-582d-43a7-8aab-f01c62e07c68 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:46.542728 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279900ad-582d-43a7-8aab-f01c62e07c68 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:46.605150 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0648e-fa3d-4a2d-a5a2-3d66c6604887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:46.605796 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0648e-fa3d-4a2d-a5a2-3d66c6604887 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:46.606089 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0648e-fa3d-4a2d-a5a2-3d66c6604887 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:46.606369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0648e-fa3d-4a2d-a5a2-3d66c6604887 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:46.607082 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0648e-fa3d-4a2d-a5a2-3d66c6604887 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:46.609108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0648e-fa3d-4a2d-a5a2-3d66c6604887 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:46.617904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:46.728867 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1287/2574] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:08:46 2022] POST /identity/v3/users => generated 294 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:08:46.732522 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a4fe3-69c2-4432-9cb8-a0c9e5fdcc93 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:46.744449 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a4fe3-69c2-4432-9cb8-a0c9e5fdcc93 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:46.749969 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb9345-1405-42b5-b2fb-d282bf65f77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:46.755090 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb9345-1405-42b5-b2fb-d282bf65f77c admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:46.755090 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb9345-1405-42b5-b2fb-d282bf65f77c admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:46.755090 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb9345-1405-42b5-b2fb-d282bf65f77c admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:46.755090 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb9345-1405-42b5-b2fb-d282bf65f77c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:46.755090 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb9345-1405-42b5-b2fb-d282bf65f77c admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:46.767520 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1288/2575] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:08:46 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:08:46.768744 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0648e-fa3d-4a2d-a5a2-3d66c6604887 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:46.778747 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0648e-fa3d-4a2d-a5a2-3d66c6604887 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:46.787167 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7922632-af6d-448b-a7d8-b473f6e25ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:46.787167 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7922632-af6d-448b-a7d8-b473f6e25ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:46.787167 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7922632-af6d-448b-a7d8-b473f6e25ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:46.787167 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7922632-af6d-448b-a7d8-b473f6e25ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:46.787687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7922632-af6d-448b-a7d8-b473f6e25ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:46.787687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7922632-af6d-448b-a7d8-b473f6e25ba4 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:46.798533 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1288/2576] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:08:46 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:08:46.802908 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb9345-1405-42b5-b2fb-d282bf65f77c admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:46.814246 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb9345-1405-42b5-b2fb-d282bf65f77c admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:46.818916 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3e957-77a6-4727-80ab-84fe62f8009c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:46.819799 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3e957-77a6-4727-80ab-84fe62f8009c admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:46.820109 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3e957-77a6-4727-80ab-84fe62f8009c admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:46.820395 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3e957-77a6-4727-80ab-84fe62f8009c admin admin] PATH_INFO: `/v3/projects/fe3071c146834d4ca401e892b4b8ff72/users/a19f7ef0a0c247e7b8783761bddc2061/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:46.835748 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3e957-77a6-4727-80ab-84fe62f8009c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe3071c146834d4ca401e892b4b8ff72, user_id=a19f7ef0a0c247e7b8783761bddc2061, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:46.838436 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3e957-77a6-4727-80ab-84fe62f8009c admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:46.945077 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1289/2577] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:08:46 2022] PUT /identity/v3/projects/fe3071c146834d4ca401e892b4b8ff72/users/a19f7ef0a0c247e7b8783761bddc2061/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:08:46.956187 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae4b43-56ad-4258-a1dd-26ff3c9bf095 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:46.956481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae4b43-56ad-4258-a1dd-26ff3c9bf095 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:46.956761 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae4b43-56ad-4258-a1dd-26ff3c9bf095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:46.987949 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-76ae4b43-56ad-4258-a1dd-26ff3c9bf095 None None] MFA Rules not processed for user `a19f7ef0a0c247e7b8783761bddc2061`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:46.989473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-76ae4b43-56ad-4258-a1dd-26ff3c9bf095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:47.067541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1289/2578] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:08:47.072613 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3e957-77a6-4727-80ab-84fe62f8009c admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:47.143941 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3e957-77a6-4727-80ab-84fe62f8009c admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:47.148831 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6201a-d1d9-4a10-8b09-1a12af04c195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:47.149575 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6201a-d1d9-4a10-8b09-1a12af04c195 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:47.149864 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6201a-d1d9-4a10-8b09-1a12af04c195 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:47.150148 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6201a-d1d9-4a10-8b09-1a12af04c195 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:47.155034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6201a-d1d9-4a10-8b09-1a12af04c195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:47.155034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6201a-d1d9-4a10-8b09-1a12af04c195 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:47.266565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1290/2579] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:08:47 2022] POST /identity/v3/projects => generated 388 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:08:47.270881 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae4b43-56ad-4258-a1dd-26ff3c9bf095 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:47.282834 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae4b43-56ad-4258-a1dd-26ff3c9bf095 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:47.352965 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da90bc-3973-47cf-9fbd-f0c148fa3b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:47.353655 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da90bc-3973-47cf-9fbd-f0c148fa3b36 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:47.353946 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da90bc-3973-47cf-9fbd-f0c148fa3b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:47.354263 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da90bc-3973-47cf-9fbd-f0c148fa3b36 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:47.354978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da90bc-3973-47cf-9fbd-f0c148fa3b36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:47.357045 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da90bc-3973-47cf-9fbd-f0c148fa3b36 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:47.461787 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1290/2580] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:08:47 2022] POST /identity/v3/users => generated 301 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:08:47.471981 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6201a-d1d9-4a10-8b09-1a12af04c195 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:47.482541 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6201a-d1d9-4a10-8b09-1a12af04c195 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:47.487993 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2069be1-bdad-40e8-8c67-6e7a4119a457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:47.488778 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2069be1-bdad-40e8-8c67-6e7a4119a457 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:47.489140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2069be1-bdad-40e8-8c67-6e7a4119a457 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:47.489475 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2069be1-bdad-40e8-8c67-6e7a4119a457 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:47.490191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2069be1-bdad-40e8-8c67-6e7a4119a457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:47.491915 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2069be1-bdad-40e8-8c67-6e7a4119a457 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:47.494362 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:47.511611 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1291/2581] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:08:47 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:08:47.516300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da90bc-3973-47cf-9fbd-f0c148fa3b36 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:47.530036 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da90bc-3973-47cf-9fbd-f0c148fa3b36 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:47.536288 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29e04f-1557-4979-b95a-f86007891b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:47.537636 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29e04f-1557-4979-b95a-f86007891b1e admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:47.538331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29e04f-1557-4979-b95a-f86007891b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:47.538746 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29e04f-1557-4979-b95a-f86007891b1e admin admin] PATH_INFO: `/v3/projects/bd1c9c6e004f47a5bc1604795b1c765c/users/8c23fda268384915afa148448fde3169/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:47.561311 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a29e04f-1557-4979-b95a-f86007891b1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1c9c6e004f47a5bc1604795b1c765c, user_id=8c23fda268384915afa148448fde3169, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:47.564720 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a29e04f-1557-4979-b95a-f86007891b1e admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:47.690498 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1291/2582] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:08:47 2022] PUT /identity/v3/projects/bd1c9c6e004f47a5bc1604795b1c765c/users/8c23fda268384915afa148448fde3169/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:08:47.694603 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2069be1-bdad-40e8-8c67-6e7a4119a457 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:47.705744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2069be1-bdad-40e8-8c67-6e7a4119a457 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:47.775276 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea56c3-bbe7-4f35-b354-4752e7bd1c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:47.775887 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea56c3-bbe7-4f35-b354-4752e7bd1c5c admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:47.776210 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea56c3-bbe7-4f35-b354-4752e7bd1c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:47.776496 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea56c3-bbe7-4f35-b354-4752e7bd1c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:47.778089 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea56c3-bbe7-4f35-b354-4752e7bd1c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:47.779701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea56c3-bbe7-4f35-b354-4752e7bd1c5c admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:47.793465 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1292/2583] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:08:47 2022] GET /identity/v3/roles => generated 1427 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:08:47.798044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29e04f-1557-4979-b95a-f86007891b1e admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:47.808497 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29e04f-1557-4979-b95a-f86007891b1e admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:47.813278 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee9b14-5c33-461c-a70e-62f5e684cc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:47.814168 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee9b14-5c33-461c-a70e-62f5e684cc60 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:47.814457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee9b14-5c33-461c-a70e-62f5e684cc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:47.814732 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee9b14-5c33-461c-a70e-62f5e684cc60 admin admin] PATH_INFO: `/v3/projects/bd1c9c6e004f47a5bc1604795b1c765c/users/8c23fda268384915afa148448fde3169/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:47.817094 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee9b14-5c33-461c-a70e-62f5e684cc60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1c9c6e004f47a5bc1604795b1c765c, user_id=8c23fda268384915afa148448fde3169, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:47.819710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee9b14-5c33-461c-a70e-62f5e684cc60 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:47.832987 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1292/2584] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:08:47 2022] PUT /identity/v3/projects/bd1c9c6e004f47a5bc1604795b1c765c/users/8c23fda268384915afa148448fde3169/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:08:47.845815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8332557-e03d-4a44-97c8-ce357d6d05bd None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:47.846330 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8332557-e03d-4a44-97c8-ce357d6d05bd None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:47.846431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8332557-e03d-4a44-97c8-ce357d6d05bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:47.882799 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-a8332557-e03d-4a44-97c8-ce357d6d05bd None None] MFA Rules not processed for user `8c23fda268384915afa148448fde3169`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:47.883998 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-a8332557-e03d-4a44-97c8-ce357d6d05bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:47.951568 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1293/2585] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:47 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:08:47.963926 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee9b14-5c33-461c-a70e-62f5e684cc60 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:47.968511 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-d8ee9b14-5c33-461c-a70e-62f5e684cc60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:47.994150 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:48.024815 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee9b14-5c33-461c-a70e-62f5e684cc60 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:48.028749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15224e5c-035a-4a3f-a278-1300e803c676 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:48.029340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15224e5c-035a-4a3f-a278-1300e803c676 service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:48.029630 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15224e5c-035a-4a3f-a278-1300e803c676 service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:48.029913 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15224e5c-035a-4a3f-a278-1300e803c676 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:48.039931 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15224e5c-035a-4a3f-a278-1300e803c676 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:48.041541 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15224e5c-035a-4a3f-a278-1300e803c676 service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:48.051409 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1293/2586] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:08:47 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:08:49.709235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8332557-e03d-4a44-97c8-ce357d6d05bd None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:49.779889 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8332557-e03d-4a44-97c8-ce357d6d05bd None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:49.785467 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946c338-2474-456b-bdc9-7e44036d43da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:49.786372 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946c338-2474-456b-bdc9-7e44036d43da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:49.786670 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946c338-2474-456b-bdc9-7e44036d43da admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:49.786957 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946c338-2474-456b-bdc9-7e44036d43da admin admin] PATH_INFO: `/v3/users/a19f7ef0a0c247e7b8783761bddc2061` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:49.788204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946c338-2474-456b-bdc9-7e44036d43da admin admin] RBAC: Authorizing `identity:delete_user(user_id=a19f7ef0a0c247e7b8783761bddc2061)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:49.790259 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946c338-2474-456b-bdc9-7e44036d43da admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:49.814511 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:50.041887 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c946c338-2474-456b-bdc9-7e44036d43da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a19f7ef0a0c247e7b8783761bddc2061'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:50.055362 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c946c338-2474-456b-bdc9-7e44036d43da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a19f7ef0a0c247e7b8783761bddc2061'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:50.062975 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c946c338-2474-456b-bdc9-7e44036d43da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a19f7ef0a0c247e7b8783761bddc2061'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:50.063768 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c946c338-2474-456b-bdc9-7e44036d43da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a19f7ef0a0c247e7b8783761bddc2061'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:50.156365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c946c338-2474-456b-bdc9-7e44036d43da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a19f7ef0a0c247e7b8783761bddc2061'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:50.162776 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1294/2587] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:08:49 2022] DELETE /identity/v3/users/a19f7ef0a0c247e7b8783761bddc2061 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:08:50.167561 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6476e2-002e-43c7-9111-f346f69ea14a None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:50.168143 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6476e2-002e-43c7-9111-f346f69ea14a None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:50.168143 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6476e2-002e-43c7-9111-f346f69ea14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:50.185018 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-4d6476e2-002e-43c7-9111-f346f69ea14a None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:50.186325 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-4d6476e2-002e-43c7-9111-f346f69ea14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:50.247139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1294/2588] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:08:50.257340 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946c338-2474-456b-bdc9-7e44036d43da admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:50.258764 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-c946c338-2474-456b-bdc9-7e44036d43da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:50.318954 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946c338-2474-456b-bdc9-7e44036d43da admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:50.322612 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629805b2-31d9-47cb-bfcc-80362223b7e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:50.323264 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629805b2-31d9-47cb-bfcc-80362223b7e3 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:50.323549 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629805b2-31d9-47cb-bfcc-80362223b7e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:50.323822 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629805b2-31d9-47cb-bfcc-80362223b7e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:50.333571 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629805b2-31d9-47cb-bfcc-80362223b7e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:50.335012 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629805b2-31d9-47cb-bfcc-80362223b7e3 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:50.344936 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1295/2589] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:08:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:08:50.694558 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6476e2-002e-43c7-9111-f346f69ea14a None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:50.704885 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6476e2-002e-43c7-9111-f346f69ea14a None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:50.708587 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab80816-d286-478e-8dca-8a6d72ddc59f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:50.709271 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab80816-d286-478e-8dca-8a6d72ddc59f service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:50.709562 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab80816-d286-478e-8dca-8a6d72ddc59f service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:50.709844 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab80816-d286-478e-8dca-8a6d72ddc59f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:50.711605 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-fab80816-d286-478e-8dca-8a6d72ddc59f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:50.724831 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab80816-d286-478e-8dca-8a6d72ddc59f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:50.726411 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab80816-d286-478e-8dca-8a6d72ddc59f service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:50.737742 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1295/2590] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:08:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:08:50.861415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629805b2-31d9-47cb-bfcc-80362223b7e3 service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:50.862989 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-629805b2-31d9-47cb-bfcc-80362223b7e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:50.907371 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629805b2-31d9-47cb-bfcc-80362223b7e3 service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:50.907371 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29c4e1-4b2b-464a-96f3-0dde663becc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:50.907371 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29c4e1-4b2b-464a-96f3-0dde663becc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:50.907371 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29c4e1-4b2b-464a-96f3-0dde663becc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:50.908147 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29c4e1-4b2b-464a-96f3-0dde663becc8 admin admin] PATH_INFO: `/v3/projects/fe3071c146834d4ca401e892b4b8ff72` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:50.908147 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29c4e1-4b2b-464a-96f3-0dde663becc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe3071c146834d4ca401e892b4b8ff72)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:50.909641 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29c4e1-4b2b-464a-96f3-0dde663becc8 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:51.122480 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-7c29c4e1-4b2b-464a-96f3-0dde663becc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe3071c146834d4ca401e892b4b8ff72', 'request_id': 'req-7c29c4e1-4b2b-464a-96f3-0dde663becc8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:51.132652 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-7c29c4e1-4b2b-464a-96f3-0dde663becc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe3071c146834d4ca401e892b4b8ff72', 'request_id': 'req-7c29c4e1-4b2b-464a-96f3-0dde663becc8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:51.259554 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-7c29c4e1-4b2b-464a-96f3-0dde663becc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe3071c146834d4ca401e892b4b8ff72', 'request_id': 'req-7c29c4e1-4b2b-464a-96f3-0dde663becc8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:51.299848 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-7c29c4e1-4b2b-464a-96f3-0dde663becc8 admin admin] The token cache is being invalidate because project fe3071c146834d4ca401e892b4b8ff72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:08:51.300812 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-7c29c4e1-4b2b-464a-96f3-0dde663becc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:51.302333 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-7c29c4e1-4b2b-464a-96f3-0dde663becc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:51.305461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1296/2591] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:08:50 2022] DELETE /identity/v3/projects/fe3071c146834d4ca401e892b4b8ff72 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:08:51.311392 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab80816-d286-478e-8dca-8a6d72ddc59f service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:51.331075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab80816-d286-478e-8dca-8a6d72ddc59f service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:51.438288 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eaa976-ae9e-41a2-9218-8bc42ea6774b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:51.439190 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaa976-ae9e-41a2-9218-8bc42ea6774b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:51.439475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaa976-ae9e-41a2-9218-8bc42ea6774b admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:51.439902 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaa976-ae9e-41a2-9218-8bc42ea6774b admin admin] PATH_INFO: `/v3/users/8c23fda268384915afa148448fde3169` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:51.441161 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eaa976-ae9e-41a2-9218-8bc42ea6774b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c23fda268384915afa148448fde3169)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:51.444739 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eaa976-ae9e-41a2-9218-8bc42ea6774b admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:51.701776 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-23eaa976-ae9e-41a2-9218-8bc42ea6774b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c23fda268384915afa148448fde3169'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:51.702574 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-23eaa976-ae9e-41a2-9218-8bc42ea6774b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c23fda268384915afa148448fde3169'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:51.709948 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:51.715223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-23eaa976-ae9e-41a2-9218-8bc42ea6774b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c23fda268384915afa148448fde3169'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:51.723447 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-23eaa976-ae9e-41a2-9218-8bc42ea6774b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c23fda268384915afa148448fde3169'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:51.727221 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-23eaa976-ae9e-41a2-9218-8bc42ea6774b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c23fda268384915afa148448fde3169'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:51.853698 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1296/2592] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:08:51 2022] DELETE /identity/v3/users/8c23fda268384915afa148448fde3169 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:08:52.346855 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29c4e1-4b2b-464a-96f3-0dde663becc8 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:52.349349 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-7c29c4e1-4b2b-464a-96f3-0dde663becc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:52.365902 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29c4e1-4b2b-464a-96f3-0dde663becc8 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:52.397155 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:52.466996 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2a3b5-ef85-4e1d-af3c-3a55bf8acf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:52.468391 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2a3b5-ef85-4e1d-af3c-3a55bf8acf4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:52.468839 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2a3b5-ef85-4e1d-af3c-3a55bf8acf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:52.469357 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2a3b5-ef85-4e1d-af3c-3a55bf8acf4e admin admin] PATH_INFO: `/v3/projects/bd1c9c6e004f47a5bc1604795b1c765c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:52.471202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2a3b5-ef85-4e1d-af3c-3a55bf8acf4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd1c9c6e004f47a5bc1604795b1c765c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:52.473961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2a3b5-ef85-4e1d-af3c-3a55bf8acf4e admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:52.621806 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-add2a3b5-ef85-4e1d-af3c-3a55bf8acf4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd1c9c6e004f47a5bc1604795b1c765c', 'request_id': 'req-add2a3b5-ef85-4e1d-af3c-3a55bf8acf4e'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:52.629030 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-add2a3b5-ef85-4e1d-af3c-3a55bf8acf4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd1c9c6e004f47a5bc1604795b1c765c', 'request_id': 'req-add2a3b5-ef85-4e1d-af3c-3a55bf8acf4e'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:52.688330 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-add2a3b5-ef85-4e1d-af3c-3a55bf8acf4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd1c9c6e004f47a5bc1604795b1c765c', 'request_id': 'req-add2a3b5-ef85-4e1d-af3c-3a55bf8acf4e'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:52.699705 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-add2a3b5-ef85-4e1d-af3c-3a55bf8acf4e admin admin] The token cache is being invalidate because project bd1c9c6e004f47a5bc1604795b1c765c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:08:52.700134 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-add2a3b5-ef85-4e1d-af3c-3a55bf8acf4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:52.700751 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-add2a3b5-ef85-4e1d-af3c-3a55bf8acf4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:52.703070 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1297/2593] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:08:52 2022] DELETE /identity/v3/projects/bd1c9c6e004f47a5bc1604795b1c765c => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:08:52.708086 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4a001-d059-49a9-bbeb-8f40fc66d592 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:52.708615 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4a001-d059-49a9-bbeb-8f40fc66d592 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:52.708732 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4a001-d059-49a9-bbeb-8f40fc66d592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:52.729510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-14d4a001-d059-49a9-bbeb-8f40fc66d592 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:52.730744 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-14d4a001-d059-49a9-bbeb-8f40fc66d592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:52.813635 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1297/2594] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:08:52.821431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ef1d4-10d9-4935-866c-d95e0354888d None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:52.821801 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ef1d4-10d9-4935-866c-d95e0354888d None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:52.822153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ef1d4-10d9-4935-866c-d95e0354888d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:52.842607 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-2c8ef1d4-10d9-4935-866c-d95e0354888d None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:52.844379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-2c8ef1d4-10d9-4935-866c-d95e0354888d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:52.852445 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1298/2595] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:08:52.856843 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4a001-d059-49a9-bbeb-8f40fc66d592 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:52.867786 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4a001-d059-49a9-bbeb-8f40fc66d592 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:52.872619 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ed576-3a3a-4684-99f8-9f424afa7302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:52.873403 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ed576-3a3a-4684-99f8-9f424afa7302 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:52.873759 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ed576-3a3a-4684-99f8-9f424afa7302 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:52.874746 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ed576-3a3a-4684-99f8-9f424afa7302 admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:52.875509 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ed576-3a3a-4684-99f8-9f424afa7302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:08:52.875821 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ed576-3a3a-4684-99f8-9f424afa7302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:52.877475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ed576-3a3a-4684-99f8-9f424afa7302 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:52.889255 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1298/2596] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 16:08:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:08:52.893830 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ef1d4-10d9-4935-866c-d95e0354888d None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:52.903247 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ef1d4-10d9-4935-866c-d95e0354888d None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:52.908154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483894d-db70-4bf9-b5c5-a5ae725bd1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:52.908820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483894d-db70-4bf9-b5c5-a5ae725bd1e6 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:52.909107 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483894d-db70-4bf9-b5c5-a5ae725bd1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:52.909383 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483894d-db70-4bf9-b5c5-a5ae725bd1e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:52.910092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483894d-db70-4bf9-b5c5-a5ae725bd1e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:52.912011 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483894d-db70-4bf9-b5c5-a5ae725bd1e6 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:53.042464 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1299/2597] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:08:52 2022] POST /identity/v3/projects => generated 386 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:08:53.043769 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ed576-3a3a-4684-99f8-9f424afa7302 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:53.054921 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ed576-3a3a-4684-99f8-9f424afa7302 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:53.126549 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70612867-2e48-4586-9b9f-c5326c7b38fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:53.127303 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70612867-2e48-4586-9b9f-c5326c7b38fe admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:53.127621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70612867-2e48-4586-9b9f-c5326c7b38fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:53.127925 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70612867-2e48-4586-9b9f-c5326c7b38fe admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:53.128715 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70612867-2e48-4586-9b9f-c5326c7b38fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:53.130654 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70612867-2e48-4586-9b9f-c5326c7b38fe admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:53.237399 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1299/2598] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:08:53 2022] POST /identity/v3/users => generated 294 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:08:53.241514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483894d-db70-4bf9-b5c5-a5ae725bd1e6 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:53.252286 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483894d-db70-4bf9-b5c5-a5ae725bd1e6 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:53.257174 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3232a4-5fe6-43da-9e28-76ce32b194e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:53.257917 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3232a4-5fe6-43da-9e28-76ce32b194e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:53.258278 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3232a4-5fe6-43da-9e28-76ce32b194e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:53.258558 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3232a4-5fe6-43da-9e28-76ce32b194e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:53.259549 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3232a4-5fe6-43da-9e28-76ce32b194e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:53.261216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3232a4-5fe6-43da-9e28-76ce32b194e2 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:53.274807 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1300/2599] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:08:53 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:08:53.278595 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70612867-2e48-4586-9b9f-c5326c7b38fe admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:53.289831 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70612867-2e48-4586-9b9f-c5326c7b38fe admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:53.295013 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e795fa-19fb-4da1-8c9a-84c1a23bded7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:53.295988 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e795fa-19fb-4da1-8c9a-84c1a23bded7 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:53.297672 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e795fa-19fb-4da1-8c9a-84c1a23bded7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:53.304580 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e795fa-19fb-4da1-8c9a-84c1a23bded7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:53.304580 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e795fa-19fb-4da1-8c9a-84c1a23bded7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:53.304580 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e795fa-19fb-4da1-8c9a-84c1a23bded7 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:53.310977 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1300/2600] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:08:53 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:08:53.315798 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3232a4-5fe6-43da-9e28-76ce32b194e2 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:53.326590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3232a4-5fe6-43da-9e28-76ce32b194e2 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:53.337965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20e219-621c-49bc-af30-c814b763da10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:53.337965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20e219-621c-49bc-af30-c814b763da10 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:53.337965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20e219-621c-49bc-af30-c814b763da10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:53.337965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20e219-621c-49bc-af30-c814b763da10 admin admin] PATH_INFO: `/v3/projects/729d7d1a72d94af7b0229e3c760a08d1/users/b66b418fb5754691b7eae3d509231a4d/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:53.359569 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20e219-621c-49bc-af30-c814b763da10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=729d7d1a72d94af7b0229e3c760a08d1, user_id=b66b418fb5754691b7eae3d509231a4d, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:53.366254 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20e219-621c-49bc-af30-c814b763da10 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:53.472513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1301/2601] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:08:53 2022] PUT /identity/v3/projects/729d7d1a72d94af7b0229e3c760a08d1/users/b66b418fb5754691b7eae3d509231a4d/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:08:53.483558 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a455937-ac5d-4f73-95a0-07c9c8903443 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:53.483862 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a455937-ac5d-4f73-95a0-07c9c8903443 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:53.484255 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a455937-ac5d-4f73-95a0-07c9c8903443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:53.526539 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-9a455937-ac5d-4f73-95a0-07c9c8903443 None None] MFA Rules not processed for user `b66b418fb5754691b7eae3d509231a4d`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:53.526539 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-9a455937-ac5d-4f73-95a0-07c9c8903443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:53.559244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:53.596362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1301/2602] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:08:53.607646 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20e219-621c-49bc-af30-c814b763da10 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:53.610609 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-3b20e219-621c-49bc-af30-c814b763da10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:53.674867 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20e219-621c-49bc-af30-c814b763da10 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:53.678948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624d1f6-32b4-431e-ae42-e04b945017d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:53.679618 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624d1f6-32b4-431e-ae42-e04b945017d6 service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:53.679902 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624d1f6-32b4-431e-ae42-e04b945017d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:53.680288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624d1f6-32b4-431e-ae42-e04b945017d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:53.685982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:53.691449 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624d1f6-32b4-431e-ae42-e04b945017d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:53.692925 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624d1f6-32b4-431e-ae42-e04b945017d6 service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:53.703744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1302/2603] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:08:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:08:55.701846 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a455937-ac5d-4f73-95a0-07c9c8903443 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:55.703878 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-9a455937-ac5d-4f73-95a0-07c9c8903443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:55.761299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a455937-ac5d-4f73-95a0-07c9c8903443 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:55.765450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40178cbd-6e27-4e03-8b8c-834cd60548f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:55.766096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40178cbd-6e27-4e03-8b8c-834cd60548f8 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:55.766387 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40178cbd-6e27-4e03-8b8c-834cd60548f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:55.766667 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40178cbd-6e27-4e03-8b8c-834cd60548f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:55.768498 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-40178cbd-6e27-4e03-8b8c-834cd60548f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:55.833176 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40178cbd-6e27-4e03-8b8c-834cd60548f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:55.834648 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40178cbd-6e27-4e03-8b8c-834cd60548f8 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:55.840860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624d1f6-32b4-431e-ae42-e04b945017d6 service cinder] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:55.842403 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-7624d1f6-32b4-431e-ae42-e04b945017d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:55.846657 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1302/2604] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:08:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:08:55.918314 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624d1f6-32b4-431e-ae42-e04b945017d6 service cinder] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:55.923274 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae7342-feb3-486e-8840-50c5488440cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:55.936371 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae7342-feb3-486e-8840-50c5488440cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:55.936371 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae7342-feb3-486e-8840-50c5488440cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:55.936371 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae7342-feb3-486e-8840-50c5488440cb admin admin] PATH_INFO: `/v3/users/b0d02887422a43e4bb69566a2d64e890` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:55.936371 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae7342-feb3-486e-8840-50c5488440cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0d02887422a43e4bb69566a2d64e890)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:55.936371 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae7342-feb3-486e-8840-50c5488440cb admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:56.170422 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-3eae7342-feb3-486e-8840-50c5488440cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0d02887422a43e4bb69566a2d64e890'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:56.183325 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-3eae7342-feb3-486e-8840-50c5488440cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0d02887422a43e4bb69566a2d64e890'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:56.191325 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-3eae7342-feb3-486e-8840-50c5488440cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0d02887422a43e4bb69566a2d64e890'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:56.192046 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-3eae7342-feb3-486e-8840-50c5488440cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0d02887422a43e4bb69566a2d64e890'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:56.274936 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-3eae7342-feb3-486e-8840-50c5488440cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0d02887422a43e4bb69566a2d64e890'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:56.281864 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1303/2605] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:08:55 2022] DELETE /identity/v3/users/b0d02887422a43e4bb69566a2d64e890 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:08:56.549145 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40178cbd-6e27-4e03-8b8c-834cd60548f8 service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:56.563853 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40178cbd-6e27-4e03-8b8c-834cd60548f8 service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:56.689103 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55780f48-a8e8-49d6-925d-d897c6332e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:56.689103 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55780f48-a8e8-49d6-925d-d897c6332e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:56.689103 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55780f48-a8e8-49d6-925d-d897c6332e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:56.689103 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55780f48-a8e8-49d6-925d-d897c6332e71 admin admin] PATH_INFO: `/v3/projects/4941c3a4d1be445b972c8684bc8b18d0` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:56.689424 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55780f48-a8e8-49d6-925d-d897c6332e71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4941c3a4d1be445b972c8684bc8b18d0)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:56.689424 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55780f48-a8e8-49d6-925d-d897c6332e71 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:56.698002 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:56.882972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-55780f48-a8e8-49d6-925d-d897c6332e71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4941c3a4d1be445b972c8684bc8b18d0', 'request_id': 'req-55780f48-a8e8-49d6-925d-d897c6332e71'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:56.889241 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-55780f48-a8e8-49d6-925d-d897c6332e71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4941c3a4d1be445b972c8684bc8b18d0', 'request_id': 'req-55780f48-a8e8-49d6-925d-d897c6332e71'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:56.895628 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-55780f48-a8e8-49d6-925d-d897c6332e71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4941c3a4d1be445b972c8684bc8b18d0', 'request_id': 'req-55780f48-a8e8-49d6-925d-d897c6332e71'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:57.049750 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-55780f48-a8e8-49d6-925d-d897c6332e71 admin admin] The token cache is being invalidate because project 4941c3a4d1be445b972c8684bc8b18d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:08:57.050162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-55780f48-a8e8-49d6-925d-d897c6332e71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:57.050913 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-55780f48-a8e8-49d6-925d-d897c6332e71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:57.052863 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1303/2606] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:08:56 2022] DELETE /identity/v3/projects/4941c3a4d1be445b972c8684bc8b18d0 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:08:57.058481 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa188d1-f7ec-4d7c-8822-03f091346297 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:57.059121 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa188d1-f7ec-4d7c-8822-03f091346297 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:57.059476 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa188d1-f7ec-4d7c-8822-03f091346297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:57.083449 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-7fa188d1-f7ec-4d7c-8822-03f091346297 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:57.084720 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-7fa188d1-f7ec-4d7c-8822-03f091346297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:57.156537 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1304/2607] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:08:57.164811 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe92ca-2bd8-4aa0-98e2-077ac3060fdb None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:57.165187 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe92ca-2bd8-4aa0-98e2-077ac3060fdb None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:57.165547 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe92ca-2bd8-4aa0-98e2-077ac3060fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:57.184853 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-b1fe92ca-2bd8-4aa0-98e2-077ac3060fdb None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:57.186087 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-b1fe92ca-2bd8-4aa0-98e2-077ac3060fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:57.194739 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1304/2608] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:08:57.199047 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa188d1-f7ec-4d7c-8822-03f091346297 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:57.210101 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa188d1-f7ec-4d7c-8822-03f091346297 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:57.215448 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e02937-ce4d-4da1-a28c-2952618ca03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:57.217046 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e02937-ce4d-4da1-a28c-2952618ca03c admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:57.217046 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e02937-ce4d-4da1-a28c-2952618ca03c admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:57.217046 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e02937-ce4d-4da1-a28c-2952618ca03c admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:57.217609 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e02937-ce4d-4da1-a28c-2952618ca03c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:08:57.218085 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e02937-ce4d-4da1-a28c-2952618ca03c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:57.220183 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e02937-ce4d-4da1-a28c-2952618ca03c admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:57.229042 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:57.236572 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1305/2609] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 16:08:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:08:57.240965 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe92ca-2bd8-4aa0-98e2-077ac3060fdb None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:57.250869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe92ca-2bd8-4aa0-98e2-077ac3060fdb None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:57.255560 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2b4f8-4db6-44e4-aed0-556e1cd17f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:57.256282 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2b4f8-4db6-44e4-aed0-556e1cd17f07 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:57.256570 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2b4f8-4db6-44e4-aed0-556e1cd17f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:57.256849 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2b4f8-4db6-44e4-aed0-556e1cd17f07 admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:57.257551 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2b4f8-4db6-44e4-aed0-556e1cd17f07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:57.259493 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2b4f8-4db6-44e4-aed0-556e1cd17f07 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:57.341797 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1305/2610] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:08:57 2022] POST /identity/v3/projects => generated 386 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:08:57.348813 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e02937-ce4d-4da1-a28c-2952618ca03c admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:57.360618 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e02937-ce4d-4da1-a28c-2952618ca03c admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:57.440012 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b343483-6d3c-4c68-8f0d-9fa3aa39bfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:57.440950 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b343483-6d3c-4c68-8f0d-9fa3aa39bfe9 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:57.441241 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b343483-6d3c-4c68-8f0d-9fa3aa39bfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:57.441520 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b343483-6d3c-4c68-8f0d-9fa3aa39bfe9 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:57.442213 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b343483-6d3c-4c68-8f0d-9fa3aa39bfe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:57.444186 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b343483-6d3c-4c68-8f0d-9fa3aa39bfe9 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:57.553621 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1306/2611] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:08:57 2022] POST /identity/v3/users => generated 294 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:08:57.555024 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2b4f8-4db6-44e4-aed0-556e1cd17f07 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:57.565848 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2b4f8-4db6-44e4-aed0-556e1cd17f07 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:57.570590 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f316aae-4d0c-4797-a019-90c1965e9276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:57.571265 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f316aae-4d0c-4797-a019-90c1965e9276 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:57.571556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f316aae-4d0c-4797-a019-90c1965e9276 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:57.571869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f316aae-4d0c-4797-a019-90c1965e9276 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:57.572649 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f316aae-4d0c-4797-a019-90c1965e9276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:57.574261 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f316aae-4d0c-4797-a019-90c1965e9276 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:57.585759 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1306/2612] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:08:57 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:08:57.589747 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b343483-6d3c-4c68-8f0d-9fa3aa39bfe9 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:57.600846 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b343483-6d3c-4c68-8f0d-9fa3aa39bfe9 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:57.605539 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11e8fd-7245-420d-8bc9-55e349e3ad4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:57.606204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11e8fd-7245-420d-8bc9-55e349e3ad4a admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:57.606497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11e8fd-7245-420d-8bc9-55e349e3ad4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:57.606904 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11e8fd-7245-420d-8bc9-55e349e3ad4a admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:57.607637 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11e8fd-7245-420d-8bc9-55e349e3ad4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:57.609432 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11e8fd-7245-420d-8bc9-55e349e3ad4a admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:57.622979 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1307/2613] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:08:57 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:08:57.626030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f316aae-4d0c-4797-a019-90c1965e9276 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:57.637007 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f316aae-4d0c-4797-a019-90c1965e9276 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:57.643026 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd8d66-18a9-4b0f-bc59-e4d1d638ddbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:57.643996 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd8d66-18a9-4b0f-bc59-e4d1d638ddbf admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:57.644340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd8d66-18a9-4b0f-bc59-e4d1d638ddbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:57.644623 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd8d66-18a9-4b0f-bc59-e4d1d638ddbf admin admin] PATH_INFO: `/v3/projects/cc7a96296b9f4a8b90a33dae99521c99/users/aba6d6e3a5e34f53bc0b274f806984f6/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:57.660855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd8d66-18a9-4b0f-bc59-e4d1d638ddbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc7a96296b9f4a8b90a33dae99521c99, user_id=aba6d6e3a5e34f53bc0b274f806984f6, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:57.663512 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd8d66-18a9-4b0f-bc59-e4d1d638ddbf admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:57.740758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1307/2614] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:08:57 2022] PUT /identity/v3/projects/cc7a96296b9f4a8b90a33dae99521c99/users/aba6d6e3a5e34f53bc0b274f806984f6/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:08:57.751418 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf94bae-d0cc-4c8b-9493-bff226901d24 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:57.751804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf94bae-d0cc-4c8b-9493-bff226901d24 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:57.752188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf94bae-d0cc-4c8b-9493-bff226901d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:57.780894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-ecf94bae-d0cc-4c8b-9493-bff226901d24 None None] MFA Rules not processed for user `aba6d6e3a5e34f53bc0b274f806984f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:57.782744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-ecf94bae-d0cc-4c8b-9493-bff226901d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:57.866937 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1308/2615] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:08:57.878519 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd8d66-18a9-4b0f-bc59-e4d1d638ddbf admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:57.880661 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-1afd8d66-18a9-4b0f-bc59-e4d1d638ddbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:57.971170 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd8d66-18a9-4b0f-bc59-e4d1d638ddbf admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:57.977529 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0264f-4318-441d-a0af-e7bf494d23bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:57.980757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0264f-4318-441d-a0af-e7bf494d23bd service nova] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:57.980757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0264f-4318-441d-a0af-e7bf494d23bd service nova] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:57.980757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0264f-4318-441d-a0af-e7bf494d23bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:57.989808 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0264f-4318-441d-a0af-e7bf494d23bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:57.991582 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0264f-4318-441d-a0af-e7bf494d23bd service nova] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:58.004187 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1308/2616] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:08:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:08:58.135159 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf94bae-d0cc-4c8b-9493-bff226901d24 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:58.144600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-ecf94bae-d0cc-4c8b-9493-bff226901d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:58.218562 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf94bae-d0cc-4c8b-9493-bff226901d24 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:58.223989 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9afec2-38cf-4ba5-9884-d0f27c3b82e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:58.225102 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9afec2-38cf-4ba5-9884-d0f27c3b82e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:58.225302 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9afec2-38cf-4ba5-9884-d0f27c3b82e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:58.225758 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9afec2-38cf-4ba5-9884-d0f27c3b82e7 admin admin] PATH_INFO: `/v3/users/b66b418fb5754691b7eae3d509231a4d` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:58.226739 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9afec2-38cf-4ba5-9884-d0f27c3b82e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b66b418fb5754691b7eae3d509231a4d)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:58.228901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9afec2-38cf-4ba5-9884-d0f27c3b82e7 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:58.242895 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:58.417388 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-3f9afec2-38cf-4ba5-9884-d0f27c3b82e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b66b418fb5754691b7eae3d509231a4d'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:58.434634 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-3f9afec2-38cf-4ba5-9884-d0f27c3b82e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b66b418fb5754691b7eae3d509231a4d'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:58.444735 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-3f9afec2-38cf-4ba5-9884-d0f27c3b82e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b66b418fb5754691b7eae3d509231a4d'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:58.446694 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-3f9afec2-38cf-4ba5-9884-d0f27c3b82e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b66b418fb5754691b7eae3d509231a4d'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:58.517934 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-3f9afec2-38cf-4ba5-9884-d0f27c3b82e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b66b418fb5754691b7eae3d509231a4d'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:58.525916 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1309/2617] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:08:58 2022] DELETE /identity/v3/users/b66b418fb5754691b7eae3d509231a4d => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:08:58.530957 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345f6d5-4938-49cd-a6ce-a9b97e8e22ad None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:58.532053 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345f6d5-4938-49cd-a6ce-a9b97e8e22ad None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:58.532377 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345f6d5-4938-49cd-a6ce-a9b97e8e22ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:58.553238 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-e345f6d5-4938-49cd-a6ce-a9b97e8e22ad None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:58.554502 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-e345f6d5-4938-49cd-a6ce-a9b97e8e22ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:58.595564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:58.633036 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1309/2618] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:08:58.653268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9afec2-38cf-4ba5-9884-d0f27c3b82e7 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:58.655816 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-3f9afec2-38cf-4ba5-9884-d0f27c3b82e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:58.728932 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9afec2-38cf-4ba5-9884-d0f27c3b82e7 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:58.732658 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2be851-5c52-4f4c-9919-fb2659112590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:58.733325 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2be851-5c52-4f4c-9919-fb2659112590 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:58.734157 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2be851-5c52-4f4c-9919-fb2659112590 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:58.734922 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2be851-5c52-4f4c-9919-fb2659112590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:58.748963 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2be851-5c52-4f4c-9919-fb2659112590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:58.751385 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2be851-5c52-4f4c-9919-fb2659112590 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:58.763270 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1310/2619] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:08:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:08:59.181189 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345f6d5-4938-49cd-a6ce-a9b97e8e22ad None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:59.183183 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-e345f6d5-4938-49cd-a6ce-a9b97e8e22ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:59.197996 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345f6d5-4938-49cd-a6ce-a9b97e8e22ad None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:59.203572 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f05e5-64f2-46ca-b5c4-e52d328bf82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:59.204481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f05e5-64f2-46ca-b5c4-e52d328bf82f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:59.204767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f05e5-64f2-46ca-b5c4-e52d328bf82f admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:59.206141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f05e5-64f2-46ca-b5c4-e52d328bf82f admin admin] PATH_INFO: `/v3/projects/729d7d1a72d94af7b0229e3c760a08d1` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:59.207223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f05e5-64f2-46ca-b5c4-e52d328bf82f admin admin] RBAC: Authorizing `identity:delete_project(project_id=729d7d1a72d94af7b0229e3c760a08d1)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:59.209584 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f05e5-64f2-46ca-b5c4-e52d328bf82f admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:59.333835 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-647f05e5-64f2-46ca-b5c4-e52d328bf82f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '729d7d1a72d94af7b0229e3c760a08d1', 'request_id': 'req-647f05e5-64f2-46ca-b5c4-e52d328bf82f'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:59.340077 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-647f05e5-64f2-46ca-b5c4-e52d328bf82f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '729d7d1a72d94af7b0229e3c760a08d1', 'request_id': 'req-647f05e5-64f2-46ca-b5c4-e52d328bf82f'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:59.346611 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-647f05e5-64f2-46ca-b5c4-e52d328bf82f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '729d7d1a72d94af7b0229e3c760a08d1', 'request_id': 'req-647f05e5-64f2-46ca-b5c4-e52d328bf82f'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:59.444186 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-647f05e5-64f2-46ca-b5c4-e52d328bf82f admin admin] The token cache is being invalidate because project 729d7d1a72d94af7b0229e3c760a08d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:08:59.444440 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-647f05e5-64f2-46ca-b5c4-e52d328bf82f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:59.445027 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-647f05e5-64f2-46ca-b5c4-e52d328bf82f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:08:59.447616 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1310/2620] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:08:59 2022] DELETE /identity/v3/projects/729d7d1a72d94af7b0229e3c760a08d1 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:08:59.453331 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94dd8e5-ea2c-4987-adb5-2285925e862b None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:59.453847 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94dd8e5-ea2c-4987-adb5-2285925e862b None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:59.453976 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94dd8e5-ea2c-4987-adb5-2285925e862b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:59.475086 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-a94dd8e5-ea2c-4987-adb5-2285925e862b None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:59.476321 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-a94dd8e5-ea2c-4987-adb5-2285925e862b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:59.537884 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1311/2621] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:08:59.601199 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9d72d-fe5b-4973-bb58-985239624d77 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:59.601494 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9d72d-fe5b-4973-bb58-985239624d77 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:59.601852 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9d72d-fe5b-4973-bb58-985239624d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:59.620870 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-fda9d72d-fe5b-4973-bb58-985239624d77 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:08:59.622098 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-fda9d72d-fe5b-4973-bb58-985239624d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:08:59.630814 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1311/2622] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:08:59.635072 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94dd8e5-ea2c-4987-adb5-2285925e862b None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:59.645141 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94dd8e5-ea2c-4987-adb5-2285925e862b None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:59.649771 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728fe5a-f6a2-4878-839b-1dbf7a03b561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:59.650434 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728fe5a-f6a2-4878-839b-1dbf7a03b561 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:59.650724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728fe5a-f6a2-4878-839b-1dbf7a03b561 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:59.651005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728fe5a-f6a2-4878-839b-1dbf7a03b561 admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:59.651834 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728fe5a-f6a2-4878-839b-1dbf7a03b561 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:08:59.652046 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728fe5a-f6a2-4878-839b-1dbf7a03b561 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:59.653668 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728fe5a-f6a2-4878-839b-1dbf7a03b561 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:59.665478 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1312/2623] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 16:08:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:08:59.670094 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9d72d-fe5b-4973-bb58-985239624d77 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:59.679942 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9d72d-fe5b-4973-bb58-985239624d77 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:59.684609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bcec73-7b1b-43aa-8140-ed3620f650ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:59.687303 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bcec73-7b1b-43aa-8140-ed3620f650ad admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:59.687303 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bcec73-7b1b-43aa-8140-ed3620f650ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:59.687303 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bcec73-7b1b-43aa-8140-ed3620f650ad admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:59.687303 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bcec73-7b1b-43aa-8140-ed3620f650ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:59.688939 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bcec73-7b1b-43aa-8140-ed3620f650ad admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:08:59.763554 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1312/2624] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:08:59 2022] POST /identity/v3/projects => generated 364 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:08:59.767949 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728fe5a-f6a2-4878-839b-1dbf7a03b561 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:08:59.780323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728fe5a-f6a2-4878-839b-1dbf7a03b561 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:08:59.795291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:59.842668 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca59577-e031-4918-9584-e9113116e261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:08:59.844391 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca59577-e031-4918-9584-e9113116e261 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:08:59.844522 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca59577-e031-4918-9584-e9113116e261 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:08:59.844790 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca59577-e031-4918-9584-e9113116e261 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:08:59.845483 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca59577-e031-4918-9584-e9113116e261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:08:59.847406 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca59577-e031-4918-9584-e9113116e261 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:00.008303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1313/2625] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:08:59 2022] POST /identity/v3/users => generated 283 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:09:00.012629 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bcec73-7b1b-43aa-8140-ed3620f650ad admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:00.023271 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bcec73-7b1b-43aa-8140-ed3620f650ad admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:00.028051 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb21dd-1d7c-4629-95d5-b9f2ddc91f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:00.028816 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb21dd-1d7c-4629-95d5-b9f2ddc91f82 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:00.029108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb21dd-1d7c-4629-95d5-b9f2ddc91f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:00.029391 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb21dd-1d7c-4629-95d5-b9f2ddc91f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:00.030136 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb21dd-1d7c-4629-95d5-b9f2ddc91f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:00.032432 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb21dd-1d7c-4629-95d5-b9f2ddc91f82 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:00.043495 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1313/2626] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:09:00 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:09:00.048686 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca59577-e031-4918-9584-e9113116e261 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:00.059448 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca59577-e031-4918-9584-e9113116e261 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:00.064563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a723a10-294d-4019-88a5-24ecde41d8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:00.065240 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a723a10-294d-4019-88a5-24ecde41d8cf admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:00.065528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a723a10-294d-4019-88a5-24ecde41d8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:00.065810 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a723a10-294d-4019-88a5-24ecde41d8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:00.066541 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a723a10-294d-4019-88a5-24ecde41d8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:00.068397 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a723a10-294d-4019-88a5-24ecde41d8cf admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:00.080244 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1314/2627] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:09:00 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:09:00.084510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb21dd-1d7c-4629-95d5-b9f2ddc91f82 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:00.100210 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb21dd-1d7c-4629-95d5-b9f2ddc91f82 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:00.106484 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85cb24-e08a-4917-8337-bb9110cbd821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:00.110646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85cb24-e08a-4917-8337-bb9110cbd821 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:00.110646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85cb24-e08a-4917-8337-bb9110cbd821 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:00.110646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85cb24-e08a-4917-8337-bb9110cbd821 admin admin] PATH_INFO: `/v3/projects/4d9db4bcb01749699c4eea0adf80afea/users/9b066c20c564429887d49f28f6a7a70f/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:00.127910 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85cb24-e08a-4917-8337-bb9110cbd821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d9db4bcb01749699c4eea0adf80afea, user_id=9b066c20c564429887d49f28f6a7a70f, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:00.130674 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85cb24-e08a-4917-8337-bb9110cbd821 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:00.209021 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1314/2628] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:09:00 2022] PUT /identity/v3/projects/4d9db4bcb01749699c4eea0adf80afea/users/9b066c20c564429887d49f28f6a7a70f/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:00.255975 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a774bf-c960-41d5-8465-c43314f43e17 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:00.256322 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a774bf-c960-41d5-8465-c43314f43e17 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:00.256612 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a774bf-c960-41d5-8465-c43314f43e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:00.284128 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-56a774bf-c960-41d5-8465-c43314f43e17 None None] MFA Rules not processed for user `9b066c20c564429887d49f28f6a7a70f`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:00.285273 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-56a774bf-c960-41d5-8465-c43314f43e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:00.350347 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1315/2629] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:09:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:00.361938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85cb24-e08a-4917-8337-bb9110cbd821 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:00.363696 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-7c85cb24-e08a-4917-8337-bb9110cbd821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:00.425753 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85cb24-e08a-4917-8337-bb9110cbd821 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:00.429596 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778cac1-4e93-4ef3-ba2f-40339afde7d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:00.430219 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778cac1-4e93-4ef3-ba2f-40339afde7d8 service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:00.430565 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778cac1-4e93-4ef3-ba2f-40339afde7d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:00.430948 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778cac1-4e93-4ef3-ba2f-40339afde7d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:00.438631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:00.444758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778cac1-4e93-4ef3-ba2f-40339afde7d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:00.451543 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778cac1-4e93-4ef3-ba2f-40339afde7d8 service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:00.459255 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1315/2630] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:09:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:09:10.347333 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=58,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:10.533736 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:11.478946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a774bf-c960-41d5-8465-c43314f43e17 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:11.478946 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-56a774bf-c960-41d5-8465-c43314f43e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:11.546857 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a774bf-c960-41d5-8465-c43314f43e17 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:11.551587 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe016d-2d15-4d9c-a677-23b710b111b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:11.552505 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe016d-2d15-4d9c-a677-23b710b111b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:11.552796 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe016d-2d15-4d9c-a677-23b710b111b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:11.553072 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe016d-2d15-4d9c-a677-23b710b111b4 admin admin] PATH_INFO: `/v3/users/aba6d6e3a5e34f53bc0b274f806984f6` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:11.554384 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe016d-2d15-4d9c-a677-23b710b111b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba6d6e3a5e34f53bc0b274f806984f6)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:11.556410 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe016d-2d15-4d9c-a677-23b710b111b4 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:11.810879 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-57fe016d-2d15-4d9c-a677-23b710b111b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba6d6e3a5e34f53bc0b274f806984f6'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:11.837633 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-57fe016d-2d15-4d9c-a677-23b710b111b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba6d6e3a5e34f53bc0b274f806984f6'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:11.846070 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-57fe016d-2d15-4d9c-a677-23b710b111b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba6d6e3a5e34f53bc0b274f806984f6'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:11.846908 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-57fe016d-2d15-4d9c-a677-23b710b111b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba6d6e3a5e34f53bc0b274f806984f6'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:11.956315 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-57fe016d-2d15-4d9c-a677-23b710b111b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba6d6e3a5e34f53bc0b274f806984f6'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:11.963584 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1316/2631] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:09:11 2022] DELETE /identity/v3/users/aba6d6e3a5e34f53bc0b274f806984f6 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:11.967933 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d718c8e-874d-4957-ae8d-3f4ecfa619f4 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:11.968725 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d718c8e-874d-4957-ae8d-3f4ecfa619f4 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:11.968836 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d718c8e-874d-4957-ae8d-3f4ecfa619f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:11.987677 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-6d718c8e-874d-4957-ae8d-3f4ecfa619f4 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:11.989054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-6d718c8e-874d-4957-ae8d-3f4ecfa619f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:12.054499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1316/2632] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:09:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:12.060920 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe016d-2d15-4d9c-a677-23b710b111b4 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:12.062431 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-57fe016d-2d15-4d9c-a677-23b710b111b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:12.120557 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe016d-2d15-4d9c-a677-23b710b111b4 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:12.124192 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ef994-b4f7-4e78-bcc8-704611733ffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:12.124841 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ef994-b4f7-4e78-bcc8-704611733ffc service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:12.125127 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ef994-b4f7-4e78-bcc8-704611733ffc service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:12.125407 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ef994-b4f7-4e78-bcc8-704611733ffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:12.134714 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ef994-b4f7-4e78-bcc8-704611733ffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:12.136159 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ef994-b4f7-4e78-bcc8-704611733ffc service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:12.147336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1317/2633] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:09:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:09:12.671523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d718c8e-874d-4957-ae8d-3f4ecfa619f4 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:12.672986 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-6d718c8e-874d-4957-ae8d-3f4ecfa619f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:12.685263 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d718c8e-874d-4957-ae8d-3f4ecfa619f4 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:12.691031 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49285b-fe12-45a8-8c46-8a1b606d2249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:12.692008 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49285b-fe12-45a8-8c46-8a1b606d2249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:12.692322 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49285b-fe12-45a8-8c46-8a1b606d2249 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:12.693143 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49285b-fe12-45a8-8c46-8a1b606d2249 admin admin] PATH_INFO: `/v3/projects/cc7a96296b9f4a8b90a33dae99521c99` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:12.693792 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49285b-fe12-45a8-8c46-8a1b606d2249 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc7a96296b9f4a8b90a33dae99521c99)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:12.695727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49285b-fe12-45a8-8c46-8a1b606d2249 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:12.802397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5b49285b-fe12-45a8-8c46-8a1b606d2249 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc7a96296b9f4a8b90a33dae99521c99', 'request_id': 'req-5b49285b-fe12-45a8-8c46-8a1b606d2249'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:12.808795 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5b49285b-fe12-45a8-8c46-8a1b606d2249 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc7a96296b9f4a8b90a33dae99521c99', 'request_id': 'req-5b49285b-fe12-45a8-8c46-8a1b606d2249'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:12.815008 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5b49285b-fe12-45a8-8c46-8a1b606d2249 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc7a96296b9f4a8b90a33dae99521c99', 'request_id': 'req-5b49285b-fe12-45a8-8c46-8a1b606d2249'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:12.921506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5b49285b-fe12-45a8-8c46-8a1b606d2249 admin admin] The token cache is being invalidate because project cc7a96296b9f4a8b90a33dae99521c99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:09:12.921729 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5b49285b-fe12-45a8-8c46-8a1b606d2249 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:12.922382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5b49285b-fe12-45a8-8c46-8a1b606d2249 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:12.926179 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1317/2634] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:09:12 2022] DELETE /identity/v3/projects/cc7a96296b9f4a8b90a33dae99521c99 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:12.929586 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e6bce-4ad1-4243-bc17-aff95c02d3a6 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:12.930072 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e6bce-4ad1-4243-bc17-aff95c02d3a6 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:12.930179 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e6bce-4ad1-4243-bc17-aff95c02d3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:12.948965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-624e6bce-4ad1-4243-bc17-aff95c02d3a6 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:12.950157 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-624e6bce-4ad1-4243-bc17-aff95c02d3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:12.968871 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:13.013994 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1318/2635] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:09:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:13.023325 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b8054-edbb-4b2e-8d52-a741fdf5159a None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:13.023967 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b8054-edbb-4b2e-8d52-a741fdf5159a None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:13.023967 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b8054-edbb-4b2e-8d52-a741fdf5159a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:13.043458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-9d1b8054-edbb-4b2e-8d52-a741fdf5159a None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:13.044848 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-9d1b8054-edbb-4b2e-8d52-a741fdf5159a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:13.053340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1318/2636] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:09:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:13.058020 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e6bce-4ad1-4243-bc17-aff95c02d3a6 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:13.068748 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e6bce-4ad1-4243-bc17-aff95c02d3a6 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:13.073690 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06dbb10-afad-4da8-96c4-aac163bffdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:13.081218 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06dbb10-afad-4da8-96c4-aac163bffdbf admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:13.081218 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06dbb10-afad-4da8-96c4-aac163bffdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:13.081218 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06dbb10-afad-4da8-96c4-aac163bffdbf admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:13.081218 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06dbb10-afad-4da8-96c4-aac163bffdbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:09:13.081218 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06dbb10-afad-4da8-96c4-aac163bffdbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:13.081218 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06dbb10-afad-4da8-96c4-aac163bffdbf admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:13.091284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1319/2637] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 16:09:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:09:13.096487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b8054-edbb-4b2e-8d52-a741fdf5159a None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:13.105850 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b8054-edbb-4b2e-8d52-a741fdf5159a None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:13.110707 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23799f62-89ee-41d0-84dd-bff3d1373405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:13.112703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23799f62-89ee-41d0-84dd-bff3d1373405 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:13.112703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23799f62-89ee-41d0-84dd-bff3d1373405 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:13.112703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23799f62-89ee-41d0-84dd-bff3d1373405 admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:13.113043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23799f62-89ee-41d0-84dd-bff3d1373405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:13.114752 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23799f62-89ee-41d0-84dd-bff3d1373405 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:13.198473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1319/2638] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:09:13 2022] POST /identity/v3/projects => generated 374 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:09:13.200878 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06dbb10-afad-4da8-96c4-aac163bffdbf admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:13.211648 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06dbb10-afad-4da8-96c4-aac163bffdbf admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:13.269379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9de11-0376-46eb-acc0-6ebc4e6b2db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:13.270048 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9de11-0376-46eb-acc0-6ebc4e6b2db3 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:13.270339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9de11-0376-46eb-acc0-6ebc4e6b2db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:13.270623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9de11-0376-46eb-acc0-6ebc4e6b2db3 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:13.271324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac9de11-0376-46eb-acc0-6ebc4e6b2db3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:13.273317 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac9de11-0376-46eb-acc0-6ebc4e6b2db3 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:13.368150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1320/2639] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:09:13 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:09:13.372340 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23799f62-89ee-41d0-84dd-bff3d1373405 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:13.383556 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23799f62-89ee-41d0-84dd-bff3d1373405 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:13.388229 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febde17d-653c-46bd-88f4-70083b919153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:13.388895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febde17d-653c-46bd-88f4-70083b919153 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:13.389240 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febde17d-653c-46bd-88f4-70083b919153 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:13.389512 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febde17d-653c-46bd-88f4-70083b919153 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:13.390242 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febde17d-653c-46bd-88f4-70083b919153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:13.391846 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febde17d-653c-46bd-88f4-70083b919153 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:13.402965 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1320/2640] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:09:13 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:09:13.407212 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9de11-0376-46eb-acc0-6ebc4e6b2db3 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:13.417232 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9de11-0376-46eb-acc0-6ebc4e6b2db3 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:13.421911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cdcfb-b65e-4876-bc41-db330ca5af56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:13.422586 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cdcfb-b65e-4876-bc41-db330ca5af56 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:13.422877 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cdcfb-b65e-4876-bc41-db330ca5af56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:13.423184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cdcfb-b65e-4876-bc41-db330ca5af56 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:13.424046 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cdcfb-b65e-4876-bc41-db330ca5af56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:13.425712 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cdcfb-b65e-4876-bc41-db330ca5af56 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:13.435832 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1321/2641] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:09:13 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:09:13.440827 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febde17d-653c-46bd-88f4-70083b919153 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:13.452027 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febde17d-653c-46bd-88f4-70083b919153 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:13.458443 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f89c2d-56c2-4aad-900d-8e6169170376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:13.459328 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f89c2d-56c2-4aad-900d-8e6169170376 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:13.459621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f89c2d-56c2-4aad-900d-8e6169170376 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:13.459905 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f89c2d-56c2-4aad-900d-8e6169170376 admin admin] PATH_INFO: `/v3/projects/d31091e194724daab5bf8408da73ca40/users/29b6eb51d3054ff7a4100547dbc7a185/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:13.475070 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f89c2d-56c2-4aad-900d-8e6169170376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d31091e194724daab5bf8408da73ca40, user_id=29b6eb51d3054ff7a4100547dbc7a185, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:13.477762 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f89c2d-56c2-4aad-900d-8e6169170376 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:13.579166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1321/2642] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:09:13 2022] PUT /identity/v3/projects/d31091e194724daab5bf8408da73ca40/users/29b6eb51d3054ff7a4100547dbc7a185/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:13.591613 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8f23f-7890-4e39-a78a-5086e35d4522 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:13.591913 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8f23f-7890-4e39-a78a-5086e35d4522 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:13.592236 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8f23f-7890-4e39-a78a-5086e35d4522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:13.618848 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-54f8f23f-7890-4e39-a78a-5086e35d4522 None None] MFA Rules not processed for user `29b6eb51d3054ff7a4100547dbc7a185`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:13.620062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-54f8f23f-7890-4e39-a78a-5086e35d4522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:13.683961 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1322/2643] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:09:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:13.688427 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f89c2d-56c2-4aad-900d-8e6169170376 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:13.710002 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:13.750738 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f89c2d-56c2-4aad-900d-8e6169170376 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:13.756026 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7377d-87b0-4b6f-a599-635154ac27bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:13.756857 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7377d-87b0-4b6f-a599-635154ac27bb admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:13.757081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7377d-87b0-4b6f-a599-635154ac27bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:13.757368 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7377d-87b0-4b6f-a599-635154ac27bb admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:13.758059 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7377d-87b0-4b6f-a599-635154ac27bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:13.759965 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7377d-87b0-4b6f-a599-635154ac27bb admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:13.877876 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1322/2644] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:09:13 2022] POST /identity/v3/projects => generated 374 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:09:13.881903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8f23f-7890-4e39-a78a-5086e35d4522 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:13.892947 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8f23f-7890-4e39-a78a-5086e35d4522 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:13.905952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:13.952308 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf9933-c0f2-4c17-93d2-eafe1e2cb84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:13.952992 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf9933-c0f2-4c17-93d2-eafe1e2cb84c admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:13.953281 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf9933-c0f2-4c17-93d2-eafe1e2cb84c admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:13.953564 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf9933-c0f2-4c17-93d2-eafe1e2cb84c admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:13.954272 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf9933-c0f2-4c17-93d2-eafe1e2cb84c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:13.956582 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf9933-c0f2-4c17-93d2-eafe1e2cb84c admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:14.070998 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1323/2645] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:09:13 2022] POST /identity/v3/users => generated 294 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:09:14.075073 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7377d-87b0-4b6f-a599-635154ac27bb admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:14.085542 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7377d-87b0-4b6f-a599-635154ac27bb admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:14.090211 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482dea5-728d-49ec-ab79-2808b07ee25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:14.090876 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482dea5-728d-49ec-ab79-2808b07ee25a admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:14.091166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482dea5-728d-49ec-ab79-2808b07ee25a admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:14.091452 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482dea5-728d-49ec-ab79-2808b07ee25a admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:14.092213 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482dea5-728d-49ec-ab79-2808b07ee25a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:14.094108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482dea5-728d-49ec-ab79-2808b07ee25a admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:14.106118 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1323/2646] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:09:14 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:09:14.110666 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf9933-c0f2-4c17-93d2-eafe1e2cb84c admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:14.121770 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf9933-c0f2-4c17-93d2-eafe1e2cb84c admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:14.126949 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91bf3d-4887-4066-8246-d355c2b5c1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:14.128119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91bf3d-4887-4066-8246-d355c2b5c1a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:14.131784 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91bf3d-4887-4066-8246-d355c2b5c1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:14.131784 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91bf3d-4887-4066-8246-d355c2b5c1a5 admin admin] PATH_INFO: `/v3/projects/4b6684556e204154addb78e0fcd5b4da/users/8c45baf9467e4d0f88e65dc57add70fa/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:14.144362 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91bf3d-4887-4066-8246-d355c2b5c1a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b6684556e204154addb78e0fcd5b4da, user_id=8c45baf9467e4d0f88e65dc57add70fa, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:14.147135 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91bf3d-4887-4066-8246-d355c2b5c1a5 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:14.237408 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1324/2647] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:09:14 2022] PUT /identity/v3/projects/4b6684556e204154addb78e0fcd5b4da/users/8c45baf9467e4d0f88e65dc57add70fa/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:14.241370 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482dea5-728d-49ec-ab79-2808b07ee25a admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:14.251336 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482dea5-728d-49ec-ab79-2808b07ee25a admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:14.309807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b964a-8dd7-45ea-a7b5-5a9ccc6acaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:14.310503 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b964a-8dd7-45ea-a7b5-5a9ccc6acaf8 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:14.310790 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b964a-8dd7-45ea-a7b5-5a9ccc6acaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:14.311087 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b964a-8dd7-45ea-a7b5-5a9ccc6acaf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:14.311853 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b964a-8dd7-45ea-a7b5-5a9ccc6acaf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:14.313676 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b964a-8dd7-45ea-a7b5-5a9ccc6acaf8 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:14.323828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1324/2648] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:09:14 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:09:14.328077 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91bf3d-4887-4066-8246-d355c2b5c1a5 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:14.338532 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91bf3d-4887-4066-8246-d355c2b5c1a5 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:14.343774 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d0bce-c20d-4f16-991b-cbe947900081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:14.344783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d0bce-c20d-4f16-991b-cbe947900081 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:14.345095 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d0bce-c20d-4f16-991b-cbe947900081 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:14.345376 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d0bce-c20d-4f16-991b-cbe947900081 admin admin] PATH_INFO: `/v3/projects/4b6684556e204154addb78e0fcd5b4da/users/8c45baf9467e4d0f88e65dc57add70fa/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:14.348070 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d0bce-c20d-4f16-991b-cbe947900081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b6684556e204154addb78e0fcd5b4da, user_id=8c45baf9467e4d0f88e65dc57add70fa, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:14.352227 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d0bce-c20d-4f16-991b-cbe947900081 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:14.362744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1325/2649] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:09:14 2022] PUT /identity/v3/projects/4b6684556e204154addb78e0fcd5b4da/users/8c45baf9467e4d0f88e65dc57add70fa/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:14.372936 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b412a53-943d-4468-bdf1-99d7c0834c1c None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:14.373640 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b412a53-943d-4468-bdf1-99d7c0834c1c None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:14.373640 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b412a53-943d-4468-bdf1-99d7c0834c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:14.400243 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-5b412a53-943d-4468-bdf1-99d7c0834c1c None None] MFA Rules not processed for user `8c45baf9467e4d0f88e65dc57add70fa`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:14.401495 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-5b412a53-943d-4468-bdf1-99d7c0834c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:14.484459 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1325/2650] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:09:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:14.499997 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d0bce-c20d-4f16-991b-cbe947900081 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:14.502117 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-c58d0bce-c20d-4f16-991b-cbe947900081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:14.564438 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d0bce-c20d-4f16-991b-cbe947900081 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:14.568089 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a1066-c6dc-48a6-ba3b-2f870f5bba9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:14.568761 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a1066-c6dc-48a6-ba3b-2f870f5bba9a service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:14.569049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a1066-c6dc-48a6-ba3b-2f870f5bba9a service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:14.569329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a1066-c6dc-48a6-ba3b-2f870f5bba9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:14.578212 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a1066-c6dc-48a6-ba3b-2f870f5bba9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:14.579674 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a1066-c6dc-48a6-ba3b-2f870f5bba9a service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:14.590130 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1326/2651] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:09:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:09:15.488385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b412a53-943d-4468-bdf1-99d7c0834c1c None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:15.505785 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:15.553607 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b412a53-943d-4468-bdf1-99d7c0834c1c None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:15.558145 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a07e31-3ee4-474c-9d7d-d1659de6751b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:15.559017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a07e31-3ee4-474c-9d7d-d1659de6751b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:15.559305 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a07e31-3ee4-474c-9d7d-d1659de6751b admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:15.559586 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a07e31-3ee4-474c-9d7d-d1659de6751b admin admin] PATH_INFO: `/v3/users/29b6eb51d3054ff7a4100547dbc7a185` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:15.560829 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a07e31-3ee4-474c-9d7d-d1659de6751b admin admin] RBAC: Authorizing `identity:delete_user(user_id=29b6eb51d3054ff7a4100547dbc7a185)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:15.562769 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a07e31-3ee4-474c-9d7d-d1659de6751b admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:15.804636 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-46a07e31-3ee4-474c-9d7d-d1659de6751b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29b6eb51d3054ff7a4100547dbc7a185'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:15.805216 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-46a07e31-3ee4-474c-9d7d-d1659de6751b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29b6eb51d3054ff7a4100547dbc7a185'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:15.817441 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-46a07e31-3ee4-474c-9d7d-d1659de6751b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29b6eb51d3054ff7a4100547dbc7a185'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:15.824348 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-46a07e31-3ee4-474c-9d7d-d1659de6751b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29b6eb51d3054ff7a4100547dbc7a185'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:15.824988 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-46a07e31-3ee4-474c-9d7d-d1659de6751b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29b6eb51d3054ff7a4100547dbc7a185'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:15.894820 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1326/2652] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:09:15 2022] DELETE /identity/v3/users/29b6eb51d3054ff7a4100547dbc7a185 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:15.899522 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc39a5d-367c-4539-8f40-bb8d64987fe2 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:15.900092 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc39a5d-367c-4539-8f40-bb8d64987fe2 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:15.900540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc39a5d-367c-4539-8f40-bb8d64987fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:15.918965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-1bc39a5d-367c-4539-8f40-bb8d64987fe2 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:15.920190 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-1bc39a5d-367c-4539-8f40-bb8d64987fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:15.981193 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1327/2653] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:15.995933 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a07e31-3ee4-474c-9d7d-d1659de6751b admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:15.997551 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-46a07e31-3ee4-474c-9d7d-d1659de6751b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:16.055335 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a07e31-3ee4-474c-9d7d-d1659de6751b admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:16.058851 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70e6d4-2c72-40d8-8901-b4371cdc64b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:16.059499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70e6d4-2c72-40d8-8901-b4371cdc64b9 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:16.059791 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70e6d4-2c72-40d8-8901-b4371cdc64b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:16.060076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70e6d4-2c72-40d8-8901-b4371cdc64b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:16.069818 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70e6d4-2c72-40d8-8901-b4371cdc64b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:16.071262 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70e6d4-2c72-40d8-8901-b4371cdc64b9 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:16.081099 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1327/2654] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:09:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:09:16.512338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc39a5d-367c-4539-8f40-bb8d64987fe2 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:16.515870 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-1bc39a5d-367c-4539-8f40-bb8d64987fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:16.528935 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc39a5d-367c-4539-8f40-bb8d64987fe2 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:16.534437 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971baa8-8935-4846-8357-1c75af98ca15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:16.535309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971baa8-8935-4846-8357-1c75af98ca15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:16.535597 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971baa8-8935-4846-8357-1c75af98ca15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:16.535872 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971baa8-8935-4846-8357-1c75af98ca15 admin admin] PATH_INFO: `/v3/projects/d31091e194724daab5bf8408da73ca40` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:16.537109 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971baa8-8935-4846-8357-1c75af98ca15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d31091e194724daab5bf8408da73ca40)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:16.539262 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971baa8-8935-4846-8357-1c75af98ca15 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:16.548867 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:16.682109 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-e971baa8-8935-4846-8357-1c75af98ca15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd31091e194724daab5bf8408da73ca40', 'request_id': 'req-e971baa8-8935-4846-8357-1c75af98ca15'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:16.688441 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-e971baa8-8935-4846-8357-1c75af98ca15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd31091e194724daab5bf8408da73ca40', 'request_id': 'req-e971baa8-8935-4846-8357-1c75af98ca15'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:16.813483 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-e971baa8-8935-4846-8357-1c75af98ca15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd31091e194724daab5bf8408da73ca40', 'request_id': 'req-e971baa8-8935-4846-8357-1c75af98ca15'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:16.825156 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-e971baa8-8935-4846-8357-1c75af98ca15 admin admin] The token cache is being invalidate because project d31091e194724daab5bf8408da73ca40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:09:16.825449 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-e971baa8-8935-4846-8357-1c75af98ca15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:16.826083 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-e971baa8-8935-4846-8357-1c75af98ca15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:16.827679 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1328/2655] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:09:16 2022] DELETE /identity/v3/projects/d31091e194724daab5bf8408da73ca40 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:16.832471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70e6d4-2c72-40d8-8901-b4371cdc64b9 service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:16.858703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70e6d4-2c72-40d8-8901-b4371cdc64b9 service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:16.875434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:16.898055 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d87654-3798-4bbc-bb4a-573d31fd2ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:16.898937 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d87654-3798-4bbc-bb4a-573d31fd2ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:16.899224 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d87654-3798-4bbc-bb4a-573d31fd2ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:16.899506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d87654-3798-4bbc-bb4a-573d31fd2ff0 admin admin] PATH_INFO: `/v3/users/8c45baf9467e4d0f88e65dc57add70fa` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:16.900727 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d87654-3798-4bbc-bb4a-573d31fd2ff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c45baf9467e4d0f88e65dc57add70fa)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:16.902649 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d87654-3798-4bbc-bb4a-573d31fd2ff0 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:17.181175 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-46d87654-3798-4bbc-bb4a-573d31fd2ff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c45baf9467e4d0f88e65dc57add70fa'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:17.181858 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-46d87654-3798-4bbc-bb4a-573d31fd2ff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c45baf9467e4d0f88e65dc57add70fa'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:17.195219 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-46d87654-3798-4bbc-bb4a-573d31fd2ff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c45baf9467e4d0f88e65dc57add70fa'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:17.202155 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-46d87654-3798-4bbc-bb4a-573d31fd2ff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c45baf9467e4d0f88e65dc57add70fa'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:17.202898 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-46d87654-3798-4bbc-bb4a-573d31fd2ff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c45baf9467e4d0f88e65dc57add70fa'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:17.287799 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1328/2656] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:09:16 2022] DELETE /identity/v3/users/8c45baf9467e4d0f88e65dc57add70fa => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:17.747093 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971baa8-8935-4846-8357-1c75af98ca15 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:17.748648 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-e971baa8-8935-4846-8357-1c75af98ca15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:17.762326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971baa8-8935-4846-8357-1c75af98ca15 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:17.820243 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3226dd-6cc2-43e0-ae5e-0751fdcda5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:17.821123 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3226dd-6cc2-43e0-ae5e-0751fdcda5aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:17.821416 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3226dd-6cc2-43e0-ae5e-0751fdcda5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:17.821702 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3226dd-6cc2-43e0-ae5e-0751fdcda5aa admin admin] PATH_INFO: `/v3/projects/4b6684556e204154addb78e0fcd5b4da` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:17.822895 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3226dd-6cc2-43e0-ae5e-0751fdcda5aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b6684556e204154addb78e0fcd5b4da)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:17.824868 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3226dd-6cc2-43e0-ae5e-0751fdcda5aa admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:17.950713 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-6c3226dd-6cc2-43e0-ae5e-0751fdcda5aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b6684556e204154addb78e0fcd5b4da', 'request_id': 'req-6c3226dd-6cc2-43e0-ae5e-0751fdcda5aa'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:17.956988 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-6c3226dd-6cc2-43e0-ae5e-0751fdcda5aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b6684556e204154addb78e0fcd5b4da', 'request_id': 'req-6c3226dd-6cc2-43e0-ae5e-0751fdcda5aa'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:18.030559 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-6c3226dd-6cc2-43e0-ae5e-0751fdcda5aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b6684556e204154addb78e0fcd5b4da', 'request_id': 'req-6c3226dd-6cc2-43e0-ae5e-0751fdcda5aa'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:18.042094 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-6c3226dd-6cc2-43e0-ae5e-0751fdcda5aa admin admin] The token cache is being invalidate because project 4b6684556e204154addb78e0fcd5b4da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:09:18.042791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-6c3226dd-6cc2-43e0-ae5e-0751fdcda5aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:18.043126 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-6c3226dd-6cc2-43e0-ae5e-0751fdcda5aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:18.044724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1329/2657] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:09:17 2022] DELETE /identity/v3/projects/4b6684556e204154addb78e0fcd5b4da => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:18.049642 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15388024-99db-411c-abfc-c3b56747f176 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:18.050118 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15388024-99db-411c-abfc-c3b56747f176 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:18.050245 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15388024-99db-411c-abfc-c3b56747f176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:18.068736 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-15388024-99db-411c-abfc-c3b56747f176 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:18.069956 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-15388024-99db-411c-abfc-c3b56747f176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:18.130004 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1329/2658] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:18.137955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51bb1d-3068-45a6-96a9-678779785803 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:18.138250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51bb1d-3068-45a6-96a9-678779785803 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:18.138531 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51bb1d-3068-45a6-96a9-678779785803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:18.158703 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-7a51bb1d-3068-45a6-96a9-678779785803 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:18.160562 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-7a51bb1d-3068-45a6-96a9-678779785803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:18.168536 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1330/2659] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:18.172819 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15388024-99db-411c-abfc-c3b56747f176 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:18.182603 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15388024-99db-411c-abfc-c3b56747f176 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:18.187412 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b7e75-3f79-41b4-8622-733cdb8a658e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:18.188074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b7e75-3f79-41b4-8622-733cdb8a658e admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:18.188418 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b7e75-3f79-41b4-8622-733cdb8a658e admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:18.188717 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b7e75-3f79-41b4-8622-733cdb8a658e admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:18.189444 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b7e75-3f79-41b4-8622-733cdb8a658e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:09:18.189754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b7e75-3f79-41b4-8622-733cdb8a658e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:18.191394 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b7e75-3f79-41b4-8622-733cdb8a658e admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:18.203027 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1330/2660] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 16:09:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:09:18.209502 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51bb1d-3068-45a6-96a9-678779785803 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:18.219055 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51bb1d-3068-45a6-96a9-678779785803 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:18.224593 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00f58f-4e4f-4fb1-a10f-51c8a248db0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:18.225237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00f58f-4e4f-4fb1-a10f-51c8a248db0f admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:18.225522 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00f58f-4e4f-4fb1-a10f-51c8a248db0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:18.225801 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00f58f-4e4f-4fb1-a10f-51c8a248db0f admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:18.226497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00f58f-4e4f-4fb1-a10f-51c8a248db0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:18.228388 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00f58f-4e4f-4fb1-a10f-51c8a248db0f admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:18.310264 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:18.320602 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1331/2661] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:09:18 2022] POST /identity/v3/projects => generated 368 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:09:18.324263 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b7e75-3f79-41b4-8622-733cdb8a658e admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:18.336088 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b7e75-3f79-41b4-8622-733cdb8a658e admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:18.378245 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:18.394715 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15679d86-e7a9-4427-a96f-24a3d5fd75a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:18.395404 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15679d86-e7a9-4427-a96f-24a3d5fd75a1 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:18.395699 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15679d86-e7a9-4427-a96f-24a3d5fd75a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:18.395986 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15679d86-e7a9-4427-a96f-24a3d5fd75a1 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:18.396729 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15679d86-e7a9-4427-a96f-24a3d5fd75a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:18.398667 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15679d86-e7a9-4427-a96f-24a3d5fd75a1 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:18.505417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1331/2662] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:09:18 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:09:18.509445 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00f58f-4e4f-4fb1-a10f-51c8a248db0f admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:18.521555 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00f58f-4e4f-4fb1-a10f-51c8a248db0f admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:18.527170 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc22431-746c-43b9-bafc-44605d110317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:18.527839 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc22431-746c-43b9-bafc-44605d110317 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:18.528189 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc22431-746c-43b9-bafc-44605d110317 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:18.528684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc22431-746c-43b9-bafc-44605d110317 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:18.529759 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc22431-746c-43b9-bafc-44605d110317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:18.531818 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc22431-746c-43b9-bafc-44605d110317 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:18.547006 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1332/2663] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:09:18 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:09:18.549896 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15679d86-e7a9-4427-a96f-24a3d5fd75a1 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:18.561924 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15679d86-e7a9-4427-a96f-24a3d5fd75a1 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:18.566787 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4665a1-c2f1-45ff-a432-2f6e6f4040d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:18.571475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4665a1-c2f1-45ff-a432-2f6e6f4040d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:18.571475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4665a1-c2f1-45ff-a432-2f6e6f4040d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:18.571475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4665a1-c2f1-45ff-a432-2f6e6f4040d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:18.571475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4665a1-c2f1-45ff-a432-2f6e6f4040d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:18.571475 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4665a1-c2f1-45ff-a432-2f6e6f4040d2 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:18.581308 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1332/2664] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:09:18 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:09:18.585509 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc22431-746c-43b9-bafc-44605d110317 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:18.595847 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc22431-746c-43b9-bafc-44605d110317 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:18.601269 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d180e2e-f994-48af-abba-9d83ba2b80d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:18.602161 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d180e2e-f994-48af-abba-9d83ba2b80d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:18.602453 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d180e2e-f994-48af-abba-9d83ba2b80d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:18.602736 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d180e2e-f994-48af-abba-9d83ba2b80d7 admin admin] PATH_INFO: `/v3/projects/e4a3ccb02d104d3a8fa14d2fc524a4ca/users/c4147ff1573b4d23bfc95934117bc919/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:18.618665 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d180e2e-f994-48af-abba-9d83ba2b80d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a3ccb02d104d3a8fa14d2fc524a4ca, user_id=c4147ff1573b4d23bfc95934117bc919, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:18.621347 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d180e2e-f994-48af-abba-9d83ba2b80d7 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:18.722737 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1333/2665] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:09:18 2022] PUT /identity/v3/projects/e4a3ccb02d104d3a8fa14d2fc524a4ca/users/c4147ff1573b4d23bfc95934117bc919/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:09:18.737273 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796169d-eb59-4335-9305-0cfbb48d7d4c None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:18.737600 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796169d-eb59-4335-9305-0cfbb48d7d4c None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:18.737884 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796169d-eb59-4335-9305-0cfbb48d7d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:18.766943 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-e796169d-eb59-4335-9305-0cfbb48d7d4c None None] MFA Rules not processed for user `c4147ff1573b4d23bfc95934117bc919`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:18.768182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-e796169d-eb59-4335-9305-0cfbb48d7d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:18.831751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1333/2666] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:09:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:18.836971 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d180e2e-f994-48af-abba-9d83ba2b80d7 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:18.899489 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d180e2e-f994-48af-abba-9d83ba2b80d7 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:18.904527 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6fc0a-4904-4be9-baa7-b37991a2373b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:18.905216 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6fc0a-4904-4be9-baa7-b37991a2373b admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:18.905514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6fc0a-4904-4be9-baa7-b37991a2373b admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:18.905804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6fc0a-4904-4be9-baa7-b37991a2373b admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:18.906551 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6fc0a-4904-4be9-baa7-b37991a2373b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:18.908516 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6fc0a-4904-4be9-baa7-b37991a2373b admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:18.998499 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1334/2667] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:09:18 2022] POST /identity/v3/projects => generated 368 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:09:19.002608 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796169d-eb59-4335-9305-0cfbb48d7d4c None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:19.014612 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796169d-eb59-4335-9305-0cfbb48d7d4c None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:19.081098 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d0bac-fa18-47eb-bb8b-b92a26dd8747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:19.081902 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d0bac-fa18-47eb-bb8b-b92a26dd8747 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:19.082066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d0bac-fa18-47eb-bb8b-b92a26dd8747 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:19.082308 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d0bac-fa18-47eb-bb8b-b92a26dd8747 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:19.083015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d0bac-fa18-47eb-bb8b-b92a26dd8747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:19.084943 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d0bac-fa18-47eb-bb8b-b92a26dd8747 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:19.217991 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1334/2668] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:09:19 2022] POST /identity/v3/users => generated 291 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:09:19.222315 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6fc0a-4904-4be9-baa7-b37991a2373b admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:19.233182 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6fc0a-4904-4be9-baa7-b37991a2373b admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:19.237818 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32bfc2-b694-4676-8403-b51121da7ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:19.242978 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32bfc2-b694-4676-8403-b51121da7ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:19.242978 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32bfc2-b694-4676-8403-b51121da7ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:19.242978 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32bfc2-b694-4676-8403-b51121da7ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:19.242978 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32bfc2-b694-4676-8403-b51121da7ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:19.242978 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32bfc2-b694-4676-8403-b51121da7ad2 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:19.253125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1335/2669] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:09:19 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:09:19.257420 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d0bac-fa18-47eb-bb8b-b92a26dd8747 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:19.267454 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d0bac-fa18-47eb-bb8b-b92a26dd8747 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:19.272375 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38556901-6fdd-48f5-b7f3-47334a38fedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:19.273264 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38556901-6fdd-48f5-b7f3-47334a38fedf admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:19.273547 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38556901-6fdd-48f5-b7f3-47334a38fedf admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:19.273831 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38556901-6fdd-48f5-b7f3-47334a38fedf admin admin] PATH_INFO: `/v3/projects/865ddde435814cd09dce398e7b5d5767/users/e3e859c716f4493b881a38a3c3fa4b7f/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:19.289537 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38556901-6fdd-48f5-b7f3-47334a38fedf admin admin] RBAC: Authorizing `identity:create_grant(project_id=865ddde435814cd09dce398e7b5d5767, user_id=e3e859c716f4493b881a38a3c3fa4b7f, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:19.292186 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38556901-6fdd-48f5-b7f3-47334a38fedf admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:19.385845 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1335/2670] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:09:19 2022] PUT /identity/v3/projects/865ddde435814cd09dce398e7b5d5767/users/e3e859c716f4493b881a38a3c3fa4b7f/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:19.389841 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32bfc2-b694-4676-8403-b51121da7ad2 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:19.399982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32bfc2-b694-4676-8403-b51121da7ad2 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:19.460833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da52ec-953c-4da7-b9a4-a649be07f958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:19.461519 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da52ec-953c-4da7-b9a4-a649be07f958 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:19.461813 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da52ec-953c-4da7-b9a4-a649be07f958 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:19.462099 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da52ec-953c-4da7-b9a4-a649be07f958 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:19.462830 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da52ec-953c-4da7-b9a4-a649be07f958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:19.464490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da52ec-953c-4da7-b9a4-a649be07f958 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:19.475590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1336/2671] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:09:19 2022] GET /identity/v3/roles => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:09:19.480476 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38556901-6fdd-48f5-b7f3-47334a38fedf admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:19.491903 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38556901-6fdd-48f5-b7f3-47334a38fedf admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:19.496608 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b79b4f-6f3e-47fc-a830-73e06312bd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:19.497490 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b79b4f-6f3e-47fc-a830-73e06312bd4d admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:19.497874 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b79b4f-6f3e-47fc-a830-73e06312bd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:19.498165 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b79b4f-6f3e-47fc-a830-73e06312bd4d admin admin] PATH_INFO: `/v3/projects/865ddde435814cd09dce398e7b5d5767/users/e3e859c716f4493b881a38a3c3fa4b7f/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:19.500214 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b79b4f-6f3e-47fc-a830-73e06312bd4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=865ddde435814cd09dce398e7b5d5767, user_id=e3e859c716f4493b881a38a3c3fa4b7f, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:19.505118 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b79b4f-6f3e-47fc-a830-73e06312bd4d admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:19.516356 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1336/2672] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:09:19 2022] PUT /identity/v3/projects/865ddde435814cd09dce398e7b5d5767/users/e3e859c716f4493b881a38a3c3fa4b7f/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:19.526845 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483aad76-cba7-44a7-97e6-7fbe7c1df07d None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:19.527145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483aad76-cba7-44a7-97e6-7fbe7c1df07d None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:19.527428 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483aad76-cba7-44a7-97e6-7fbe7c1df07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:19.556657 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-483aad76-cba7-44a7-97e6-7fbe7c1df07d None None] MFA Rules not processed for user `e3e859c716f4493b881a38a3c3fa4b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:19.557870 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-483aad76-cba7-44a7-97e6-7fbe7c1df07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:19.577842 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:19.626823 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1337/2673] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:09:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:19.638794 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b79b4f-6f3e-47fc-a830-73e06312bd4d admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:19.640376 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-07b79b4f-6f3e-47fc-a830-73e06312bd4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:19.647909 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:19.698220 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b79b4f-6f3e-47fc-a830-73e06312bd4d admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:19.701921 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3a2a7-faf1-4cf1-87a8-384ec7bb67d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:19.702569 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3a2a7-faf1-4cf1-87a8-384ec7bb67d9 service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:19.702854 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3a2a7-faf1-4cf1-87a8-384ec7bb67d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:19.703129 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3a2a7-faf1-4cf1-87a8-384ec7bb67d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:19.713943 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3a2a7-faf1-4cf1-87a8-384ec7bb67d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:19.715440 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3a2a7-faf1-4cf1-87a8-384ec7bb67d9 service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:19.726741 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1337/2674] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:09:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:09:23.043307 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483aad76-cba7-44a7-97e6-7fbe7c1df07d None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:23.117494 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483aad76-cba7-44a7-97e6-7fbe7c1df07d None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:23.122099 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3db76d-b2b4-48f4-81af-161328eb5da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:23.123041 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3db76d-b2b4-48f4-81af-161328eb5da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:23.123319 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3db76d-b2b4-48f4-81af-161328eb5da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:23.123610 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3db76d-b2b4-48f4-81af-161328eb5da3 admin admin] PATH_INFO: `/v3/users/c4147ff1573b4d23bfc95934117bc919` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:23.124899 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3db76d-b2b4-48f4-81af-161328eb5da3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4147ff1573b4d23bfc95934117bc919)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:23.126891 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3db76d-b2b4-48f4-81af-161328eb5da3 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:23.267139 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-cc3db76d-b2b4-48f4-81af-161328eb5da3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4147ff1573b4d23bfc95934117bc919'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:23.279682 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-cc3db76d-b2b4-48f4-81af-161328eb5da3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4147ff1573b4d23bfc95934117bc919'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:23.286543 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-cc3db76d-b2b4-48f4-81af-161328eb5da3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4147ff1573b4d23bfc95934117bc919'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:23.287237 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-cc3db76d-b2b4-48f4-81af-161328eb5da3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4147ff1573b4d23bfc95934117bc919'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:23.360876 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-cc3db76d-b2b4-48f4-81af-161328eb5da3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4147ff1573b4d23bfc95934117bc919'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:23.368415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1338/2675] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:09:23 2022] DELETE /identity/v3/users/c4147ff1573b4d23bfc95934117bc919 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:23.373223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df23083-bd68-4efe-b231-586798b0f8f8 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:23.373700 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df23083-bd68-4efe-b231-586798b0f8f8 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:23.373883 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df23083-bd68-4efe-b231-586798b0f8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:23.391026 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-2df23083-bd68-4efe-b231-586798b0f8f8 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:23.392282 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-2df23083-bd68-4efe-b231-586798b0f8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:23.450487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1338/2676] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:09:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:23.460344 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3db76d-b2b4-48f4-81af-161328eb5da3 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:23.461765 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-cc3db76d-b2b4-48f4-81af-161328eb5da3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:23.503719 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:23.520835 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3db76d-b2b4-48f4-81af-161328eb5da3 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:23.524473 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d39a1d-fd7d-467f-82f2-51dd83e54942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:23.525124 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d39a1d-fd7d-467f-82f2-51dd83e54942 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:23.525409 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d39a1d-fd7d-467f-82f2-51dd83e54942 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:23.525687 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d39a1d-fd7d-467f-82f2-51dd83e54942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:23.536429 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d39a1d-fd7d-467f-82f2-51dd83e54942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:23.537868 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d39a1d-fd7d-467f-82f2-51dd83e54942 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:23.547510 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1339/2677] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:09:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:09:24.186328 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df23083-bd68-4efe-b231-586798b0f8f8 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:24.188168 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-2df23083-bd68-4efe-b231-586798b0f8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:24.202014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df23083-bd68-4efe-b231-586798b0f8f8 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:24.207806 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc8b87-e72a-40cd-beb2-470659cdcf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:24.208886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc8b87-e72a-40cd-beb2-470659cdcf4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:24.209528 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc8b87-e72a-40cd-beb2-470659cdcf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:24.209528 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc8b87-e72a-40cd-beb2-470659cdcf4a admin admin] PATH_INFO: `/v3/projects/e4a3ccb02d104d3a8fa14d2fc524a4ca` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:24.210741 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc8b87-e72a-40cd-beb2-470659cdcf4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4a3ccb02d104d3a8fa14d2fc524a4ca)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:24.212667 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc8b87-e72a-40cd-beb2-470659cdcf4a admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:24.305306 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-75bc8b87-e72a-40cd-beb2-470659cdcf4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4a3ccb02d104d3a8fa14d2fc524a4ca', 'request_id': 'req-75bc8b87-e72a-40cd-beb2-470659cdcf4a'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:24.311454 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-75bc8b87-e72a-40cd-beb2-470659cdcf4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4a3ccb02d104d3a8fa14d2fc524a4ca', 'request_id': 'req-75bc8b87-e72a-40cd-beb2-470659cdcf4a'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:24.317081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-75bc8b87-e72a-40cd-beb2-470659cdcf4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4a3ccb02d104d3a8fa14d2fc524a4ca', 'request_id': 'req-75bc8b87-e72a-40cd-beb2-470659cdcf4a'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:24.401258 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-75bc8b87-e72a-40cd-beb2-470659cdcf4a admin admin] The token cache is being invalidate because project e4a3ccb02d104d3a8fa14d2fc524a4ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:09:24.401957 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-75bc8b87-e72a-40cd-beb2-470659cdcf4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:24.402265 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-75bc8b87-e72a-40cd-beb2-470659cdcf4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:24.403856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1339/2678] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:09:24 2022] DELETE /identity/v3/projects/e4a3ccb02d104d3a8fa14d2fc524a4ca => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:24.407852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d39a1d-fd7d-467f-82f2-51dd83e54942 service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:24.418195 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d39a1d-fd7d-467f-82f2-51dd83e54942 service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:24.475377 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a806b5-82b9-4d1c-a764-f765f2c0316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:24.476351 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a806b5-82b9-4d1c-a764-f765f2c0316c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:24.476637 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a806b5-82b9-4d1c-a764-f765f2c0316c admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:24.476911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a806b5-82b9-4d1c-a764-f765f2c0316c admin admin] PATH_INFO: `/v3/users/e3e859c716f4493b881a38a3c3fa4b7f` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:24.478095 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a806b5-82b9-4d1c-a764-f765f2c0316c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3e859c716f4493b881a38a3c3fa4b7f)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:24.479993 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a806b5-82b9-4d1c-a764-f765f2c0316c admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:24.684093 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-20a806b5-82b9-4d1c-a764-f765f2c0316c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3e859c716f4493b881a38a3c3fa4b7f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:24.696168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-20a806b5-82b9-4d1c-a764-f765f2c0316c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3e859c716f4493b881a38a3c3fa4b7f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:24.702899 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-20a806b5-82b9-4d1c-a764-f765f2c0316c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3e859c716f4493b881a38a3c3fa4b7f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:24.703568 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-20a806b5-82b9-4d1c-a764-f765f2c0316c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3e859c716f4493b881a38a3c3fa4b7f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:24.773355 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-20a806b5-82b9-4d1c-a764-f765f2c0316c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3e859c716f4493b881a38a3c3fa4b7f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:24.779650 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1340/2679] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:09:24 2022] DELETE /identity/v3/users/e3e859c716f4493b881a38a3c3fa4b7f => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:25.191029 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc8b87-e72a-40cd-beb2-470659cdcf4a admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:25.191029 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-75bc8b87-e72a-40cd-beb2-470659cdcf4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:25.203589 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc8b87-e72a-40cd-beb2-470659cdcf4a admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:25.237458 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:25.265980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e772d06-96cc-4b8a-965e-a567c94bb76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:25.266844 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e772d06-96cc-4b8a-965e-a567c94bb76d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:25.267129 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e772d06-96cc-4b8a-965e-a567c94bb76d admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:25.267406 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e772d06-96cc-4b8a-965e-a567c94bb76d admin admin] PATH_INFO: `/v3/projects/865ddde435814cd09dce398e7b5d5767` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:25.268614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e772d06-96cc-4b8a-965e-a567c94bb76d admin admin] RBAC: Authorizing `identity:delete_project(project_id=865ddde435814cd09dce398e7b5d5767)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:25.270732 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e772d06-96cc-4b8a-965e-a567c94bb76d admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:25.386004 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5e772d06-96cc-4b8a-965e-a567c94bb76d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '865ddde435814cd09dce398e7b5d5767', 'request_id': 'req-5e772d06-96cc-4b8a-965e-a567c94bb76d'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:25.392539 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5e772d06-96cc-4b8a-965e-a567c94bb76d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '865ddde435814cd09dce398e7b5d5767', 'request_id': 'req-5e772d06-96cc-4b8a-965e-a567c94bb76d'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:25.399411 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5e772d06-96cc-4b8a-965e-a567c94bb76d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '865ddde435814cd09dce398e7b5d5767', 'request_id': 'req-5e772d06-96cc-4b8a-965e-a567c94bb76d'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:25.481332 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5e772d06-96cc-4b8a-965e-a567c94bb76d admin admin] The token cache is being invalidate because project 865ddde435814cd09dce398e7b5d5767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:09:25.481966 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5e772d06-96cc-4b8a-965e-a567c94bb76d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:25.482196 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5e772d06-96cc-4b8a-965e-a567c94bb76d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:25.483748 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1340/2680] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:09:25 2022] DELETE /identity/v3/projects/865ddde435814cd09dce398e7b5d5767 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:25.488911 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc2f6f-e7a9-427f-a064-533fe3d25bc4 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:25.489356 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc2f6f-e7a9-427f-a064-533fe3d25bc4 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:25.489511 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc2f6f-e7a9-427f-a064-533fe3d25bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:25.507733 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-16bc2f6f-e7a9-427f-a064-533fe3d25bc4 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:25.508986 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-16bc2f6f-e7a9-427f-a064-533fe3d25bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:25.565754 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:25.574901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1341/2681] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:09:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:25.583928 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28db24-a2cd-4a0e-b544-1d489930c3b5 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:25.584418 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28db24-a2cd-4a0e-b544-1d489930c3b5 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:25.584793 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28db24-a2cd-4a0e-b544-1d489930c3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:25.603405 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-9c28db24-a2cd-4a0e-b544-1d489930c3b5 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:25.605054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-9c28db24-a2cd-4a0e-b544-1d489930c3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:25.612616 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1341/2682] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:09:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:25.617636 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc2f6f-e7a9-427f-a064-533fe3d25bc4 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:25.627551 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc2f6f-e7a9-427f-a064-533fe3d25bc4 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:25.632830 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1805fe5-5885-42b2-803c-680840083f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:25.635923 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1805fe5-5885-42b2-803c-680840083f33 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:25.635923 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1805fe5-5885-42b2-803c-680840083f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:25.635923 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1805fe5-5885-42b2-803c-680840083f33 admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:25.635923 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1805fe5-5885-42b2-803c-680840083f33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:09:25.635923 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1805fe5-5885-42b2-803c-680840083f33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:25.636743 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1805fe5-5885-42b2-803c-680840083f33 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:25.648484 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1342/2683] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 16:09:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:09:25.652895 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28db24-a2cd-4a0e-b544-1d489930c3b5 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:25.662096 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28db24-a2cd-4a0e-b544-1d489930c3b5 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:25.667384 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b545c-9cb4-4f8d-b7a4-c43bf304e24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:25.668047 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b545c-9cb4-4f8d-b7a4-c43bf304e24d admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:25.668396 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b545c-9cb4-4f8d-b7a4-c43bf304e24d admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:25.668681 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b545c-9cb4-4f8d-b7a4-c43bf304e24d admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:25.669412 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b545c-9cb4-4f8d-b7a4-c43bf304e24d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:25.671346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b545c-9cb4-4f8d-b7a4-c43bf304e24d admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:25.780550 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1342/2684] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:09:25 2022] POST /identity/v3/projects => generated 378 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:09:25.784588 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1805fe5-5885-42b2-803c-680840083f33 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:25.794841 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1805fe5-5885-42b2-803c-680840083f33 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:25.852549 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd164b8-e598-479f-a572-2f82f7c07f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:25.853219 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd164b8-e598-479f-a572-2f82f7c07f02 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:25.853504 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd164b8-e598-479f-a572-2f82f7c07f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:25.853781 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd164b8-e598-479f-a572-2f82f7c07f02 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:25.854478 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd164b8-e598-479f-a572-2f82f7c07f02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:25.856397 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd164b8-e598-479f-a572-2f82f7c07f02 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:25.968157 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1343/2685] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:09:25 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:09:25.972571 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b545c-9cb4-4f8d-b7a4-c43bf304e24d admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:25.983871 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b545c-9cb4-4f8d-b7a4-c43bf304e24d admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:25.988546 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd41915-3291-4fde-a661-b96ae99c6ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:25.989237 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd41915-3291-4fde-a661-b96ae99c6ecc admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:25.989528 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd41915-3291-4fde-a661-b96ae99c6ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:25.989811 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd41915-3291-4fde-a661-b96ae99c6ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:25.991349 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd41915-3291-4fde-a661-b96ae99c6ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:25.993298 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd41915-3291-4fde-a661-b96ae99c6ecc admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:26.004253 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1343/2686] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:09:25 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:09:26.012302 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd164b8-e598-479f-a572-2f82f7c07f02 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:26.026007 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd164b8-e598-479f-a572-2f82f7c07f02 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:26.032269 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb545e5-a85b-4a0f-9199-9272c332ee9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:26.032902 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb545e5-a85b-4a0f-9199-9272c332ee9b admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:26.033187 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb545e5-a85b-4a0f-9199-9272c332ee9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:26.033465 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb545e5-a85b-4a0f-9199-9272c332ee9b admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:26.034190 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb545e5-a85b-4a0f-9199-9272c332ee9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:26.035858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb545e5-a85b-4a0f-9199-9272c332ee9b admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:26.047340 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1344/2687] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:09:26 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:09:26.051611 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd41915-3291-4fde-a661-b96ae99c6ecc admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:26.062513 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd41915-3291-4fde-a661-b96ae99c6ecc admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:26.067215 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d8778-517f-4a30-a68a-893eb3a37601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:26.068128 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d8778-517f-4a30-a68a-893eb3a37601 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:26.068469 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d8778-517f-4a30-a68a-893eb3a37601 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:26.068919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d8778-517f-4a30-a68a-893eb3a37601 admin admin] PATH_INFO: `/v3/projects/d2eabf8f573b402daf5676725f3bc6fa/users/be18a1ab9115440e9f60543a1d0fdbfb/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:26.084433 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d8778-517f-4a30-a68a-893eb3a37601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2eabf8f573b402daf5676725f3bc6fa, user_id=be18a1ab9115440e9f60543a1d0fdbfb, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:26.087174 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d8778-517f-4a30-a68a-893eb3a37601 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:26.168290 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1344/2688] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:09:26 2022] PUT /identity/v3/projects/d2eabf8f573b402daf5676725f3bc6fa/users/be18a1ab9115440e9f60543a1d0fdbfb/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:26.179806 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf94edf-03a8-4da8-9081-cfa67d0a8d5b None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:26.180175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf94edf-03a8-4da8-9081-cfa67d0a8d5b None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:26.180461 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf94edf-03a8-4da8-9081-cfa67d0a8d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:26.206697 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-8bf94edf-03a8-4da8-9081-cfa67d0a8d5b None None] MFA Rules not processed for user `be18a1ab9115440e9f60543a1d0fdbfb`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:26.207922 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-8bf94edf-03a8-4da8-9081-cfa67d0a8d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:26.271451 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1345/2689] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:09:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:26.275985 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d8778-517f-4a30-a68a-893eb3a37601 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:26.344345 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:26.348017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d8778-517f-4a30-a68a-893eb3a37601 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:26.357422 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef579fd-dcf7-44c5-a001-a140a192bcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:26.357422 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef579fd-dcf7-44c5-a001-a140a192bcef admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:26.357422 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef579fd-dcf7-44c5-a001-a140a192bcef admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:26.357422 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef579fd-dcf7-44c5-a001-a140a192bcef admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:26.358105 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef579fd-dcf7-44c5-a001-a140a192bcef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:26.358105 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef579fd-dcf7-44c5-a001-a140a192bcef admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:26.432749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1345/2690] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:09:26 2022] POST /identity/v3/projects => generated 378 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:09:26.436956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf94edf-03a8-4da8-9081-cfa67d0a8d5b None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:26.447902 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf94edf-03a8-4da8-9081-cfa67d0a8d5b None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:26.501510 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:26.508630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da54d29-bac2-402a-b55c-aac98b495c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:26.509391 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da54d29-bac2-402a-b55c-aac98b495c28 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:26.509684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da54d29-bac2-402a-b55c-aac98b495c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:26.509965 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da54d29-bac2-402a-b55c-aac98b495c28 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:26.510670 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da54d29-bac2-402a-b55c-aac98b495c28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:26.512868 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da54d29-bac2-402a-b55c-aac98b495c28 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:26.596861 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1346/2691] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:09:26 2022] POST /identity/v3/users => generated 296 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:09:26.616393 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef579fd-dcf7-44c5-a001-a140a192bcef admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:26.627310 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef579fd-dcf7-44c5-a001-a140a192bcef admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:26.632188 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e0b6a-0edb-44e1-bb2f-887138ba2952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:26.632856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e0b6a-0edb-44e1-bb2f-887138ba2952 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:26.633148 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e0b6a-0edb-44e1-bb2f-887138ba2952 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:26.633431 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e0b6a-0edb-44e1-bb2f-887138ba2952 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:26.634166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e0b6a-0edb-44e1-bb2f-887138ba2952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:26.635777 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e0b6a-0edb-44e1-bb2f-887138ba2952 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:26.648032 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1346/2692] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:09:26 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:09:26.652518 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da54d29-bac2-402a-b55c-aac98b495c28 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:26.664299 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da54d29-bac2-402a-b55c-aac98b495c28 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:26.669720 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448ff50-8433-4e5d-ae52-c7f91bec93cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:26.670803 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448ff50-8433-4e5d-ae52-c7f91bec93cd admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:26.671115 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448ff50-8433-4e5d-ae52-c7f91bec93cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:26.671401 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448ff50-8433-4e5d-ae52-c7f91bec93cd admin admin] PATH_INFO: `/v3/projects/6806fce2508847439d7dd6f8575fc139/users/0bd95757793343d1a941e65b82d951c7/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:26.689034 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448ff50-8433-4e5d-ae52-c7f91bec93cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6806fce2508847439d7dd6f8575fc139, user_id=0bd95757793343d1a941e65b82d951c7, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:26.691791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448ff50-8433-4e5d-ae52-c7f91bec93cd admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:26.773766 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1347/2693] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:09:26 2022] PUT /identity/v3/projects/6806fce2508847439d7dd6f8575fc139/users/0bd95757793343d1a941e65b82d951c7/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:26.777794 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e0b6a-0edb-44e1-bb2f-887138ba2952 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:26.788675 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e0b6a-0edb-44e1-bb2f-887138ba2952 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:26.844784 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba2d14-d7a5-4d9a-8c20-945048f570fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:26.845467 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba2d14-d7a5-4d9a-8c20-945048f570fa admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:26.845754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba2d14-d7a5-4d9a-8c20-945048f570fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:26.846034 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba2d14-d7a5-4d9a-8c20-945048f570fa admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:26.846755 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba2d14-d7a5-4d9a-8c20-945048f570fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:26.848424 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba2d14-d7a5-4d9a-8c20-945048f570fa admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:26.858021 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1347/2694] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:09:26 2022] GET /identity/v3/roles => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:09:26.862359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448ff50-8433-4e5d-ae52-c7f91bec93cd admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:26.872820 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448ff50-8433-4e5d-ae52-c7f91bec93cd admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:26.879271 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533bb91-aed5-4e29-ac9e-8bc755198c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:26.879271 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533bb91-aed5-4e29-ac9e-8bc755198c55 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:26.879271 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533bb91-aed5-4e29-ac9e-8bc755198c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:26.879271 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533bb91-aed5-4e29-ac9e-8bc755198c55 admin admin] PATH_INFO: `/v3/projects/6806fce2508847439d7dd6f8575fc139/users/0bd95757793343d1a941e65b82d951c7/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:26.881361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533bb91-aed5-4e29-ac9e-8bc755198c55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6806fce2508847439d7dd6f8575fc139, user_id=0bd95757793343d1a941e65b82d951c7, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:26.884181 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533bb91-aed5-4e29-ac9e-8bc755198c55 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:26.894726 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1348/2695] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:09:26 2022] PUT /identity/v3/projects/6806fce2508847439d7dd6f8575fc139/users/0bd95757793343d1a941e65b82d951c7/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:26.905437 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99818093-bb2f-479d-9363-26ed5b4dddff None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:26.905733 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99818093-bb2f-479d-9363-26ed5b4dddff None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:26.906015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99818093-bb2f-479d-9363-26ed5b4dddff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:26.933613 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-99818093-bb2f-479d-9363-26ed5b4dddff None None] MFA Rules not processed for user `0bd95757793343d1a941e65b82d951c7`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:26.934825 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-99818093-bb2f-479d-9363-26ed5b4dddff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:27.003272 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1348/2696] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:09:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:27.016226 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533bb91-aed5-4e29-ac9e-8bc755198c55 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:27.020423 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-5533bb91-aed5-4e29-ac9e-8bc755198c55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:27.078339 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533bb91-aed5-4e29-ac9e-8bc755198c55 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:27.082052 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892cfbf6-6247-4a57-9601-c6a3aa75d715 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:27.082709 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cfbf6-6247-4a57-9601-c6a3aa75d715 service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:27.083001 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cfbf6-6247-4a57-9601-c6a3aa75d715 service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:27.083283 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cfbf6-6247-4a57-9601-c6a3aa75d715 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:27.141344 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892cfbf6-6247-4a57-9601-c6a3aa75d715 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:27.142713 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892cfbf6-6247-4a57-9601-c6a3aa75d715 service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:27.152265 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1349/2697] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:09:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:09:37.000246 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=75,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:37.148616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=67,keystone:INSERT=5 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:39.595965 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99818093-bb2f-479d-9363-26ed5b4dddff None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:39.605800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99818093-bb2f-479d-9363-26ed5b4dddff None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:39.609532 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c176272-2cf6-4df9-8e1a-4f3a430e1608 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:39.610179 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c176272-2cf6-4df9-8e1a-4f3a430e1608 service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:39.610473 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c176272-2cf6-4df9-8e1a-4f3a430e1608 service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:39.611545 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c176272-2cf6-4df9-8e1a-4f3a430e1608 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:39.619911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c176272-2cf6-4df9-8e1a-4f3a430e1608 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:39.621385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c176272-2cf6-4df9-8e1a-4f3a430e1608 service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:39.630953 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1349/2698] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:09:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:09:49.626646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=6 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:17.107466 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892cfbf6-6247-4a57-9601-c6a3aa75d715 service cinder] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:17.109006 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-892cfbf6-6247-4a57-9601-c6a3aa75d715 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:17.184159 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892cfbf6-6247-4a57-9601-c6a3aa75d715 service cinder] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:17.190528 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319839d-3b70-42ca-9001-5bac0d1ab018 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:17.191179 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319839d-3b70-42ca-9001-5bac0d1ab018 service nova] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:17.191469 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319839d-3b70-42ca-9001-5bac0d1ab018 service nova] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:17.191751 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319839d-3b70-42ca-9001-5bac0d1ab018 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:17.193546 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-a319839d-3b70-42ca-9001-5bac0d1ab018 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:17.251976 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319839d-3b70-42ca-9001-5bac0d1ab018 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:17.253794 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319839d-3b70-42ca-9001-5bac0d1ab018 service nova] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:17.262894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1350/2699] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:10:17 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:10:20.480195 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c176272-2cf6-4df9-8e1a-4f3a430e1608 service cinder] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:20.481751 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-0c176272-2cf6-4df9-8e1a-4f3a430e1608 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:20.549170 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c176272-2cf6-4df9-8e1a-4f3a430e1608 service cinder] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:20.553900 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fa0e0-a5be-4bbb-bbb2-ac057c71dc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:20.554817 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fa0e0-a5be-4bbb-bbb2-ac057c71dc7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:20.555108 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fa0e0-a5be-4bbb-bbb2-ac057c71dc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:20.555395 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fa0e0-a5be-4bbb-bbb2-ac057c71dc7f admin admin] PATH_INFO: `/v3/users/9b066c20c564429887d49f28f6a7a70f` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:20.556711 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724fa0e0-a5be-4bbb-bbb2-ac057c71dc7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b066c20c564429887d49f28f6a7a70f)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:20.560488 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724fa0e0-a5be-4bbb-bbb2-ac057c71dc7f admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:20.788883 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-724fa0e0-a5be-4bbb-bbb2-ac057c71dc7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b066c20c564429887d49f28f6a7a70f'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:20.789462 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-724fa0e0-a5be-4bbb-bbb2-ac057c71dc7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b066c20c564429887d49f28f6a7a70f'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:20.801831 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-724fa0e0-a5be-4bbb-bbb2-ac057c71dc7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b066c20c564429887d49f28f6a7a70f'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:20.808666 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-724fa0e0-a5be-4bbb-bbb2-ac057c71dc7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b066c20c564429887d49f28f6a7a70f'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:20.809321 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-724fa0e0-a5be-4bbb-bbb2-ac057c71dc7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b066c20c564429887d49f28f6a7a70f'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:20.882780 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1350/2700] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:10:20 2022] DELETE /identity/v3/users/9b066c20c564429887d49f28f6a7a70f => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:10:20.887272 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293d50b-2e16-49ba-8bd7-a6347c0e8930 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:20.887755 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293d50b-2e16-49ba-8bd7-a6347c0e8930 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:20.887855 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293d50b-2e16-49ba-8bd7-a6347c0e8930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:20.905611 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-2293d50b-2e16-49ba-8bd7-a6347c0e8930 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:10:20.906917 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-2293d50b-2e16-49ba-8bd7-a6347c0e8930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:20.967661 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1351/2701] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:10:20.977602 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fa0e0-a5be-4bbb-bbb2-ac057c71dc7f admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:20.979043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-724fa0e0-a5be-4bbb-bbb2-ac057c71dc7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:21.037483 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fa0e0-a5be-4bbb-bbb2-ac057c71dc7f admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:21.041126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c18cf-eee4-4b6c-8b14-ce93a80ebd4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:21.041748 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c18cf-eee4-4b6c-8b14-ce93a80ebd4f service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:21.042036 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c18cf-eee4-4b6c-8b14-ce93a80ebd4f service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:21.042346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c18cf-eee4-4b6c-8b14-ce93a80ebd4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:21.051864 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c18cf-eee4-4b6c-8b14-ce93a80ebd4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:21.053352 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c18cf-eee4-4b6c-8b14-ce93a80ebd4f service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:21.063302 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1351/2702] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:10:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:10:21.480271 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293d50b-2e16-49ba-8bd7-a6347c0e8930 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:21.482202 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-2293d50b-2e16-49ba-8bd7-a6347c0e8930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:21.517954 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293d50b-2e16-49ba-8bd7-a6347c0e8930 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:21.522937 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c7493-130b-4f5c-b65e-0a89df8c824c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:21.523916 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c7493-130b-4f5c-b65e-0a89df8c824c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:21.524329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c7493-130b-4f5c-b65e-0a89df8c824c admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:21.524787 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c7493-130b-4f5c-b65e-0a89df8c824c admin admin] PATH_INFO: `/v3/projects/4d9db4bcb01749699c4eea0adf80afea` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:21.527004 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c7493-130b-4f5c-b65e-0a89df8c824c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d9db4bcb01749699c4eea0adf80afea)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:21.529938 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c7493-130b-4f5c-b65e-0a89df8c824c admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:21.637263 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:21.650374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-6a6c7493-130b-4f5c-b65e-0a89df8c824c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d9db4bcb01749699c4eea0adf80afea', 'request_id': 'req-6a6c7493-130b-4f5c-b65e-0a89df8c824c'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:21.661325 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-6a6c7493-130b-4f5c-b65e-0a89df8c824c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d9db4bcb01749699c4eea0adf80afea', 'request_id': 'req-6a6c7493-130b-4f5c-b65e-0a89df8c824c'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:21.756799 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-6a6c7493-130b-4f5c-b65e-0a89df8c824c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d9db4bcb01749699c4eea0adf80afea', 'request_id': 'req-6a6c7493-130b-4f5c-b65e-0a89df8c824c'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:21.767536 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-6a6c7493-130b-4f5c-b65e-0a89df8c824c admin admin] The token cache is being invalidate because project 4d9db4bcb01749699c4eea0adf80afea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:10:21.767827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-6a6c7493-130b-4f5c-b65e-0a89df8c824c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:21.768478 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-6a6c7493-130b-4f5c-b65e-0a89df8c824c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:21.770020 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1352/2703] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:10:21 2022] DELETE /identity/v3/projects/4d9db4bcb01749699c4eea0adf80afea => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:10:22.528227 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c18cf-eee4-4b6c-8b14-ce93a80ebd4f service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:22.529391 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-603c18cf-eee4-4b6c-8b14-ce93a80ebd4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:22.543100 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c18cf-eee4-4b6c-8b14-ce93a80ebd4f service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:22.562144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:22.600023 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97098f6b-b589-49c7-af6a-28d0ea4c6e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:22.600938 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97098f6b-b589-49c7-af6a-28d0ea4c6e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:22.601226 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97098f6b-b589-49c7-af6a-28d0ea4c6e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:22.601507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97098f6b-b589-49c7-af6a-28d0ea4c6e69 admin admin] PATH_INFO: `/v3/users/be18a1ab9115440e9f60543a1d0fdbfb` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:22.602710 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97098f6b-b589-49c7-af6a-28d0ea4c6e69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be18a1ab9115440e9f60543a1d0fdbfb)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:22.604676 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97098f6b-b589-49c7-af6a-28d0ea4c6e69 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:22.741445 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-97098f6b-b589-49c7-af6a-28d0ea4c6e69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be18a1ab9115440e9f60543a1d0fdbfb'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:22.742113 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-97098f6b-b589-49c7-af6a-28d0ea4c6e69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be18a1ab9115440e9f60543a1d0fdbfb'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:22.755914 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-97098f6b-b589-49c7-af6a-28d0ea4c6e69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be18a1ab9115440e9f60543a1d0fdbfb'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:22.763189 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-97098f6b-b589-49c7-af6a-28d0ea4c6e69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be18a1ab9115440e9f60543a1d0fdbfb'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:22.764039 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-97098f6b-b589-49c7-af6a-28d0ea4c6e69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be18a1ab9115440e9f60543a1d0fdbfb'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:22.858305 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1352/2704] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:10:22 2022] DELETE /identity/v3/users/be18a1ab9115440e9f60543a1d0fdbfb => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:10:22.863066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d7fca-9d48-4141-bb0d-1d3e945cee31 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:22.863546 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d7fca-9d48-4141-bb0d-1d3e945cee31 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:22.863666 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d7fca-9d48-4141-bb0d-1d3e945cee31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:22.881010 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-6f2d7fca-9d48-4141-bb0d-1d3e945cee31 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:10:22.882213 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-6f2d7fca-9d48-4141-bb0d-1d3e945cee31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:22.941424 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1353/2705] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:10:22.951088 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97098f6b-b589-49c7-af6a-28d0ea4c6e69 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:22.953179 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-97098f6b-b589-49c7-af6a-28d0ea4c6e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:23.010989 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97098f6b-b589-49c7-af6a-28d0ea4c6e69 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:23.014775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f954294-94ad-45a6-b042-83dd29277717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:23.015921 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f954294-94ad-45a6-b042-83dd29277717 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:23.016243 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f954294-94ad-45a6-b042-83dd29277717 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:23.016532 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f954294-94ad-45a6-b042-83dd29277717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:23.025709 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f954294-94ad-45a6-b042-83dd29277717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:23.027157 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f954294-94ad-45a6-b042-83dd29277717 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:23.037539 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1353/2706] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:10:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:10:24.057611 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d7fca-9d48-4141-bb0d-1d3e945cee31 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:24.059044 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-6f2d7fca-9d48-4141-bb0d-1d3e945cee31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:24.071879 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d7fca-9d48-4141-bb0d-1d3e945cee31 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:24.077071 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708bae7b-f22c-4b1d-a840-818fd53c87e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:24.079078 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bae7b-f22c-4b1d-a840-818fd53c87e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:24.079078 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bae7b-f22c-4b1d-a840-818fd53c87e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:24.079331 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bae7b-f22c-4b1d-a840-818fd53c87e8 admin admin] PATH_INFO: `/v3/projects/d2eabf8f573b402daf5676725f3bc6fa` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:24.080558 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708bae7b-f22c-4b1d-a840-818fd53c87e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2eabf8f573b402daf5676725f3bc6fa)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:24.082586 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708bae7b-f22c-4b1d-a840-818fd53c87e8 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:24.208527 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-708bae7b-f22c-4b1d-a840-818fd53c87e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2eabf8f573b402daf5676725f3bc6fa', 'request_id': 'req-708bae7b-f22c-4b1d-a840-818fd53c87e8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:24.214929 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-708bae7b-f22c-4b1d-a840-818fd53c87e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2eabf8f573b402daf5676725f3bc6fa', 'request_id': 'req-708bae7b-f22c-4b1d-a840-818fd53c87e8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:24.308634 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-708bae7b-f22c-4b1d-a840-818fd53c87e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2eabf8f573b402daf5676725f3bc6fa', 'request_id': 'req-708bae7b-f22c-4b1d-a840-818fd53c87e8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:24.319721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-708bae7b-f22c-4b1d-a840-818fd53c87e8 admin admin] The token cache is being invalidate because project d2eabf8f573b402daf5676725f3bc6fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:10:24.320049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-708bae7b-f22c-4b1d-a840-818fd53c87e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:24.320720 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-708bae7b-f22c-4b1d-a840-818fd53c87e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:24.322313 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1354/2707] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:10:24 2022] DELETE /identity/v3/projects/d2eabf8f573b402daf5676725f3bc6fa => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:10:24.326203 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f954294-94ad-45a6-b042-83dd29277717 service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:24.336047 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f954294-94ad-45a6-b042-83dd29277717 service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:24.383084 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:24.397744 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa6967-f719-457e-914c-82bb085e31d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:24.398637 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa6967-f719-457e-914c-82bb085e31d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:24.398924 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa6967-f719-457e-914c-82bb085e31d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:24.399204 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa6967-f719-457e-914c-82bb085e31d0 admin admin] PATH_INFO: `/v3/users/0bd95757793343d1a941e65b82d951c7` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:24.400442 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa6967-f719-457e-914c-82bb085e31d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bd95757793343d1a941e65b82d951c7)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:24.402400 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa6967-f719-457e-914c-82bb085e31d0 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:24.585618 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708bae7b-f22c-4b1d-a840-818fd53c87e8 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:24.585618 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-708bae7b-f22c-4b1d-a840-818fd53c87e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:24.598724 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-a6aa6967-f719-457e-914c-82bb085e31d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bd95757793343d1a941e65b82d951c7'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:24.599544 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-a6aa6967-f719-457e-914c-82bb085e31d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bd95757793343d1a941e65b82d951c7'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:24.613396 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-a6aa6967-f719-457e-914c-82bb085e31d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bd95757793343d1a941e65b82d951c7'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:24.621104 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-a6aa6967-f719-457e-914c-82bb085e31d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bd95757793343d1a941e65b82d951c7'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:24.622544 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-a6aa6967-f719-457e-914c-82bb085e31d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bd95757793343d1a941e65b82d951c7'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:24.643411 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:24.674245 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708bae7b-f22c-4b1d-a840-818fd53c87e8 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:24.680090 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ee8aa-64b8-4766-b68f-174216f27615 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:24.680844 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ee8aa-64b8-4766-b68f-174216f27615 service nova] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:24.681135 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ee8aa-64b8-4766-b68f-174216f27615 service nova] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:24.681424 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ee8aa-64b8-4766-b68f-174216f27615 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:24.683289 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-258ee8aa-64b8-4766-b68f-174216f27615 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:24.696938 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ee8aa-64b8-4766-b68f-174216f27615 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:24.698601 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ee8aa-64b8-4766-b68f-174216f27615 service nova] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:24.711500 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1355/2708] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:10:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:10:24.743631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1354/2709] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:10:24 2022] DELETE /identity/v3/users/0bd95757793343d1a941e65b82d951c7 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:10:25.088644 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ee8aa-64b8-4766-b68f-174216f27615 service nova] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:25.090775 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-258ee8aa-64b8-4766-b68f-174216f27615 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:25.173036 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ee8aa-64b8-4766-b68f-174216f27615 service nova] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:25.202901 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa6967-f719-457e-914c-82bb085e31d0 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:25.205102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-a6aa6967-f719-457e-914c-82bb085e31d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:25.274180 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95a6fd-22c4-4611-8182-8e36c0170615 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716cbbfeede34885b0411e5b9b25df47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:25.274996 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95a6fd-22c4-4611-8182-8e36c0170615 service placement] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:25.275303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95a6fd-22c4-4611-8182-8e36c0170615 service placement] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:25.275994 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95a6fd-22c4-4611-8182-8e36c0170615 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:25.279129 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-8c95a6fd-22c4-4611-8182-8e36c0170615 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:25.292660 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95a6fd-22c4-4611-8182-8e36c0170615 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:25.294489 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95a6fd-22c4-4611-8182-8e36c0170615 service placement] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:25.305064 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa6967-f719-457e-914c-82bb085e31d0 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:25.307251 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1356/2710] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:10:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:10:25.310662 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451a2dc-ce49-4242-8eea-f5981eca017e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:25.311553 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451a2dc-ce49-4242-8eea-f5981eca017e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:25.311845 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451a2dc-ce49-4242-8eea-f5981eca017e admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:25.312230 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451a2dc-ce49-4242-8eea-f5981eca017e admin admin] PATH_INFO: `/v3/projects/6806fce2508847439d7dd6f8575fc139` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:25.314661 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451a2dc-ce49-4242-8eea-f5981eca017e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6806fce2508847439d7dd6f8575fc139)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:25.316631 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451a2dc-ce49-4242-8eea-f5981eca017e admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:25.436197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-0451a2dc-ce49-4242-8eea-f5981eca017e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6806fce2508847439d7dd6f8575fc139', 'request_id': 'req-0451a2dc-ce49-4242-8eea-f5981eca017e'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:25.443447 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-0451a2dc-ce49-4242-8eea-f5981eca017e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6806fce2508847439d7dd6f8575fc139', 'request_id': 'req-0451a2dc-ce49-4242-8eea-f5981eca017e'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:25.449807 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-0451a2dc-ce49-4242-8eea-f5981eca017e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6806fce2508847439d7dd6f8575fc139', 'request_id': 'req-0451a2dc-ce49-4242-8eea-f5981eca017e'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:25.453417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:25.556048 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-0451a2dc-ce49-4242-8eea-f5981eca017e admin admin] The token cache is being invalidate because project 6806fce2508847439d7dd6f8575fc139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:10:25.556376 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-0451a2dc-ce49-4242-8eea-f5981eca017e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:25.557019 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-0451a2dc-ce49-4242-8eea-f5981eca017e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:25.558621 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1355/2711] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:10:25 2022] DELETE /identity/v3/projects/6806fce2508847439d7dd6f8575fc139 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:10:25.564845 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c91ff-44be-4525-8c28-69f8e00a90af None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:25.565143 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c91ff-44be-4525-8c28-69f8e00a90af None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:25.565429 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c91ff-44be-4525-8c28-69f8e00a90af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:25.584253 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-4a9c91ff-44be-4525-8c28-69f8e00a90af None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:10:25.585470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-4a9c91ff-44be-4525-8c28-69f8e00a90af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:25.647208 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1357/2712] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:10:25.654674 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630ee76-1c6e-4acd-9c59-e693f0117b2f None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:25.655006 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630ee76-1c6e-4acd-9c59-e693f0117b2f None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:25.655289 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630ee76-1c6e-4acd-9c59-e693f0117b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:25.674116 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-8630ee76-1c6e-4acd-9c59-e693f0117b2f None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:10:25.675346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-8630ee76-1c6e-4acd-9c59-e693f0117b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:25.683323 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1356/2713] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:10:25.688236 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c91ff-44be-4525-8c28-69f8e00a90af None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:25.693134 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=100 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:25.699511 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c91ff-44be-4525-8c28-69f8e00a90af None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:25.705400 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d28df-93e4-4b13-aad7-bcaad6790a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:25.706165 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d28df-93e4-4b13-aad7-bcaad6790a92 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:25.706463 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d28df-93e4-4b13-aad7-bcaad6790a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:25.706758 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d28df-93e4-4b13-aad7-bcaad6790a92 admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:25.707539 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d28df-93e4-4b13-aad7-bcaad6790a92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:10:25.707887 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d28df-93e4-4b13-aad7-bcaad6790a92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:25.710167 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d28df-93e4-4b13-aad7-bcaad6790a92 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:25.724691 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1358/2714] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 16:10:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:10:25.732306 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630ee76-1c6e-4acd-9c59-e693f0117b2f None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:25.739944 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630ee76-1c6e-4acd-9c59-e693f0117b2f None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:25.744761 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d4f5f-9715-4829-a474-4e62db348d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:25.745483 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d4f5f-9715-4829-a474-4e62db348d3e admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:25.745774 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d4f5f-9715-4829-a474-4e62db348d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:25.746058 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d4f5f-9715-4829-a474-4e62db348d3e admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:25.746764 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d4f5f-9715-4829-a474-4e62db348d3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:25.748746 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d4f5f-9715-4829-a474-4e62db348d3e admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:25.844025 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1357/2715] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:10:25 2022] POST /identity/v3/projects => generated 388 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:10:25.848598 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d28df-93e4-4b13-aad7-bcaad6790a92 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:25.859412 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d28df-93e4-4b13-aad7-bcaad6790a92 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:25.916595 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01f645-74ab-48dc-b32d-7e27eafc91dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:25.917199 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01f645-74ab-48dc-b32d-7e27eafc91dc admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:25.917512 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01f645-74ab-48dc-b32d-7e27eafc91dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:25.917795 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01f645-74ab-48dc-b32d-7e27eafc91dc admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:25.918495 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01f645-74ab-48dc-b32d-7e27eafc91dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:25.920427 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01f645-74ab-48dc-b32d-7e27eafc91dc admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:26.033039 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1359/2716] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:10:25 2022] POST /identity/v3/users => generated 295 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:10:26.037068 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d4f5f-9715-4829-a474-4e62db348d3e admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:26.048964 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d4f5f-9715-4829-a474-4e62db348d3e admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:26.054018 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e99f0-dfbd-4a28-981c-18118bf479f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:26.054690 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e99f0-dfbd-4a28-981c-18118bf479f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:26.054975 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e99f0-dfbd-4a28-981c-18118bf479f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:26.055253 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e99f0-dfbd-4a28-981c-18118bf479f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:26.055996 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e99f0-dfbd-4a28-981c-18118bf479f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:26.057637 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e99f0-dfbd-4a28-981c-18118bf479f5 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:26.069338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1358/2717] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:10:26 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:10:26.076689 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01f645-74ab-48dc-b32d-7e27eafc91dc admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:26.086896 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01f645-74ab-48dc-b32d-7e27eafc91dc admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:26.091521 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5aa725-dbf4-4184-bb63-97bf23365ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:26.092223 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5aa725-dbf4-4184-bb63-97bf23365ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:26.092497 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5aa725-dbf4-4184-bb63-97bf23365ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:26.092778 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5aa725-dbf4-4184-bb63-97bf23365ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:26.094005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5aa725-dbf4-4184-bb63-97bf23365ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:26.095839 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5aa725-dbf4-4184-bb63-97bf23365ff1 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:26.105943 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1360/2718] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:10:26 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:10:26.112006 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e99f0-dfbd-4a28-981c-18118bf479f5 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:26.123204 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e99f0-dfbd-4a28-981c-18118bf479f5 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:26.128278 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee786c0-0a00-4b80-87ed-d3f8d4a43e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:26.129176 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee786c0-0a00-4b80-87ed-d3f8d4a43e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:26.129464 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee786c0-0a00-4b80-87ed-d3f8d4a43e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:26.129748 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee786c0-0a00-4b80-87ed-d3f8d4a43e50 admin admin] PATH_INFO: `/v3/projects/2df4ac5a66754a56825fbaa0f06e2d09/users/cdb3ec84c857464b93f15a7afd1d49ea/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:26.145063 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee786c0-0a00-4b80-87ed-d3f8d4a43e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2df4ac5a66754a56825fbaa0f06e2d09, user_id=cdb3ec84c857464b93f15a7afd1d49ea, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:26.147725 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee786c0-0a00-4b80-87ed-d3f8d4a43e50 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:26.231611 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1359/2719] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:10:26 2022] PUT /identity/v3/projects/2df4ac5a66754a56825fbaa0f06e2d09/users/cdb3ec84c857464b93f15a7afd1d49ea/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:10:26.243580 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf84c1-b90b-4c66-b764-1aac5d6059cf None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:26.243873 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf84c1-b90b-4c66-b764-1aac5d6059cf None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:26.244189 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf84c1-b90b-4c66-b764-1aac5d6059cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:26.274537 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-a5bf84c1-b90b-4c66-b764-1aac5d6059cf None None] MFA Rules not processed for user `cdb3ec84c857464b93f15a7afd1d49ea`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:10:26.276323 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-a5bf84c1-b90b-4c66-b764-1aac5d6059cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:26.349310 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1361/2720] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:10:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:10:26.353805 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee786c0-0a00-4b80-87ed-d3f8d4a43e50 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:26.421127 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee786c0-0a00-4b80-87ed-d3f8d4a43e50 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:26.427225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd9f98-9217-4a38-87e4-0e78c37602b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:26.427917 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd9f98-9217-4a38-87e4-0e78c37602b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:26.428241 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd9f98-9217-4a38-87e4-0e78c37602b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:26.428523 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd9f98-9217-4a38-87e4-0e78c37602b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:26.429323 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd9f98-9217-4a38-87e4-0e78c37602b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:26.431267 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd9f98-9217-4a38-87e4-0e78c37602b6 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:26.518998 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1360/2721] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:10:26 2022] POST /identity/v3/projects => generated 390 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:10:26.519997 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf84c1-b90b-4c66-b764-1aac5d6059cf None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:26.531834 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf84c1-b90b-4c66-b764-1aac5d6059cf None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:26.582513 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:26.588566 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d526b7-66c9-4401-801b-a30826934e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:26.589250 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d526b7-66c9-4401-801b-a30826934e91 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:26.589546 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d526b7-66c9-4401-801b-a30826934e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:26.589829 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d526b7-66c9-4401-801b-a30826934e91 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:26.590523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d526b7-66c9-4401-801b-a30826934e91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:26.592471 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d526b7-66c9-4401-801b-a30826934e91 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:26.720424 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1362/2722] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:10:26 2022] POST /identity/v3/users => generated 302 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:10:26.721963 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd9f98-9217-4a38-87e4-0e78c37602b6 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:26.732271 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd9f98-9217-4a38-87e4-0e78c37602b6 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:26.737818 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e0f7d-99d9-48b3-a5ef-bb942294b1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:26.741840 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e0f7d-99d9-48b3-a5ef-bb942294b1af admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:26.741840 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e0f7d-99d9-48b3-a5ef-bb942294b1af admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:26.741840 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e0f7d-99d9-48b3-a5ef-bb942294b1af admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:26.741840 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e0f7d-99d9-48b3-a5ef-bb942294b1af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:26.741840 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e0f7d-99d9-48b3-a5ef-bb942294b1af admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:26.752496 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1361/2723] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:10:26 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:10:26.756829 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d526b7-66c9-4401-801b-a30826934e91 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:26.767422 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d526b7-66c9-4401-801b-a30826934e91 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:26.772087 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569801ac-3d21-48ac-b131-16ef4b87cbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:26.773002 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569801ac-3d21-48ac-b131-16ef4b87cbef admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:26.773294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569801ac-3d21-48ac-b131-16ef4b87cbef admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:26.773579 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569801ac-3d21-48ac-b131-16ef4b87cbef admin admin] PATH_INFO: `/v3/projects/669f363eef6942ce99c521a8e873649e/users/8e8655501613415bb94cdb1b3b599848/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:26.790043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569801ac-3d21-48ac-b131-16ef4b87cbef admin admin] RBAC: Authorizing `identity:create_grant(project_id=669f363eef6942ce99c521a8e873649e, user_id=8e8655501613415bb94cdb1b3b599848, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:26.792810 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569801ac-3d21-48ac-b131-16ef4b87cbef admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:26.910637 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1363/2724] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:10:26 2022] PUT /identity/v3/projects/669f363eef6942ce99c521a8e873649e/users/8e8655501613415bb94cdb1b3b599848/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:10:26.914711 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e0f7d-99d9-48b3-a5ef-bb942294b1af admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:26.925501 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e0f7d-99d9-48b3-a5ef-bb942294b1af admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:26.984262 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab79e9-f1d0-482b-9527-a6c969136451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:26.984941 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab79e9-f1d0-482b-9527-a6c969136451 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:26.985233 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab79e9-f1d0-482b-9527-a6c969136451 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:26.985513 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab79e9-f1d0-482b-9527-a6c969136451 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:26.986242 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab79e9-f1d0-482b-9527-a6c969136451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:26.987841 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab79e9-f1d0-482b-9527-a6c969136451 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:26.993172 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:26.998240 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1362/2725] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:10:26 2022] GET /identity/v3/roles => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:10:27.003122 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569801ac-3d21-48ac-b131-16ef4b87cbef admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:27.013470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569801ac-3d21-48ac-b131-16ef4b87cbef admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:27.019083 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3745ec8-4aa1-4b3d-9e5e-d063fe31ecda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:27.019968 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3745ec8-4aa1-4b3d-9e5e-d063fe31ecda admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:27.020324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3745ec8-4aa1-4b3d-9e5e-d063fe31ecda admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:27.020611 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3745ec8-4aa1-4b3d-9e5e-d063fe31ecda admin admin] PATH_INFO: `/v3/projects/669f363eef6942ce99c521a8e873649e/users/8e8655501613415bb94cdb1b3b599848/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:27.022594 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3745ec8-4aa1-4b3d-9e5e-d063fe31ecda admin admin] RBAC: Authorizing `identity:create_grant(project_id=669f363eef6942ce99c521a8e873649e, user_id=8e8655501613415bb94cdb1b3b599848, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:27.025259 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3745ec8-4aa1-4b3d-9e5e-d063fe31ecda admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:27.036470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1364/2726] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:10:27 2022] PUT /identity/v3/projects/669f363eef6942ce99c521a8e873649e/users/8e8655501613415bb94cdb1b3b599848/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:10:27.104662 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8670c-c100-4c25-bf6e-3ad1390549f3 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:27.109795 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8670c-c100-4c25-bf6e-3ad1390549f3 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:27.109795 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8670c-c100-4c25-bf6e-3ad1390549f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:27.132395 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-0eb8670c-c100-4c25-bf6e-3ad1390549f3 None None] MFA Rules not processed for user `8e8655501613415bb94cdb1b3b599848`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:10:27.135086 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-0eb8670c-c100-4c25-bf6e-3ad1390549f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:27.211217 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1363/2727] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:10:27 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:10:27.222815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3745ec8-4aa1-4b3d-9e5e-d063fe31ecda admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:27.224689 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-a3745ec8-4aa1-4b3d-9e5e-d063fe31ecda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:27.284134 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3745ec8-4aa1-4b3d-9e5e-d063fe31ecda admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:27.287766 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7db1e-0c99-48d8-bbc4-5f5ecfa3120c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:27.288449 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7db1e-0c99-48d8-bbc4-5f5ecfa3120c service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:27.288738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7db1e-0c99-48d8-bbc4-5f5ecfa3120c service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:27.289014 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7db1e-0c99-48d8-bbc4-5f5ecfa3120c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:27.298803 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7db1e-0c99-48d8-bbc4-5f5ecfa3120c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:27.301967 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7db1e-0c99-48d8-bbc4-5f5ecfa3120c service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:27.309757 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1365/2728] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:10:27 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:10:27.455782 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8670c-c100-4c25-bf6e-3ad1390549f3 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:27.525568 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8670c-c100-4c25-bf6e-3ad1390549f3 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:27.530205 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873dc8e9-de9e-46c7-8fbd-d648d5beba9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:27.531133 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873dc8e9-de9e-46c7-8fbd-d648d5beba9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:27.531486 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873dc8e9-de9e-46c7-8fbd-d648d5beba9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:27.531806 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873dc8e9-de9e-46c7-8fbd-d648d5beba9c admin admin] PATH_INFO: `/v3/users/cdb3ec84c857464b93f15a7afd1d49ea` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:27.533012 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873dc8e9-de9e-46c7-8fbd-d648d5beba9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdb3ec84c857464b93f15a7afd1d49ea)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:27.534984 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873dc8e9-de9e-46c7-8fbd-d648d5beba9c admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:27.754263 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-873dc8e9-de9e-46c7-8fbd-d648d5beba9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdb3ec84c857464b93f15a7afd1d49ea'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:27.754921 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-873dc8e9-de9e-46c7-8fbd-d648d5beba9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdb3ec84c857464b93f15a7afd1d49ea'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:27.767190 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-873dc8e9-de9e-46c7-8fbd-d648d5beba9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdb3ec84c857464b93f15a7afd1d49ea'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:27.774015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-873dc8e9-de9e-46c7-8fbd-d648d5beba9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdb3ec84c857464b93f15a7afd1d49ea'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:27.774673 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-873dc8e9-de9e-46c7-8fbd-d648d5beba9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdb3ec84c857464b93f15a7afd1d49ea'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:27.888306 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1364/2729] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:10:27 2022] DELETE /identity/v3/users/cdb3ec84c857464b93f15a7afd1d49ea => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:10:27.893061 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68dcdbb-f6ef-4a91-83c4-4585b1fc699e None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:27.893356 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68dcdbb-f6ef-4a91-83c4-4585b1fc699e None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:27.893637 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68dcdbb-f6ef-4a91-83c4-4585b1fc699e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:27.912589 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-b68dcdbb-f6ef-4a91-83c4-4585b1fc699e None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:10:27.913816 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b68dcdbb-f6ef-4a91-83c4-4585b1fc699e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:27.973790 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1366/2730] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:10:27.983451 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873dc8e9-de9e-46c7-8fbd-d648d5beba9c admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:27.985090 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-873dc8e9-de9e-46c7-8fbd-d648d5beba9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:27.992691 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:28.045904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873dc8e9-de9e-46c7-8fbd-d648d5beba9c admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:28.049934 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0c0d8-5db2-4645-a8f9-dc3d5bfce328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:28.050592 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0c0d8-5db2-4645-a8f9-dc3d5bfce328 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:28.050880 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0c0d8-5db2-4645-a8f9-dc3d5bfce328 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:28.051158 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0c0d8-5db2-4645-a8f9-dc3d5bfce328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:28.061081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0c0d8-5db2-4645-a8f9-dc3d5bfce328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:28.062525 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0c0d8-5db2-4645-a8f9-dc3d5bfce328 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:28.072118 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1365/2731] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:10:28.581882 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68dcdbb-f6ef-4a91-83c4-4585b1fc699e None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:28.583377 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b68dcdbb-f6ef-4a91-83c4-4585b1fc699e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:28.598006 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68dcdbb-f6ef-4a91-83c4-4585b1fc699e None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:28.602914 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1195e-e545-42eb-9eb8-fbd5785c3cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:28.603937 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1195e-e545-42eb-9eb8-fbd5785c3cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:28.604317 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1195e-e545-42eb-9eb8-fbd5785c3cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:28.604669 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1195e-e545-42eb-9eb8-fbd5785c3cb8 admin admin] PATH_INFO: `/v3/projects/2df4ac5a66754a56825fbaa0f06e2d09` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:28.606021 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1195e-e545-42eb-9eb8-fbd5785c3cb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2df4ac5a66754a56825fbaa0f06e2d09)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:28.608988 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1195e-e545-42eb-9eb8-fbd5785c3cb8 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:28.747260 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:28.748841 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-ceb1195e-e545-42eb-9eb8-fbd5785c3cb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2df4ac5a66754a56825fbaa0f06e2d09', 'request_id': 'req-ceb1195e-e545-42eb-9eb8-fbd5785c3cb8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:28.755556 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-ceb1195e-e545-42eb-9eb8-fbd5785c3cb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2df4ac5a66754a56825fbaa0f06e2d09', 'request_id': 'req-ceb1195e-e545-42eb-9eb8-fbd5785c3cb8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:28.819388 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-ceb1195e-e545-42eb-9eb8-fbd5785c3cb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2df4ac5a66754a56825fbaa0f06e2d09', 'request_id': 'req-ceb1195e-e545-42eb-9eb8-fbd5785c3cb8'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:28.830468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-ceb1195e-e545-42eb-9eb8-fbd5785c3cb8 admin admin] The token cache is being invalidate because project 2df4ac5a66754a56825fbaa0f06e2d09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:10:28.830762 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-ceb1195e-e545-42eb-9eb8-fbd5785c3cb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:28.831424 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-ceb1195e-e545-42eb-9eb8-fbd5785c3cb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:28.833036 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1367/2732] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:10:28 2022] DELETE /identity/v3/projects/2df4ac5a66754a56825fbaa0f06e2d09 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:10:28.837207 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0c0d8-5db2-4645-a8f9-dc3d5bfce328 service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:28.847401 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0c0d8-5db2-4645-a8f9-dc3d5bfce328 service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:28.913822 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c24102-03a4-4b78-b4bf-847ad9dfe3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:28.914729 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c24102-03a4-4b78-b4bf-847ad9dfe3c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:28.915046 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c24102-03a4-4b78-b4bf-847ad9dfe3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:28.915401 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c24102-03a4-4b78-b4bf-847ad9dfe3c2 admin admin] PATH_INFO: `/v3/users/8e8655501613415bb94cdb1b3b599848` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:28.917270 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c24102-03a4-4b78-b4bf-847ad9dfe3c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e8655501613415bb94cdb1b3b599848)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:28.919219 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c24102-03a4-4b78-b4bf-847ad9dfe3c2 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:29.138387 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-41c24102-03a4-4b78-b4bf-847ad9dfe3c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e8655501613415bb94cdb1b3b599848'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:29.139059 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-41c24102-03a4-4b78-b4bf-847ad9dfe3c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e8655501613415bb94cdb1b3b599848'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:29.151689 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-41c24102-03a4-4b78-b4bf-847ad9dfe3c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e8655501613415bb94cdb1b3b599848'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:29.159016 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-41c24102-03a4-4b78-b4bf-847ad9dfe3c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e8655501613415bb94cdb1b3b599848'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:29.160266 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-41c24102-03a4-4b78-b4bf-847ad9dfe3c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e8655501613415bb94cdb1b3b599848'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:29.279088 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1366/2733] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:10:28 2022] DELETE /identity/v3/users/8e8655501613415bb94cdb1b3b599848 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:10:29.670984 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7e968-bb0b-4b1d-89bc-f34b1dd767f0 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:29.671546 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7e968-bb0b-4b1d-89bc-f34b1dd767f0 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:29.671546 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7e968-bb0b-4b1d-89bc-f34b1dd767f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:29.691016 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-77b7e968-bb0b-4b1d-89bc-f34b1dd767f0 None None] MFA Rules not processed for user `8874a26203f0408f8d8c9f26b2818b59`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:10:29.692198 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-77b7e968-bb0b-4b1d-89bc-f34b1dd767f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:29.760208 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1368/2734] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:10:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:10:29.776893 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c24102-03a4-4b78-b4bf-847ad9dfe3c2 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:29.778589 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-41c24102-03a4-4b78-b4bf-847ad9dfe3c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:29.826029 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:29.876265 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c24102-03a4-4b78-b4bf-847ad9dfe3c2 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:29.885529 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230357f-89e2-49e4-a309-14f3e9d6a560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:29.886623 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230357f-89e2-49e4-a309-14f3e9d6a560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:29.887037 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230357f-89e2-49e4-a309-14f3e9d6a560 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:29.887577 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230357f-89e2-49e4-a309-14f3e9d6a560 admin admin] PATH_INFO: `/v3/projects/669f363eef6942ce99c521a8e873649e` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:29.889500 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230357f-89e2-49e4-a309-14f3e9d6a560 admin admin] RBAC: Authorizing `identity:delete_project(project_id=669f363eef6942ce99c521a8e873649e)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:29.893567 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230357f-89e2-49e4-a309-14f3e9d6a560 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:30.022343 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7230357f-89e2-49e4-a309-14f3e9d6a560 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '669f363eef6942ce99c521a8e873649e', 'request_id': 'req-7230357f-89e2-49e4-a309-14f3e9d6a560'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:30.029057 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7230357f-89e2-49e4-a309-14f3e9d6a560 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '669f363eef6942ce99c521a8e873649e', 'request_id': 'req-7230357f-89e2-49e4-a309-14f3e9d6a560'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:30.035145 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7230357f-89e2-49e4-a309-14f3e9d6a560 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '669f363eef6942ce99c521a8e873649e', 'request_id': 'req-7230357f-89e2-49e4-a309-14f3e9d6a560'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:30.116737 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7230357f-89e2-49e4-a309-14f3e9d6a560 admin admin] The token cache is being invalidate because project 669f363eef6942ce99c521a8e873649e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:10:30.122772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7230357f-89e2-49e4-a309-14f3e9d6a560 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:30.122772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7230357f-89e2-49e4-a309-14f3e9d6a560 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:30.122772 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1367/2735] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:10:29 2022] DELETE /identity/v3/projects/669f363eef6942ce99c521a8e873649e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:10:30.124410 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703d317-c1f9-46c6-b3a7-f579c7d86f96 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:30.124738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703d317-c1f9-46c6-b3a7-f579c7d86f96 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:30.125610 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703d317-c1f9-46c6-b3a7-f579c7d86f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:30.145517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-1703d317-c1f9-46c6-b3a7-f579c7d86f96 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:10:30.146736 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-1703d317-c1f9-46c6-b3a7-f579c7d86f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:30.208685 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1369/2736] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:10:30.216267 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c888b8-c5fd-4c9e-aedc-7d4978ec7fc5 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:30.216564 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c888b8-c5fd-4c9e-aedc-7d4978ec7fc5 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:30.216853 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c888b8-c5fd-4c9e-aedc-7d4978ec7fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:30.236007 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-99c888b8-c5fd-4c9e-aedc-7d4978ec7fc5 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:10:30.237258 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-99c888b8-c5fd-4c9e-aedc-7d4978ec7fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:30.245453 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1368/2737] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:10:30.250598 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703d317-c1f9-46c6-b3a7-f579c7d86f96 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:30.260645 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703d317-c1f9-46c6-b3a7-f579c7d86f96 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:30.266063 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c0d84-ac5d-4667-a12f-5946310a6d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:30.266662 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c0d84-ac5d-4667-a12f-5946310a6d51 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:30.266947 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c0d84-ac5d-4667-a12f-5946310a6d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:30.267222 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c0d84-ac5d-4667-a12f-5946310a6d51 admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:30.267956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c0d84-ac5d-4667-a12f-5946310a6d51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:10:30.268678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c0d84-ac5d-4667-a12f-5946310a6d51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:30.270272 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c0d84-ac5d-4667-a12f-5946310a6d51 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:30.284519 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1370/2738] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 16:10:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:10:30.288810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c888b8-c5fd-4c9e-aedc-7d4978ec7fc5 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:30.298616 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c888b8-c5fd-4c9e-aedc-7d4978ec7fc5 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:30.303477 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a3eaf-fef8-4835-ba68-0fac17ea9fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:30.304908 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a3eaf-fef8-4835-ba68-0fac17ea9fba admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:30.305201 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a3eaf-fef8-4835-ba68-0fac17ea9fba admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:30.305485 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a3eaf-fef8-4835-ba68-0fac17ea9fba admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:30.306303 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a3eaf-fef8-4835-ba68-0fac17ea9fba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:30.308334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a3eaf-fef8-4835-ba68-0fac17ea9fba admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:30.399415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1369/2739] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:10:30 2022] POST /identity/v3/projects => generated 382 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:10:30.403628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c0d84-ac5d-4667-a12f-5946310a6d51 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:30.414512 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c0d84-ac5d-4667-a12f-5946310a6d51 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:30.472391 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628714c7-761c-4460-ab87-ad36f6ef281d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:30.473075 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628714c7-761c-4460-ab87-ad36f6ef281d admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:30.473367 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628714c7-761c-4460-ab87-ad36f6ef281d admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:30.473653 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628714c7-761c-4460-ab87-ad36f6ef281d admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:30.474356 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628714c7-761c-4460-ab87-ad36f6ef281d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:30.476289 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628714c7-761c-4460-ab87-ad36f6ef281d admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:30.609015 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:30.617252 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1371/2740] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:10:30 2022] POST /identity/v3/users => generated 292 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:10:30.620015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a3eaf-fef8-4835-ba68-0fac17ea9fba admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:30.632079 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a3eaf-fef8-4835-ba68-0fac17ea9fba admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:30.640048 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e892736-96f5-4855-86a7-8a5826762a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:30.641197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e892736-96f5-4855-86a7-8a5826762a77 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:30.641539 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e892736-96f5-4855-86a7-8a5826762a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:30.641828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e892736-96f5-4855-86a7-8a5826762a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:30.642602 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e892736-96f5-4855-86a7-8a5826762a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:30.644232 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e892736-96f5-4855-86a7-8a5826762a77 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:30.656081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1370/2741] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:10:30 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:10:30.659983 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628714c7-761c-4460-ab87-ad36f6ef281d admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:30.669990 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628714c7-761c-4460-ab87-ad36f6ef281d admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:30.676393 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9aa644-e662-45cd-9b7b-a9f75d29a1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:30.677064 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9aa644-e662-45cd-9b7b-a9f75d29a1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:30.677350 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9aa644-e662-45cd-9b7b-a9f75d29a1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:30.677630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9aa644-e662-45cd-9b7b-a9f75d29a1e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:30.678359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9aa644-e662-45cd-9b7b-a9f75d29a1e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:30.679940 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9aa644-e662-45cd-9b7b-a9f75d29a1e4 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:30.691188 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1372/2742] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:10:30 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:10:30.695555 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e892736-96f5-4855-86a7-8a5826762a77 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:30.705594 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e892736-96f5-4855-86a7-8a5826762a77 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:30.710166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67dd073-d2ba-46de-a23f-6f79f96ca022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:30.711046 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dd073-d2ba-46de-a23f-6f79f96ca022 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:30.711334 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dd073-d2ba-46de-a23f-6f79f96ca022 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:30.711615 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dd073-d2ba-46de-a23f-6f79f96ca022 admin admin] PATH_INFO: `/v3/projects/a8347e380b3d4b97b8dc92620edad18d/users/2428c37bac454b13a522baf4c37c2da3/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:30.726826 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67dd073-d2ba-46de-a23f-6f79f96ca022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8347e380b3d4b97b8dc92620edad18d, user_id=2428c37bac454b13a522baf4c37c2da3, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:30.729610 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67dd073-d2ba-46de-a23f-6f79f96ca022 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:30.808604 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1371/2743] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:10:30 2022] PUT /identity/v3/projects/a8347e380b3d4b97b8dc92620edad18d/users/2428c37bac454b13a522baf4c37c2da3/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:10:30.820845 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4440457-537d-4019-8dcb-594529742cd6 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:30.821140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4440457-537d-4019-8dcb-594529742cd6 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:30.821423 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4440457-537d-4019-8dcb-594529742cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:30.849306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-a4440457-537d-4019-8dcb-594529742cd6 None None] MFA Rules not processed for user `2428c37bac454b13a522baf4c37c2da3`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:10:30.850518 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-a4440457-537d-4019-8dcb-594529742cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:30.917033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1373/2744] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:10:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:10:30.921524 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67dd073-d2ba-46de-a23f-6f79f96ca022 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:30.975264 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:30.986125 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67dd073-d2ba-46de-a23f-6f79f96ca022 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:30.990789 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd38a5b-aae6-4fb7-a741-7ea12f815792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:30.991453 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd38a5b-aae6-4fb7-a741-7ea12f815792 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:30.991769 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd38a5b-aae6-4fb7-a741-7ea12f815792 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:30.992080 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd38a5b-aae6-4fb7-a741-7ea12f815792 admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:30.992801 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd38a5b-aae6-4fb7-a741-7ea12f815792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:30.994720 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd38a5b-aae6-4fb7-a741-7ea12f815792 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:31.101472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1372/2745] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:10:30 2022] POST /identity/v3/projects => generated 382 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:10:31.105578 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4440457-537d-4019-8dcb-594529742cd6 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:31.117869 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4440457-537d-4019-8dcb-594529742cd6 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:31.177235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014922f-c829-439c-ad0c-07a7f8d62714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:31.178005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014922f-c829-439c-ad0c-07a7f8d62714 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:31.178275 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014922f-c829-439c-ad0c-07a7f8d62714 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:31.182672 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014922f-c829-439c-ad0c-07a7f8d62714 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:31.182672 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014922f-c829-439c-ad0c-07a7f8d62714 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:31.182672 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014922f-c829-439c-ad0c-07a7f8d62714 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:31.290856 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1374/2746] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:10:31 2022] POST /identity/v3/users => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:10:31.293540 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd38a5b-aae6-4fb7-a741-7ea12f815792 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:31.304760 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd38a5b-aae6-4fb7-a741-7ea12f815792 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:31.309299 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29079e-1cc9-40e4-861d-d9b1e8800f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:31.309995 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29079e-1cc9-40e4-861d-d9b1e8800f8c admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:31.310579 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29079e-1cc9-40e4-861d-d9b1e8800f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:31.310965 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29079e-1cc9-40e4-861d-d9b1e8800f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:31.311985 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29079e-1cc9-40e4-861d-d9b1e8800f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:31.313757 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29079e-1cc9-40e4-861d-d9b1e8800f8c admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:31.326295 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1373/2747] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:10:31 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:10:31.330648 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014922f-c829-439c-ad0c-07a7f8d62714 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:31.340925 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014922f-c829-439c-ad0c-07a7f8d62714 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:31.346391 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a806471-7ead-4011-916d-eac162501321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:31.347277 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a806471-7ead-4011-916d-eac162501321 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:31.347562 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a806471-7ead-4011-916d-eac162501321 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:31.347839 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a806471-7ead-4011-916d-eac162501321 admin admin] PATH_INFO: `/v3/projects/77db2cd3f207428cae009e7c29a1c50f/users/bbb22454aaa44efe8ea2061b3b92076d/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:31.363833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a806471-7ead-4011-916d-eac162501321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77db2cd3f207428cae009e7c29a1c50f, user_id=bbb22454aaa44efe8ea2061b3b92076d, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:31.366633 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a806471-7ead-4011-916d-eac162501321 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:31.477765 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1375/2748] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:10:31 2022] PUT /identity/v3/projects/77db2cd3f207428cae009e7c29a1c50f/users/bbb22454aaa44efe8ea2061b3b92076d/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:10:31.481844 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29079e-1cc9-40e4-861d-d9b1e8800f8c admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:31.492186 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29079e-1cc9-40e4-861d-d9b1e8800f8c admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:31.551704 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934ee3c-37e7-4f4f-b6a1-a20af36763ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:31.554911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934ee3c-37e7-4f4f-b6a1-a20af36763ae admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:31.554911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934ee3c-37e7-4f4f-b6a1-a20af36763ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:31.554911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934ee3c-37e7-4f4f-b6a1-a20af36763ae admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:31.554911 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934ee3c-37e7-4f4f-b6a1-a20af36763ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:31.555377 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934ee3c-37e7-4f4f-b6a1-a20af36763ae admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:31.566743 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1374/2749] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:10:31 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:10:31.571080 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a806471-7ead-4011-916d-eac162501321 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:31.582312 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a806471-7ead-4011-916d-eac162501321 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:31.586998 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12053aa0-1060-405d-8fa5-ab1a7451a07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:31.588011 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12053aa0-1060-405d-8fa5-ab1a7451a07e admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:31.588338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12053aa0-1060-405d-8fa5-ab1a7451a07e admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:31.588618 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12053aa0-1060-405d-8fa5-ab1a7451a07e admin admin] PATH_INFO: `/v3/projects/77db2cd3f207428cae009e7c29a1c50f/users/bbb22454aaa44efe8ea2061b3b92076d/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:31.590635 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12053aa0-1060-405d-8fa5-ab1a7451a07e admin admin] RBAC: Authorizing `identity:create_grant(project_id=77db2cd3f207428cae009e7c29a1c50f, user_id=bbb22454aaa44efe8ea2061b3b92076d, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:31.593309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12053aa0-1060-405d-8fa5-ab1a7451a07e admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:31.605485 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1376/2750] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:10:31 2022] PUT /identity/v3/projects/77db2cd3f207428cae009e7c29a1c50f/users/bbb22454aaa44efe8ea2061b3b92076d/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:10:31.615611 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c57d9f-a939-474f-8459-0fa400c4ed79 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:31.615894 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c57d9f-a939-474f-8459-0fa400c4ed79 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:31.616246 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c57d9f-a939-474f-8459-0fa400c4ed79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:31.646647 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-92c57d9f-a939-474f-8459-0fa400c4ed79 None None] MFA Rules not processed for user `bbb22454aaa44efe8ea2061b3b92076d`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:10:31.648219 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-92c57d9f-a939-474f-8459-0fa400c4ed79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:31.725656 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1375/2751] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:10:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:10:31.737261 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12053aa0-1060-405d-8fa5-ab1a7451a07e admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:31.738990 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-12053aa0-1060-405d-8fa5-ab1a7451a07e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:31.772587 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:31.798893 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12053aa0-1060-405d-8fa5-ab1a7451a07e admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:31.802626 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddc976-9f42-41a0-8881-2cdc9955bab7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:31.803282 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddc976-9f42-41a0-8881-2cdc9955bab7 service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:31.803573 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddc976-9f42-41a0-8881-2cdc9955bab7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:31.803858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddc976-9f42-41a0-8881-2cdc9955bab7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:31.814409 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ddc976-9f42-41a0-8881-2cdc9955bab7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:31.815834 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ddc976-9f42-41a0-8881-2cdc9955bab7 service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:31.825362 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1377/2752] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:10:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:10:32.342654 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c57d9f-a939-474f-8459-0fa400c4ed79 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:32.391852 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:32.405293 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c57d9f-a939-474f-8459-0fa400c4ed79 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:32.410326 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4e132-787a-4a57-ae2c-333845996ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:32.411202 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4e132-787a-4a57-ae2c-333845996ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:32.411516 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4e132-787a-4a57-ae2c-333845996ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:32.411811 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4e132-787a-4a57-ae2c-333845996ddd admin admin] PATH_INFO: `/v3/users/2428c37bac454b13a522baf4c37c2da3` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:32.413091 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4e132-787a-4a57-ae2c-333845996ddd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2428c37bac454b13a522baf4c37c2da3)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:32.415015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4e132-787a-4a57-ae2c-333845996ddd admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:32.799755 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-f4c4e132-787a-4a57-ae2c-333845996ddd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2428c37bac454b13a522baf4c37c2da3'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:32.800460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-f4c4e132-787a-4a57-ae2c-333845996ddd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2428c37bac454b13a522baf4c37c2da3'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:32.818948 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-f4c4e132-787a-4a57-ae2c-333845996ddd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2428c37bac454b13a522baf4c37c2da3'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:32.830004 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-f4c4e132-787a-4a57-ae2c-333845996ddd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2428c37bac454b13a522baf4c37c2da3'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:32.830742 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-f4c4e132-787a-4a57-ae2c-333845996ddd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2428c37bac454b13a522baf4c37c2da3'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:32.936173 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1376/2753] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:10:32 2022] DELETE /identity/v3/users/2428c37bac454b13a522baf4c37c2da3 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:10:32.941516 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfac26e-1aaa-4522-9415-a95f3757e7c3 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:32.942010 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfac26e-1aaa-4522-9415-a95f3757e7c3 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:32.942123 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfac26e-1aaa-4522-9415-a95f3757e7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:32.970871 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-6dfac26e-1aaa-4522-9415-a95f3757e7c3 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:10:32.972256 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-6dfac26e-1aaa-4522-9415-a95f3757e7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:33.052072 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1378/2754] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:10:33.069594 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4e132-787a-4a57-ae2c-333845996ddd admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:33.071119 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-f4c4e132-787a-4a57-ae2c-333845996ddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:33.150106 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4e132-787a-4a57-ae2c-333845996ddd admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:33.154117 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b92c8-9d60-4d2d-a2b1-d5927db23d8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:33.154852 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b92c8-9d60-4d2d-a2b1-d5927db23d8f service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:33.155209 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b92c8-9d60-4d2d-a2b1-d5927db23d8f service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:33.155601 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b92c8-9d60-4d2d-a2b1-d5927db23d8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:33.173869 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b92c8-9d60-4d2d-a2b1-d5927db23d8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:33.175563 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b92c8-9d60-4d2d-a2b1-d5927db23d8f service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:33.187336 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1377/2755] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:10:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:10:33.915925 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfac26e-1aaa-4522-9415-a95f3757e7c3 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:33.917426 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-6dfac26e-1aaa-4522-9415-a95f3757e7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:33.931220 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfac26e-1aaa-4522-9415-a95f3757e7c3 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:33.937294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9050e3-4a5d-4951-9fdc-d897066ceb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:33.938171 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9050e3-4a5d-4951-9fdc-d897066ceb6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:33.939104 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9050e3-4a5d-4951-9fdc-d897066ceb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:33.939396 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9050e3-4a5d-4951-9fdc-d897066ceb6f admin admin] PATH_INFO: `/v3/projects/a8347e380b3d4b97b8dc92620edad18d` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:33.940852 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9050e3-4a5d-4951-9fdc-d897066ceb6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8347e380b3d4b97b8dc92620edad18d)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:33.950445 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9050e3-4a5d-4951-9fdc-d897066ceb6f admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:34.089895 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-3f9050e3-4a5d-4951-9fdc-d897066ceb6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8347e380b3d4b97b8dc92620edad18d', 'request_id': 'req-3f9050e3-4a5d-4951-9fdc-d897066ceb6f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:34.099456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-3f9050e3-4a5d-4951-9fdc-d897066ceb6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8347e380b3d4b97b8dc92620edad18d', 'request_id': 'req-3f9050e3-4a5d-4951-9fdc-d897066ceb6f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:34.202865 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-3f9050e3-4a5d-4951-9fdc-d897066ceb6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8347e380b3d4b97b8dc92620edad18d', 'request_id': 'req-3f9050e3-4a5d-4951-9fdc-d897066ceb6f'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:34.215866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-3f9050e3-4a5d-4951-9fdc-d897066ceb6f admin admin] The token cache is being invalidate because project a8347e380b3d4b97b8dc92620edad18d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:10:34.216208 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-3f9050e3-4a5d-4951-9fdc-d897066ceb6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:34.217056 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-3f9050e3-4a5d-4951-9fdc-d897066ceb6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:34.218647 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1379/2756] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:10:33 2022] DELETE /identity/v3/projects/a8347e380b3d4b97b8dc92620edad18d => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:10:34.223410 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b92c8-9d60-4d2d-a2b1-d5927db23d8f service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:34.233901 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b92c8-9d60-4d2d-a2b1-d5927db23d8f service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:34.300673 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d985c-3f60-446e-98a0-9afd7f69296d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:34.300673 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d985c-3f60-446e-98a0-9afd7f69296d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:34.300673 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d985c-3f60-446e-98a0-9afd7f69296d admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:34.301113 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d985c-3f60-446e-98a0-9afd7f69296d admin admin] PATH_INFO: `/v3/users/bbb22454aaa44efe8ea2061b3b92076d` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:34.302049 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d985c-3f60-446e-98a0-9afd7f69296d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbb22454aaa44efe8ea2061b3b92076d)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:34.305289 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d985c-3f60-446e-98a0-9afd7f69296d admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:34.322931 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:34.467457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-459d985c-3f60-446e-98a0-9afd7f69296d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbb22454aaa44efe8ea2061b3b92076d'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:34.468165 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-459d985c-3f60-446e-98a0-9afd7f69296d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbb22454aaa44efe8ea2061b3b92076d'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:34.480865 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-459d985c-3f60-446e-98a0-9afd7f69296d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbb22454aaa44efe8ea2061b3b92076d'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:34.490198 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-459d985c-3f60-446e-98a0-9afd7f69296d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbb22454aaa44efe8ea2061b3b92076d'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:34.490959 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-459d985c-3f60-446e-98a0-9afd7f69296d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbb22454aaa44efe8ea2061b3b92076d'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:34.597998 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1378/2757] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:10:34 2022] DELETE /identity/v3/users/bbb22454aaa44efe8ea2061b3b92076d => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:10:35.068234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9050e3-4a5d-4951-9fdc-d897066ceb6f admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:35.069839 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-3f9050e3-4a5d-4951-9fdc-d897066ceb6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:35.095391 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9050e3-4a5d-4951-9fdc-d897066ceb6f admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:35.171764 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:35.180942 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda1ab7-0762-437e-b4ee-7f564fd2e950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:35.182029 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda1ab7-0762-437e-b4ee-7f564fd2e950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:35.182329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda1ab7-0762-437e-b4ee-7f564fd2e950 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:35.182619 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda1ab7-0762-437e-b4ee-7f564fd2e950 admin admin] PATH_INFO: `/v3/projects/77db2cd3f207428cae009e7c29a1c50f` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:35.183901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda1ab7-0762-437e-b4ee-7f564fd2e950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77db2cd3f207428cae009e7c29a1c50f)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:35.186163 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda1ab7-0762-437e-b4ee-7f564fd2e950 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:35.336338 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-6bda1ab7-0762-437e-b4ee-7f564fd2e950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77db2cd3f207428cae009e7c29a1c50f', 'request_id': 'req-6bda1ab7-0762-437e-b4ee-7f564fd2e950'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:35.342690 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-6bda1ab7-0762-437e-b4ee-7f564fd2e950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77db2cd3f207428cae009e7c29a1c50f', 'request_id': 'req-6bda1ab7-0762-437e-b4ee-7f564fd2e950'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:35.448052 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-6bda1ab7-0762-437e-b4ee-7f564fd2e950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77db2cd3f207428cae009e7c29a1c50f', 'request_id': 'req-6bda1ab7-0762-437e-b4ee-7f564fd2e950'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:35.459385 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-6bda1ab7-0762-437e-b4ee-7f564fd2e950 admin admin] The token cache is being invalidate because project 77db2cd3f207428cae009e7c29a1c50f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:10:35.459680 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-6bda1ab7-0762-437e-b4ee-7f564fd2e950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:35.460354 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-6bda1ab7-0762-437e-b4ee-7f564fd2e950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:35.463509 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1380/2758] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:10:35 2022] DELETE /identity/v3/projects/77db2cd3f207428cae009e7c29a1c50f => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:10:35.466879 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784548b-4ad1-4091-8d38-da2a32dc92e4 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:35.467366 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784548b-4ad1-4091-8d38-da2a32dc92e4 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:35.467482 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784548b-4ad1-4091-8d38-da2a32dc92e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:35.486794 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-5784548b-4ad1-4091-8d38-da2a32dc92e4 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:10:35.487959 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-5784548b-4ad1-4091-8d38-da2a32dc92e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:35.550859 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1379/2759] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:10:35.559114 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea441cf7-5220-476c-a71e-8aa328f5cc61 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:35.559682 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea441cf7-5220-476c-a71e-8aa328f5cc61 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:35.560366 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea441cf7-5220-476c-a71e-8aa328f5cc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:35.581501 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-ea441cf7-5220-476c-a71e-8aa328f5cc61 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:10:35.582810 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-ea441cf7-5220-476c-a71e-8aa328f5cc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:35.591998 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1381/2760] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:10:35.597350 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784548b-4ad1-4091-8d38-da2a32dc92e4 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:35.607868 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784548b-4ad1-4091-8d38-da2a32dc92e4 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:35.615168 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab95fe-f19f-4eb2-9e39-22e23ea29cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:35.615886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab95fe-f19f-4eb2-9e39-22e23ea29cec admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:35.616211 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab95fe-f19f-4eb2-9e39-22e23ea29cec admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:35.616503 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab95fe-f19f-4eb2-9e39-22e23ea29cec admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:35.617250 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab95fe-f19f-4eb2-9e39-22e23ea29cec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:10:35.617575 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab95fe-f19f-4eb2-9e39-22e23ea29cec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:35.619289 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab95fe-f19f-4eb2-9e39-22e23ea29cec admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:35.636738 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1380/2761] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 16:10:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:10:35.641090 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea441cf7-5220-476c-a71e-8aa328f5cc61 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:35.654326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea441cf7-5220-476c-a71e-8aa328f5cc61 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:35.661110 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3fada-ae05-4b2f-9585-96ed960769f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:35.661863 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3fada-ae05-4b2f-9585-96ed960769f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:35.662149 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3fada-ae05-4b2f-9585-96ed960769f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:35.662428 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3fada-ae05-4b2f-9585-96ed960769f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:35.663158 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3fada-ae05-4b2f-9585-96ed960769f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:35.666409 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3fada-ae05-4b2f-9585-96ed960769f3 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:35.754001 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1382/2762] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:10:35 2022] POST /identity/v3/projects => generated 374 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:10:35.759302 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab95fe-f19f-4eb2-9e39-22e23ea29cec admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:35.768376 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab95fe-f19f-4eb2-9e39-22e23ea29cec admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:35.833157 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0313dea-4149-459c-8a43-165a9c25f5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:35.833863 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0313dea-4149-459c-8a43-165a9c25f5e4 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:35.834151 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0313dea-4149-459c-8a43-165a9c25f5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:35.834432 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0313dea-4149-459c-8a43-165a9c25f5e4 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:35.835139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0313dea-4149-459c-8a43-165a9c25f5e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:35.837275 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0313dea-4149-459c-8a43-165a9c25f5e4 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:35.948330 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1381/2763] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:10:35 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:10:35.952561 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3fada-ae05-4b2f-9585-96ed960769f3 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:35.964442 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3fada-ae05-4b2f-9585-96ed960769f3 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:35.969441 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f9f03-1ea3-43fc-941e-f7cb829be3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:35.972600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f9f03-1ea3-43fc-941e-f7cb829be3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:35.972600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f9f03-1ea3-43fc-941e-f7cb829be3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:35.972600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f9f03-1ea3-43fc-941e-f7cb829be3c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:35.972600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f9f03-1ea3-43fc-941e-f7cb829be3c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:35.974082 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f9f03-1ea3-43fc-941e-f7cb829be3c0 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:35.993469 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1383/2764] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:10:35 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 16:10:35.994838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0313dea-4149-459c-8a43-165a9c25f5e4 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:36.016451 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0313dea-4149-459c-8a43-165a9c25f5e4 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:36.021659 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e8908-5106-4b11-8e93-e03a504751a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:36.022338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e8908-5106-4b11-8e93-e03a504751a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:36.022624 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e8908-5106-4b11-8e93-e03a504751a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:36.023044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e8908-5106-4b11-8e93-e03a504751a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:36.023792 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e8908-5106-4b11-8e93-e03a504751a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:36.025711 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e8908-5106-4b11-8e93-e03a504751a1 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:36.027211 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:36.041915 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1382/2765] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:10:35 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:10:36.043375 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f9f03-1ea3-43fc-941e-f7cb829be3c0 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:36.055552 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f9f03-1ea3-43fc-941e-f7cb829be3c0 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:36.060600 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4219e-3d5a-42c6-9990-b4aca77f414c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:36.061512 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4219e-3d5a-42c6-9990-b4aca77f414c admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:36.061797 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4219e-3d5a-42c6-9990-b4aca77f414c admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:36.062075 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4219e-3d5a-42c6-9990-b4aca77f414c admin admin] PATH_INFO: `/v3/projects/96285f26962842dd93ab8b9c3a752cde/users/63abd2c420ee46f99e88f555e0a773c5/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:36.079832 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4219e-3d5a-42c6-9990-b4aca77f414c admin admin] RBAC: Authorizing `identity:create_grant(project_id=96285f26962842dd93ab8b9c3a752cde, user_id=63abd2c420ee46f99e88f555e0a773c5, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:36.082827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4219e-3d5a-42c6-9990-b4aca77f414c admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:36.181405 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1384/2766] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:10:36 2022] PUT /identity/v3/projects/96285f26962842dd93ab8b9c3a752cde/users/63abd2c420ee46f99e88f555e0a773c5/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:10:36.193839 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900557b-b32a-4459-8a4e-69cc9903e8ef None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:36.194138 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900557b-b32a-4459-8a4e-69cc9903e8ef None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:36.194419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900557b-b32a-4459-8a4e-69cc9903e8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:36.221219 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-9900557b-b32a-4459-8a4e-69cc9903e8ef None None] MFA Rules not processed for user `63abd2c420ee46f99e88f555e0a773c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:10:36.222529 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-9900557b-b32a-4459-8a4e-69cc9903e8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:36.293843 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1383/2767] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:10:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:10:36.305544 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4219e-3d5a-42c6-9990-b4aca77f414c admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:36.307306 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-65d4219e-3d5a-42c6-9990-b4aca77f414c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:36.384661 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4219e-3d5a-42c6-9990-b4aca77f414c admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:36.388400 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5015977-57ed-4440-be0b-e11af2c15d65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:36.389062 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5015977-57ed-4440-be0b-e11af2c15d65 service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:36.389348 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5015977-57ed-4440-be0b-e11af2c15d65 service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:36.389629 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5015977-57ed-4440-be0b-e11af2c15d65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:36.399374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5015977-57ed-4440-be0b-e11af2c15d65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:36.400846 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5015977-57ed-4440-be0b-e11af2c15d65 service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:36.410042 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1385/2768] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:10:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:10:46.290682 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=34 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:46.405649 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:51.041097 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900557b-b32a-4459-8a4e-69cc9903e8ef None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:51.107155 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900557b-b32a-4459-8a4e-69cc9903e8ef None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:51.112646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d618b9-b06f-410b-9546-124399bb9123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:51.113667 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d618b9-b06f-410b-9546-124399bb9123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:51.114065 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d618b9-b06f-410b-9546-124399bb9123 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:51.114450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d618b9-b06f-410b-9546-124399bb9123 admin admin] PATH_INFO: `/v3/users/63abd2c420ee46f99e88f555e0a773c5` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:51.115898 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d618b9-b06f-410b-9546-124399bb9123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63abd2c420ee46f99e88f555e0a773c5)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:51.118418 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d618b9-b06f-410b-9546-124399bb9123 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:51.331008 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-10d618b9-b06f-410b-9546-124399bb9123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63abd2c420ee46f99e88f555e0a773c5'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:51.331744 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-10d618b9-b06f-410b-9546-124399bb9123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63abd2c420ee46f99e88f555e0a773c5'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:51.343610 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-10d618b9-b06f-410b-9546-124399bb9123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63abd2c420ee46f99e88f555e0a773c5'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:51.351828 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-10d618b9-b06f-410b-9546-124399bb9123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63abd2c420ee46f99e88f555e0a773c5'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:51.352515 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-10d618b9-b06f-410b-9546-124399bb9123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63abd2c420ee46f99e88f555e0a773c5'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:51.436949 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1384/2769] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:10:51 2022] DELETE /identity/v3/users/63abd2c420ee46f99e88f555e0a773c5 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:10:51.441547 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c73e10-4eff-4ca4-ab58-4c110185cfee None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:51.442047 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c73e10-4eff-4ca4-ab58-4c110185cfee None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:51.442159 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c73e10-4eff-4ca4-ab58-4c110185cfee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:51.458756 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-59c73e10-4eff-4ca4-ab58-4c110185cfee None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:10:51.459956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-59c73e10-4eff-4ca4-ab58-4c110185cfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:51.520802 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1386/2770] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:10:51.530522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d618b9-b06f-410b-9546-124399bb9123 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:51.532845 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-10d618b9-b06f-410b-9546-124399bb9123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:51.589059 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d618b9-b06f-410b-9546-124399bb9123 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:51.592723 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9adb9b-a89f-471e-a2fd-bd40ae56125d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:51.593401 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9adb9b-a89f-471e-a2fd-bd40ae56125d service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:51.593718 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9adb9b-a89f-471e-a2fd-bd40ae56125d service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:51.594001 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9adb9b-a89f-471e-a2fd-bd40ae56125d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:51.609041 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9adb9b-a89f-471e-a2fd-bd40ae56125d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:51.612903 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9adb9b-a89f-471e-a2fd-bd40ae56125d service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:51.624945 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1385/2771] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:10:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:10:52.044390 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c73e10-4eff-4ca4-ab58-4c110185cfee None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:52.045832 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-59c73e10-4eff-4ca4-ab58-4c110185cfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:52.059271 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c73e10-4eff-4ca4-ab58-4c110185cfee None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:52.063981 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38595d56-64ee-452c-88b7-476d121de373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:52.065428 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38595d56-64ee-452c-88b7-476d121de373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:52.065587 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38595d56-64ee-452c-88b7-476d121de373 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:52.065759 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38595d56-64ee-452c-88b7-476d121de373 admin admin] PATH_INFO: `/v3/projects/96285f26962842dd93ab8b9c3a752cde` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:52.066978 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38595d56-64ee-452c-88b7-476d121de373 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96285f26962842dd93ab8b9c3a752cde)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:52.068959 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38595d56-64ee-452c-88b7-476d121de373 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:52.157073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-38595d56-64ee-452c-88b7-476d121de373 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96285f26962842dd93ab8b9c3a752cde', 'request_id': 'req-38595d56-64ee-452c-88b7-476d121de373'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:52.164157 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-38595d56-64ee-452c-88b7-476d121de373 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96285f26962842dd93ab8b9c3a752cde', 'request_id': 'req-38595d56-64ee-452c-88b7-476d121de373'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:52.265860 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-38595d56-64ee-452c-88b7-476d121de373 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96285f26962842dd93ab8b9c3a752cde', 'request_id': 'req-38595d56-64ee-452c-88b7-476d121de373'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:52.278112 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-38595d56-64ee-452c-88b7-476d121de373 admin admin] The token cache is being invalidate because project 96285f26962842dd93ab8b9c3a752cde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:10:52.278402 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-38595d56-64ee-452c-88b7-476d121de373 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:52.279044 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-38595d56-64ee-452c-88b7-476d121de373 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:52.280738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1387/2772] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:10:52 2022] DELETE /identity/v3/projects/96285f26962842dd93ab8b9c3a752cde => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:11:01.620431 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:02.274816 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:30.779609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9adb9b-a89f-471e-a2fd-bd40ae56125d service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:30.781043 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-5c9adb9b-a89f-471e-a2fd-bd40ae56125d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:30.792300 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9adb9b-a89f-471e-a2fd-bd40ae56125d service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:30.842401 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b0bed-2273-4e03-b6f8-337694533eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:30.843054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b0bed-2273-4e03-b6f8-337694533eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:30.843344 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b0bed-2273-4e03-b6f8-337694533eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:30.844144 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b0bed-2273-4e03-b6f8-337694533eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:30.846195 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-4a7b0bed-2273-4e03-b6f8-337694533eb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:30.904766 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b0bed-2273-4e03-b6f8-337694533eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:30.906209 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b0bed-2273-4e03-b6f8-337694533eb3 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:30.915127 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1386/2773] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:11:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:11:36.956871 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38595d56-64ee-452c-88b7-476d121de373 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:36.958407 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-38595d56-64ee-452c-88b7-476d121de373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:36.972315 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38595d56-64ee-452c-88b7-476d121de373 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:36.975917 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dedcae-53ef-4f00-a87e-5757fecbf671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:36.976602 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dedcae-53ef-4f00-a87e-5757fecbf671 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:36.976895 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dedcae-53ef-4f00-a87e-5757fecbf671 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:36.977178 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dedcae-53ef-4f00-a87e-5757fecbf671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:36.979035 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-49dedcae-53ef-4f00-a87e-5757fecbf671 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:37.056644 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dedcae-53ef-4f00-a87e-5757fecbf671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:37.058091 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dedcae-53ef-4f00-a87e-5757fecbf671 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:37.069297 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1388/2774] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:11:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:11:38.509041 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b0bed-2273-4e03-b6f8-337694533eb3 service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:38.519704 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b0bed-2273-4e03-b6f8-337694533eb3 service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:38.523413 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0b336-7da1-4dc7-bdc7-7d0a1d21bdb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:38.524167 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0b336-7da1-4dc7-bdc7-7d0a1d21bdb8 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:38.524460 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0b336-7da1-4dc7-bdc7-7d0a1d21bdb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:38.524743 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0b336-7da1-4dc7-bdc7-7d0a1d21bdb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:38.526532 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-ffa0b336-7da1-4dc7-bdc7-7d0a1d21bdb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:38.590001 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa0b336-7da1-4dc7-bdc7-7d0a1d21bdb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:38.591565 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa0b336-7da1-4dc7-bdc7-7d0a1d21bdb8 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:38.601624 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1387/2775] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:11:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:11:42.073722 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dedcae-53ef-4f00-a87e-5757fecbf671 service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:42.077076 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-49dedcae-53ef-4f00-a87e-5757fecbf671 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:42.149047 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dedcae-53ef-4f00-a87e-5757fecbf671 service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:42.154552 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c75cdc-cd44-4062-bce6-50950e400d08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716cbbfeede34885b0411e5b9b25df47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:42.155210 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c75cdc-cd44-4062-bce6-50950e400d08 service placement] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:42.155501 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c75cdc-cd44-4062-bce6-50950e400d08 service placement] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:42.155786 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c75cdc-cd44-4062-bce6-50950e400d08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:42.157656 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-66c75cdc-cd44-4062-bce6-50950e400d08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:42.170757 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c75cdc-cd44-4062-bce6-50950e400d08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:42.172514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c75cdc-cd44-4062-bce6-50950e400d08 service placement] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:42.188877 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1389/2776] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:11:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:11:45.708687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0b336-7da1-4dc7-bdc7-7d0a1d21bdb8 service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:45.720382 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0b336-7da1-4dc7-bdc7-7d0a1d21bdb8 service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:45.734507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ad825-e89e-48af-bcad-4957b963bd06 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716cbbfeede34885b0411e5b9b25df47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:45.735186 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ad825-e89e-48af-bcad-4957b963bd06 service placement] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:45.735477 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ad825-e89e-48af-bcad-4957b963bd06 service placement] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:45.735758 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ad825-e89e-48af-bcad-4957b963bd06 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:45.737838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-ff4ad825-e89e-48af-bcad-4957b963bd06 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:45.750707 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ad825-e89e-48af-bcad-4957b963bd06 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:45.752355 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ad825-e89e-48af-bcad-4957b963bd06 service placement] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:45.764863 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1388/2777] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:11:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:11:45.867448 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c75cdc-cd44-4062-bce6-50950e400d08 service placement] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:45.871113 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-66c75cdc-cd44-4062-bce6-50950e400d08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:45.888739 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c75cdc-cd44-4062-bce6-50950e400d08 service placement] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:45.894005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcad50c-af38-4ba9-add1-398890714f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:45.894988 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcad50c-af38-4ba9-add1-398890714f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:45.895282 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcad50c-af38-4ba9-add1-398890714f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:45.895565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcad50c-af38-4ba9-add1-398890714f84 admin admin] PATH_INFO: `/v3/users/c78eff78e8564d0ba386bcd02137aa35` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:45.896843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcad50c-af38-4ba9-add1-398890714f84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c78eff78e8564d0ba386bcd02137aa35)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:45.898796 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcad50c-af38-4ba9-add1-398890714f84 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:46.035303 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-3fcad50c-af38-4ba9-add1-398890714f84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c78eff78e8564d0ba386bcd02137aa35'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:46.047928 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-3fcad50c-af38-4ba9-add1-398890714f84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c78eff78e8564d0ba386bcd02137aa35'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:46.052881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:46.056037 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-3fcad50c-af38-4ba9-add1-398890714f84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c78eff78e8564d0ba386bcd02137aa35'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:46.056684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-3fcad50c-af38-4ba9-add1-398890714f84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c78eff78e8564d0ba386bcd02137aa35'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:46.117633 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-3fcad50c-af38-4ba9-add1-398890714f84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c78eff78e8564d0ba386bcd02137aa35'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:46.125142 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1390/2778] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:11:45 2022] DELETE /identity/v3/users/c78eff78e8564d0ba386bcd02137aa35 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:11:46.565447 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ad825-e89e-48af-bcad-4957b963bd06 service placement] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:46.583661 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ad825-e89e-48af-bcad-4957b963bd06 service placement] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:46.629240 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=100 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:46.659066 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9161e-6960-4bae-8163-64918fae3ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:46.659971 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9161e-6960-4bae-8163-64918fae3ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:46.660297 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9161e-6960-4bae-8163-64918fae3ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:46.660583 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9161e-6960-4bae-8163-64918fae3ae7 admin admin] PATH_INFO: `/v3/projects/7469c47f14be40df88cc57050d28e8ba` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:46.661784 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9161e-6960-4bae-8163-64918fae3ae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7469c47f14be40df88cc57050d28e8ba)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:46.663696 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9161e-6960-4bae-8163-64918fae3ae7 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:46.793358 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-ecd9161e-6960-4bae-8163-64918fae3ae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7469c47f14be40df88cc57050d28e8ba', 'request_id': 'req-ecd9161e-6960-4bae-8163-64918fae3ae7'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:46.799754 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-ecd9161e-6960-4bae-8163-64918fae3ae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7469c47f14be40df88cc57050d28e8ba', 'request_id': 'req-ecd9161e-6960-4bae-8163-64918fae3ae7'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:46.805910 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-ecd9161e-6960-4bae-8163-64918fae3ae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7469c47f14be40df88cc57050d28e8ba', 'request_id': 'req-ecd9161e-6960-4bae-8163-64918fae3ae7'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:46.855404 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-ecd9161e-6960-4bae-8163-64918fae3ae7 admin admin] The token cache is being invalidate because project 7469c47f14be40df88cc57050d28e8ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:11:46.855730 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-ecd9161e-6960-4bae-8163-64918fae3ae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:46.856415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-ecd9161e-6960-4bae-8163-64918fae3ae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:46.858165 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1389/2779] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:11:46 2022] DELETE /identity/v3/projects/7469c47f14be40df88cc57050d28e8ba => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:11:46.862675 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcad50c-af38-4ba9-add1-398890714f84 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:46.863958 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-3fcad50c-af38-4ba9-add1-398890714f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:46.880412 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcad50c-af38-4ba9-add1-398890714f84 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:46.951172 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884a924-69f9-4e4f-beda-0634b210d738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:46.952616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884a924-69f9-4e4f-beda-0634b210d738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:46.953503 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884a924-69f9-4e4f-beda-0634b210d738 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:46.953997 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884a924-69f9-4e4f-beda-0634b210d738 admin admin] PATH_INFO: `/v3/users/8a763155fe1046719676ed693aaf8d4b` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:46.956591 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884a924-69f9-4e4f-beda-0634b210d738 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a763155fe1046719676ed693aaf8d4b)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:46.958664 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884a924-69f9-4e4f-beda-0634b210d738 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:47.170907 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-a884a924-69f9-4e4f-beda-0634b210d738 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a763155fe1046719676ed693aaf8d4b'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:47.183693 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-a884a924-69f9-4e4f-beda-0634b210d738 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a763155fe1046719676ed693aaf8d4b'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:47.192297 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-a884a924-69f9-4e4f-beda-0634b210d738 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a763155fe1046719676ed693aaf8d4b'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:47.195107 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-a884a924-69f9-4e4f-beda-0634b210d738 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a763155fe1046719676ed693aaf8d4b'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:47.271635 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-a884a924-69f9-4e4f-beda-0634b210d738 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a763155fe1046719676ed693aaf8d4b'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:47.279015 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1391/2780] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:11:46 2022] DELETE /identity/v3/users/8a763155fe1046719676ed693aaf8d4b => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:11:47.531067 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9161e-6960-4bae-8163-64918fae3ae7 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:47.532573 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-ecd9161e-6960-4bae-8163-64918fae3ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:47.547997 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9161e-6960-4bae-8163-64918fae3ae7 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:47.613845 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84beec39-b2bd-46c2-b69e-ef155b27ec29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:47.614733 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84beec39-b2bd-46c2-b69e-ef155b27ec29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:47.615024 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84beec39-b2bd-46c2-b69e-ef155b27ec29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:47.615308 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84beec39-b2bd-46c2-b69e-ef155b27ec29 admin admin] PATH_INFO: `/v3/projects/158c6a33129b47d9945e8d69d0bf7f5a` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:47.616612 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84beec39-b2bd-46c2-b69e-ef155b27ec29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=158c6a33129b47d9945e8d69d0bf7f5a)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:47.618499 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84beec39-b2bd-46c2-b69e-ef155b27ec29 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:47.736980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-84beec39-b2bd-46c2-b69e-ef155b27ec29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '158c6a33129b47d9945e8d69d0bf7f5a', 'request_id': 'req-84beec39-b2bd-46c2-b69e-ef155b27ec29'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:47.744259 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-84beec39-b2bd-46c2-b69e-ef155b27ec29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '158c6a33129b47d9945e8d69d0bf7f5a', 'request_id': 'req-84beec39-b2bd-46c2-b69e-ef155b27ec29'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:47.753201 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-84beec39-b2bd-46c2-b69e-ef155b27ec29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '158c6a33129b47d9945e8d69d0bf7f5a', 'request_id': 'req-84beec39-b2bd-46c2-b69e-ef155b27ec29'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:47.757267 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:47.849105 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-84beec39-b2bd-46c2-b69e-ef155b27ec29 admin admin] The token cache is being invalidate because project 158c6a33129b47d9945e8d69d0bf7f5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:11:47.852954 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-84beec39-b2bd-46c2-b69e-ef155b27ec29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:47.852954 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-84beec39-b2bd-46c2-b69e-ef155b27ec29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:47.852954 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1390/2781] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:11:47 2022] DELETE /identity/v3/projects/158c6a33129b47d9945e8d69d0bf7f5a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:11:57.275179 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=57,keystone:INSERT=2,keystone:DELETE=11 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:57.957398 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:01.564554 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884a924-69f9-4e4f-beda-0634b210d738 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:12:01.566277 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-a884a924-69f9-4e4f-beda-0634b210d738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:01.625234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884a924-69f9-4e4f-beda-0634b210d738 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:12:01.672155 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69ba3f-de76-4924-bfd5-cf78eb8684f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:12:01.672740 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69ba3f-de76-4924-bfd5-cf78eb8684f1 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:01.673027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69ba3f-de76-4924-bfd5-cf78eb8684f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:01.673305 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69ba3f-de76-4924-bfd5-cf78eb8684f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:01.675063 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-ec69ba3f-de76-4924-bfd5-cf78eb8684f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:01.737775 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69ba3f-de76-4924-bfd5-cf78eb8684f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:12:01.739194 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69ba3f-de76-4924-bfd5-cf78eb8684f1 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:12:01.749995 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1392/2782] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:12:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:12:05.599748 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84beec39-b2bd-46c2-b69e-ef155b27ec29 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:12:05.603252 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-84beec39-b2bd-46c2-b69e-ef155b27ec29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:05.614451 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84beec39-b2bd-46c2-b69e-ef155b27ec29 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:12:05.618207 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9942e6-7a02-4999-8c00-e328fa02adc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:12:05.618853 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9942e6-7a02-4999-8c00-e328fa02adc9 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:05.619139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9942e6-7a02-4999-8c00-e328fa02adc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:05.619419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9942e6-7a02-4999-8c00-e328fa02adc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:05.621241 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-5a9942e6-7a02-4999-8c00-e328fa02adc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:05.703483 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9942e6-7a02-4999-8c00-e328fa02adc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:12:05.704981 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9942e6-7a02-4999-8c00-e328fa02adc9 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:12:05.716952 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1391/2783] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:12:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:12:08.983050 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69ba3f-de76-4924-bfd5-cf78eb8684f1 service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:12:08.985042 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-ec69ba3f-de76-4924-bfd5-cf78eb8684f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:09.005378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69ba3f-de76-4924-bfd5-cf78eb8684f1 service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:12:09.010288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323af66-b310-4b0a-9cd9-886c2978b267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:12:09.011195 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323af66-b310-4b0a-9cd9-886c2978b267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:09.011481 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323af66-b310-4b0a-9cd9-886c2978b267 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:09.011766 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323af66-b310-4b0a-9cd9-886c2978b267 admin admin] PATH_INFO: `/v3/users/56191d451ddf4fba953c27dd79484723` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:09.028277 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323af66-b310-4b0a-9cd9-886c2978b267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56191d451ddf4fba953c27dd79484723)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:12:09.030291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323af66-b310-4b0a-9cd9-886c2978b267 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:12:09.211872 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-2323af66-b310-4b0a-9cd9-886c2978b267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56191d451ddf4fba953c27dd79484723'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:12:09.213729 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:09.225144 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-2323af66-b310-4b0a-9cd9-886c2978b267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56191d451ddf4fba953c27dd79484723'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:12:09.232258 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-2323af66-b310-4b0a-9cd9-886c2978b267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56191d451ddf4fba953c27dd79484723'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:12:09.233446 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-2323af66-b310-4b0a-9cd9-886c2978b267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56191d451ddf4fba953c27dd79484723'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:12:09.347140 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-2323af66-b310-4b0a-9cd9-886c2978b267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56191d451ddf4fba953c27dd79484723'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:12:09.359384 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1393/2784] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:12:08 2022] DELETE /identity/v3/users/56191d451ddf4fba953c27dd79484723 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:12:09.576522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9942e6-7a02-4999-8c00-e328fa02adc9 service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:12:09.588214 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9942e6-7a02-4999-8c00-e328fa02adc9 service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:12:09.647450 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842488d2-e343-48b7-8b3b-c55a9bcc9e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:12:09.648349 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842488d2-e343-48b7-8b3b-c55a9bcc9e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:09.648639 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842488d2-e343-48b7-8b3b-c55a9bcc9e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:09.648920 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842488d2-e343-48b7-8b3b-c55a9bcc9e24 admin admin] PATH_INFO: `/v3/projects/1207210005f34c4aabbe6966e469c1a0` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:09.659873 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842488d2-e343-48b7-8b3b-c55a9bcc9e24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1207210005f34c4aabbe6966e469c1a0)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:12:09.661948 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842488d2-e343-48b7-8b3b-c55a9bcc9e24 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:12:09.769584 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-842488d2-e343-48b7-8b3b-c55a9bcc9e24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1207210005f34c4aabbe6966e469c1a0', 'request_id': 'req-842488d2-e343-48b7-8b3b-c55a9bcc9e24'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:12:09.776376 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-842488d2-e343-48b7-8b3b-c55a9bcc9e24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1207210005f34c4aabbe6966e469c1a0', 'request_id': 'req-842488d2-e343-48b7-8b3b-c55a9bcc9e24'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:12:09.782518 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-842488d2-e343-48b7-8b3b-c55a9bcc9e24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1207210005f34c4aabbe6966e469c1a0', 'request_id': 'req-842488d2-e343-48b7-8b3b-c55a9bcc9e24'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:12:09.929254 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-842488d2-e343-48b7-8b3b-c55a9bcc9e24 admin admin] The token cache is being invalidate because project 1207210005f34c4aabbe6966e469c1a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:12:09.929544 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-842488d2-e343-48b7-8b3b-c55a9bcc9e24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:12:09.930212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-842488d2-e343-48b7-8b3b-c55a9bcc9e24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:12:09.931771 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1392/2785] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:12:09 2022] DELETE /identity/v3/projects/1207210005f34c4aabbe6966e469c1a0 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:12:09.936046 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323af66-b310-4b0a-9cd9-886c2978b267 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:12:09.937505 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-2323af66-b310-4b0a-9cd9-886c2978b267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:09.950805 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323af66-b310-4b0a-9cd9-886c2978b267 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:12:10.007302 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2a480-2fe6-4b61-b715-852c30db0c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:12:10.008217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2a480-2fe6-4b61-b715-852c30db0c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:10.008511 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2a480-2fe6-4b61-b715-852c30db0c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:10.008794 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2a480-2fe6-4b61-b715-852c30db0c7d admin admin] PATH_INFO: `/v3/users/e55f8058527d463da06fd8fddb31adf4` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:10.022417 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2a480-2fe6-4b61-b715-852c30db0c7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e55f8058527d463da06fd8fddb31adf4)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:12:10.024594 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2a480-2fe6-4b61-b715-852c30db0c7d admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:12:10.223456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c5f2a480-2fe6-4b61-b715-852c30db0c7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e55f8058527d463da06fd8fddb31adf4'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:12:10.235482 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c5f2a480-2fe6-4b61-b715-852c30db0c7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e55f8058527d463da06fd8fddb31adf4'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:12:10.242421 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c5f2a480-2fe6-4b61-b715-852c30db0c7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e55f8058527d463da06fd8fddb31adf4'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:12:10.243102 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c5f2a480-2fe6-4b61-b715-852c30db0c7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e55f8058527d463da06fd8fddb31adf4'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:12:10.305835 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-c5f2a480-2fe6-4b61-b715-852c30db0c7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e55f8058527d463da06fd8fddb31adf4'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:12:10.312329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1394/2786] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:12:09 2022] DELETE /identity/v3/users/e55f8058527d463da06fd8fddb31adf4 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:12:10.662098 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842488d2-e343-48b7-8b3b-c55a9bcc9e24 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:12:10.663673 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-842488d2-e343-48b7-8b3b-c55a9bcc9e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:10.676959 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842488d2-e343-48b7-8b3b-c55a9bcc9e24 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:12:10.681020 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:10.745997 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572c0ab-5b11-48a5-bf66-431a51229285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:12:10.747012 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572c0ab-5b11-48a5-bf66-431a51229285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:10.747302 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572c0ab-5b11-48a5-bf66-431a51229285 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:10.747581 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572c0ab-5b11-48a5-bf66-431a51229285 admin admin] PATH_INFO: `/v3/projects/52bdafc550094324b057bcfc23de296b` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:10.759383 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572c0ab-5b11-48a5-bf66-431a51229285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52bdafc550094324b057bcfc23de296b)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:12:10.761372 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572c0ab-5b11-48a5-bf66-431a51229285 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:12:10.924273 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-b572c0ab-5b11-48a5-bf66-431a51229285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52bdafc550094324b057bcfc23de296b', 'request_id': 'req-b572c0ab-5b11-48a5-bf66-431a51229285'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:12:10.932270 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-b572c0ab-5b11-48a5-bf66-431a51229285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52bdafc550094324b057bcfc23de296b', 'request_id': 'req-b572c0ab-5b11-48a5-bf66-431a51229285'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:12:10.938669 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-b572c0ab-5b11-48a5-bf66-431a51229285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52bdafc550094324b057bcfc23de296b', 'request_id': 'req-b572c0ab-5b11-48a5-bf66-431a51229285'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:12:11.037516 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-b572c0ab-5b11-48a5-bf66-431a51229285 admin admin] The token cache is being invalidate because project 52bdafc550094324b057bcfc23de296b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:12:11.037815 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-b572c0ab-5b11-48a5-bf66-431a51229285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:12:11.038476 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-b572c0ab-5b11-48a5-bf66-431a51229285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:12:11.040081 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1393/2787] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:12:10 2022] DELETE /identity/v3/projects/52bdafc550094324b057bcfc23de296b => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:12:20.308317 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=69,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:21.034135 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:24.056971 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5cc32-3942-4975-8f1c-85b4fbae9f6f None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:24.057756 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5cc32-3942-4975-8f1c-85b4fbae9f6f None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:24.057756 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5cc32-3942-4975-8f1c-85b4fbae9f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:24.075912 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-efc5cc32-3942-4975-8f1c-85b4fbae9f6f None None] MFA Rules not processed for user `4a1474b39e0b477daff5833491cd6df5`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:12:24.077948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-efc5cc32-3942-4975-8f1c-85b4fbae9f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:24.133487 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1395/2788] 10.222.0.119 () {58 vars in 1014 bytes} [Thu Jul 14 16:12:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:12:24.274865 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572c0ab-5b11-48a5-bf66-431a51229285 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:12:24.276318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-b572c0ab-5b11-48a5-bf66-431a51229285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:24.346842 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572c0ab-5b11-48a5-bf66-431a51229285 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:12:24.351743 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fe412-60c5-4b09-8192-f034b167e0c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a5c169576e432c8174a562ae358e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:12:24.352422 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fe412-60c5-4b09-8192-f034b167e0c2 service swift] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:24.352709 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fe412-60c5-4b09-8192-f034b167e0c2 service swift] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:24.352987 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fe412-60c5-4b09-8192-f034b167e0c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:24.361496 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117fe412-60c5-4b09-8192-f034b167e0c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:12:24.363120 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117fe412-60c5-4b09-8192-f034b167e0c2 service swift] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:12:24.371078 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1394/2789] 10.222.0.119 () {60 vars in 1389 bytes} [Thu Jul 14 16:12:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 16:12:34.126596 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=25 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:34.367845 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=32 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:37.521923 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc5cc32-3942-4975-8f1c-85b4fbae9f6f None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:12:37.527934 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-efc5cc32-3942-4975-8f1c-85b4fbae9f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:37.580792 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc5cc32-3942-4975-8f1c-85b4fbae9f6f None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:12:37.584400 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b11f65-d4b0-4a5c-aad2-b836334eea4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:12:37.585052 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b11f65-d4b0-4a5c-aad2-b836334eea4e service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:37.585340 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b11f65-d4b0-4a5c-aad2-b836334eea4e service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:37.585623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b11f65-d4b0-4a5c-aad2-b836334eea4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:37.587378 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-53b11f65-d4b0-4a5c-aad2-b836334eea4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:37.597441 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b11f65-d4b0-4a5c-aad2-b836334eea4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:12:37.598859 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b11f65-d4b0-4a5c-aad2-b836334eea4e service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:12:37.606932 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1396/2790] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:12:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:12:44.535169 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fe412-60c5-4b09-8192-f034b167e0c2 service swift] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:12:44.536677 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-117fe412-60c5-4b09-8192-f034b167e0c2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:44.610075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fe412-60c5-4b09-8192-f034b167e0c2 service swift] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:12:44.614620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd0dff-a907-40bf-931c-c9e53ccb4327 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b236c66c184d3ca40c2069dc316664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:12:44.615688 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd0dff-a907-40bf-931c-c9e53ccb4327 service glance] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:44.616274 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd0dff-a907-40bf-931c-c9e53ccb4327 service glance] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:44.616792 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd0dff-a907-40bf-931c-c9e53ccb4327 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:44.619020 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-7ddd0dff-a907-40bf-931c-c9e53ccb4327 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:44.688463 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd0dff-a907-40bf-931c-c9e53ccb4327 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:12:44.689900 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd0dff-a907-40bf-931c-c9e53ccb4327 service glance] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:12:44.700697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1395/2791] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:12:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:12:44.928037 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b11f65-d4b0-4a5c-aad2-b836334eea4e service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:12:44.929474 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-53b11f65-d4b0-4a5c-aad2-b836334eea4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:44.940753 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b11f65-d4b0-4a5c-aad2-b836334eea4e service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:12:44.944526 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe3b0c-4c99-47d3-b8a9-fb9d84fc3b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:12:44.945171 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe3b0c-4c99-47d3-b8a9-fb9d84fc3b11 service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:44.945462 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe3b0c-4c99-47d3-b8a9-fb9d84fc3b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:44.945745 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe3b0c-4c99-47d3-b8a9-fb9d84fc3b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:44.947470 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-23fe3b0c-4c99-47d3-b8a9-fb9d84fc3b11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:44.957846 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe3b0c-4c99-47d3-b8a9-fb9d84fc3b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:12:44.959259 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe3b0c-4c99-47d3-b8a9-fb9d84fc3b11 service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:12:44.967145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1397/2792] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:12:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:12:45.041188 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd0dff-a907-40bf-931c-c9e53ccb4327 service glance] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:12:45.050717 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd0dff-a907-40bf-931c-c9e53ccb4327 service glance] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:12:45.054362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93f33e-d3ed-4972-9716-9bc393ce8c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:12:45.055003 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93f33e-d3ed-4972-9716-9bc393ce8c60 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:45.055291 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93f33e-d3ed-4972-9716-9bc393ce8c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:45.055571 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93f33e-d3ed-4972-9716-9bc393ce8c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:45.057358 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-1f93f33e-d3ed-4972-9716-9bc393ce8c60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:45.071347 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93f33e-d3ed-4972-9716-9bc393ce8c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:12:45.072810 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93f33e-d3ed-4972-9716-9bc393ce8c60 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:12:45.084614 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1396/2793] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:12:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:12:45.148632 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe3b0c-4c99-47d3-b8a9-fb9d84fc3b11 service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:12:45.150024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-23fe3b0c-4c99-47d3-b8a9-fb9d84fc3b11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:45.218010 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe3b0c-4c99-47d3-b8a9-fb9d84fc3b11 service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:12:45.223999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b2a1f-69dc-4e10-8861-9ac06b2f46b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716cbbfeede34885b0411e5b9b25df47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:12:45.224744 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b2a1f-69dc-4e10-8861-9ac06b2f46b0 service placement] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:45.225033 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b2a1f-69dc-4e10-8861-9ac06b2f46b0 service placement] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:45.225319 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b2a1f-69dc-4e10-8861-9ac06b2f46b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:45.227107 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-2e8b2a1f-69dc-4e10-8861-9ac06b2f46b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:45.239195 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b2a1f-69dc-4e10-8861-9ac06b2f46b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:12:45.240815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b2a1f-69dc-4e10-8861-9ac06b2f46b0 service placement] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:12:45.251011 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1398/2794] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:12:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:12:47.508309 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b86af0-523f-4558-b153-0a5b87242a79 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:47.508820 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b86af0-523f-4558-b153-0a5b87242a79 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:47.508932 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b86af0-523f-4558-b153-0a5b87242a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:47.527239 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-d0b86af0-523f-4558-b153-0a5b87242a79 None None] MFA Rules not processed for user `4a1474b39e0b477daff5833491cd6df5`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:12:47.528497 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-d0b86af0-523f-4558-b153-0a5b87242a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:47.538365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1397/2795] 10.222.0.119 () {58 vars in 1014 bytes} [Thu Jul 14 16:12:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:12:47.550468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b2a1f-69dc-4e10-8861-9ac06b2f46b0 service placement] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:12:47.562402 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b2a1f-69dc-4e10-8861-9ac06b2f46b0 service placement] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:12:47.567490 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7982e2-f51a-422e-8274-9301d3e32d5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a5c169576e432c8174a562ae358e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:12:47.568197 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7982e2-f51a-422e-8274-9301d3e32d5e service swift] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:47.568516 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7982e2-f51a-422e-8274-9301d3e32d5e service swift] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:47.568799 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7982e2-f51a-422e-8274-9301d3e32d5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:47.576962 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7982e2-f51a-422e-8274-9301d3e32d5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:12:47.581207 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7982e2-f51a-422e-8274-9301d3e32d5e service swift] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:12:47.587292 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1399/2796] 10.222.0.119 () {60 vars in 1389 bytes} [Thu Jul 14 16:12:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 16:12:57.522290 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=68 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:57.583901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=70 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:06.357478 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b86af0-523f-4558-b153-0a5b87242a79 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:06.359019 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-d0b86af0-523f-4558-b153-0a5b87242a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:06.375348 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b86af0-523f-4558-b153-0a5b87242a79 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:06.380975 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa93089-d255-4f48-a5da-e56262f46eb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:06.381625 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa93089-d255-4f48-a5da-e56262f46eb0 service nova] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:06.381910 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa93089-d255-4f48-a5da-e56262f46eb0 service nova] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:06.382214 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa93089-d255-4f48-a5da-e56262f46eb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:06.383922 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-2fa93089-d255-4f48-a5da-e56262f46eb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:06.396355 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa93089-d255-4f48-a5da-e56262f46eb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:06.398353 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa93089-d255-4f48-a5da-e56262f46eb0 service nova] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:06.409323 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1398/2797] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:13:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:13:08.365150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0921abb-db68-419c-8ecb-d063e2ec287f None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:08.365638 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0921abb-db68-419c-8ecb-d063e2ec287f None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:08.365754 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0921abb-db68-419c-8ecb-d063e2ec287f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:08.383846 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-c0921abb-db68-419c-8ecb-d063e2ec287f None None] MFA Rules not processed for user `4a1474b39e0b477daff5833491cd6df5`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:13:08.385167 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-c0921abb-db68-419c-8ecb-d063e2ec287f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:08.392922 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1400/2798] 10.222.0.119 () {58 vars in 972 bytes} [Thu Jul 14 16:13:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:13:08.405093 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa93089-d255-4f48-a5da-e56262f46eb0 service nova] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:08.416446 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa93089-d255-4f48-a5da-e56262f46eb0 service nova] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:08.421454 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90029ca3-a529-4bf4-9dcc-6cb4f0acf1ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a5c169576e432c8174a562ae358e8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:08.422032 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90029ca3-a529-4bf4-9dcc-6cb4f0acf1ee service swift] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:08.422320 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90029ca3-a529-4bf4-9dcc-6cb4f0acf1ee service swift] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:08.422599 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90029ca3-a529-4bf4-9dcc-6cb4f0acf1ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:08.431376 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90029ca3-a529-4bf4-9dcc-6cb4f0acf1ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:08.432996 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90029ca3-a529-4bf4-9dcc-6cb4f0acf1ee service swift] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:08.441953 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1399/2799] 10.222.0.119 () {60 vars in 1389 bytes} [Thu Jul 14 16:13:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 16:13:18.378858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:18.437904 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=12 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:09.238294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0921abb-db68-419c-8ecb-d063e2ec287f None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:09.251205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0921abb-db68-419c-8ecb-d063e2ec287f None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:09.256721 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104302a-adbe-4059-8c8c-95768826b554 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4c833a4684561ab52eda5734a7766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:09.257377 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104302a-adbe-4059-8c8c-95768826b554 service nova] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:09.257665 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104302a-adbe-4059-8c8c-95768826b554 service nova] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:09.257943 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104302a-adbe-4059-8c8c-95768826b554 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:09.259738 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-8104302a-adbe-4059-8c8c-95768826b554 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:09.273152 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104302a-adbe-4059-8c8c-95768826b554 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:09.274815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104302a-adbe-4059-8c8c-95768826b554 service nova] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:09.290670 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1401/2800] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:14:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:14:14.942972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90029ca3-a529-4bf4-9dcc-6cb4f0acf1ee service swift] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:14.952454 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90029ca3-a529-4bf4-9dcc-6cb4f0acf1ee service swift] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:14.957263 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa9a20-5c58-4d5a-90dc-a81f08925158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:14.957908 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa9a20-5c58-4d5a-90dc-a81f08925158 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:14.958206 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa9a20-5c58-4d5a-90dc-a81f08925158 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:14.958496 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa9a20-5c58-4d5a-90dc-a81f08925158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:14.960310 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-a6aa9a20-5c58-4d5a-90dc-a81f08925158 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:15.024978 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa9a20-5c58-4d5a-90dc-a81f08925158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:15.026423 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa9a20-5c58-4d5a-90dc-a81f08925158 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:15.036265 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1400/2801] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:14:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:14:18.456968 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104302a-adbe-4059-8c8c-95768826b554 service nova] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:18.459016 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-8104302a-adbe-4059-8c8c-95768826b554 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:18.473197 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104302a-adbe-4059-8c8c-95768826b554 service nova] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:18.478049 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8787046-23cc-4f79-a3b0-c2bce2d90af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:18.478926 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8787046-23cc-4f79-a3b0-c2bce2d90af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:18.479218 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8787046-23cc-4f79-a3b0-c2bce2d90af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:18.479501 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8787046-23cc-4f79-a3b0-c2bce2d90af2 admin admin] PATH_INFO: `/v3/users/8874a26203f0408f8d8c9f26b2818b59` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:18.480719 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8787046-23cc-4f79-a3b0-c2bce2d90af2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8874a26203f0408f8d8c9f26b2818b59)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:18.482639 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8787046-23cc-4f79-a3b0-c2bce2d90af2 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:18.647448 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-a8787046-23cc-4f79-a3b0-c2bce2d90af2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8874a26203f0408f8d8c9f26b2818b59'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:18.660969 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-a8787046-23cc-4f79-a3b0-c2bce2d90af2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8874a26203f0408f8d8c9f26b2818b59'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:18.667964 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-a8787046-23cc-4f79-a3b0-c2bce2d90af2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8874a26203f0408f8d8c9f26b2818b59'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:18.668827 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-a8787046-23cc-4f79-a3b0-c2bce2d90af2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8874a26203f0408f8d8c9f26b2818b59'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:18.725568 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-a8787046-23cc-4f79-a3b0-c2bce2d90af2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8874a26203f0408f8d8c9f26b2818b59'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:18.732173 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1402/2802] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:14:18 2022] DELETE /identity/v3/users/8874a26203f0408f8d8c9f26b2818b59 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:18.964466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa9a20-5c58-4d5a-90dc-a81f08925158 service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:18.975208 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa9a20-5c58-4d5a-90dc-a81f08925158 service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:19.032530 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67afbe2-f1d5-4464-b987-1368e0382619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:19.033396 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67afbe2-f1d5-4464-b987-1368e0382619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:19.033681 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67afbe2-f1d5-4464-b987-1368e0382619 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:19.033960 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67afbe2-f1d5-4464-b987-1368e0382619 admin admin] PATH_INFO: `/v3/projects/f50528750c0e4504aaafba1ebae3f707` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:19.035140 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67afbe2-f1d5-4464-b987-1368e0382619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f50528750c0e4504aaafba1ebae3f707)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:19.037118 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67afbe2-f1d5-4464-b987-1368e0382619 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:19.136038 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-e67afbe2-f1d5-4464-b987-1368e0382619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f50528750c0e4504aaafba1ebae3f707', 'request_id': 'req-e67afbe2-f1d5-4464-b987-1368e0382619'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:19.142795 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-e67afbe2-f1d5-4464-b987-1368e0382619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f50528750c0e4504aaafba1ebae3f707', 'request_id': 'req-e67afbe2-f1d5-4464-b987-1368e0382619'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:19.148418 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-e67afbe2-f1d5-4464-b987-1368e0382619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f50528750c0e4504aaafba1ebae3f707', 'request_id': 'req-e67afbe2-f1d5-4464-b987-1368e0382619'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:19.226820 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-e67afbe2-f1d5-4464-b987-1368e0382619 admin admin] The token cache is being invalidate because project f50528750c0e4504aaafba1ebae3f707 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:14:19.227029 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-e67afbe2-f1d5-4464-b987-1368e0382619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:19.227646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-e67afbe2-f1d5-4464-b987-1368e0382619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:19.229274 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1401/2803] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:14:18 2022] DELETE /identity/v3/projects/f50528750c0e4504aaafba1ebae3f707 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:19.235753 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf385f0d-a22c-4301-b9a2-7f4816b66ce4 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:19.235753 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf385f0d-a22c-4301-b9a2-7f4816b66ce4 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:19.235753 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf385f0d-a22c-4301-b9a2-7f4816b66ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:19.255623 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-cf385f0d-a22c-4301-b9a2-7f4816b66ce4 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:19.256874 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-cf385f0d-a22c-4301-b9a2-7f4816b66ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:19.314836 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1403/2804] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:19.322715 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9250a-467b-4887-ba84-cd6069a58a0c None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:19.323005 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9250a-467b-4887-ba84-cd6069a58a0c None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:19.323285 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9250a-467b-4887-ba84-cd6069a58a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:19.342286 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-c1c9250a-467b-4887-ba84-cd6069a58a0c None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:19.343481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-c1c9250a-467b-4887-ba84-cd6069a58a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:19.354986 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1402/2805] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:19.355979 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf385f0d-a22c-4301-b9a2-7f4816b66ce4 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:19.366792 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf385f0d-a22c-4301-b9a2-7f4816b66ce4 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:19.371329 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef47b4-aa73-48fe-b12b-9a0d1e9b93a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:19.371987 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef47b4-aa73-48fe-b12b-9a0d1e9b93a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:19.372310 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef47b4-aa73-48fe-b12b-9a0d1e9b93a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:19.372595 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef47b4-aa73-48fe-b12b-9a0d1e9b93a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:19.373331 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef47b4-aa73-48fe-b12b-9a0d1e9b93a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:14:19.373645 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef47b4-aa73-48fe-b12b-9a0d1e9b93a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:19.375866 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef47b4-aa73-48fe-b12b-9a0d1e9b93a7 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:19.388523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1404/2806] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 16:14:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:14:19.393047 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9250a-467b-4887-ba84-cd6069a58a0c None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:19.402126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9250a-467b-4887-ba84-cd6069a58a0c None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:19.406868 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b5c6b-9ebd-4d60-88ea-92d3330356f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:19.407510 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b5c6b-9ebd-4d60-88ea-92d3330356f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:19.407800 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b5c6b-9ebd-4d60-88ea-92d3330356f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:19.408076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b5c6b-9ebd-4d60-88ea-92d3330356f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:19.408791 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b5c6b-9ebd-4d60-88ea-92d3330356f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:19.410660 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b5c6b-9ebd-4d60-88ea-92d3330356f4 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:19.424741 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:19.538154 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1403/2807] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:14:19 2022] POST /identity/v3/projects => generated 402 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:14:19.542304 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef47b4-aa73-48fe-b12b-9a0d1e9b93a7 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:19.553843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef47b4-aa73-48fe-b12b-9a0d1e9b93a7 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:19.598694 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:19.612350 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255ff68-7591-4c81-bb00-464047e53321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:19.613028 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255ff68-7591-4c81-bb00-464047e53321 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:19.613319 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255ff68-7591-4c81-bb00-464047e53321 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:19.613608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255ff68-7591-4c81-bb00-464047e53321 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:19.614361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255ff68-7591-4c81-bb00-464047e53321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:19.616289 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255ff68-7591-4c81-bb00-464047e53321 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:19.731059 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1405/2808] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:14:19 2022] POST /identity/v3/users => generated 302 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:14:19.736025 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b5c6b-9ebd-4d60-88ea-92d3330356f4 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:19.746380 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b5c6b-9ebd-4d60-88ea-92d3330356f4 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:19.751290 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc5784-4ec6-4ed2-b9d9-6f42990613fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:19.752038 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc5784-4ec6-4ed2-b9d9-6f42990613fb admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:19.752503 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc5784-4ec6-4ed2-b9d9-6f42990613fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:19.752788 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc5784-4ec6-4ed2-b9d9-6f42990613fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:19.753539 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc5784-4ec6-4ed2-b9d9-6f42990613fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:19.755157 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc5784-4ec6-4ed2-b9d9-6f42990613fb admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:19.765905 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1404/2809] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:14:19 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:14:19.771941 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255ff68-7591-4c81-bb00-464047e53321 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:19.782755 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255ff68-7591-4c81-bb00-464047e53321 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:19.787696 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b24def-3113-4105-9758-e8414609e731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:19.788393 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b24def-3113-4105-9758-e8414609e731 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:19.788679 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b24def-3113-4105-9758-e8414609e731 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:19.788982 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b24def-3113-4105-9758-e8414609e731 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:19.789702 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b24def-3113-4105-9758-e8414609e731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:19.791268 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b24def-3113-4105-9758-e8414609e731 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:19.802212 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1406/2810] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:14:19 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:14:19.806274 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc5784-4ec6-4ed2-b9d9-6f42990613fb admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:19.816321 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc5784-4ec6-4ed2-b9d9-6f42990613fb admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:19.820838 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa1aa4-d58f-4ddf-92b6-bdf33747af17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:19.821741 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa1aa4-d58f-4ddf-92b6-bdf33747af17 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:19.822029 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa1aa4-d58f-4ddf-92b6-bdf33747af17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:19.822313 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa1aa4-d58f-4ddf-92b6-bdf33747af17 admin admin] PATH_INFO: `/v3/projects/b0eb9d123e9d4d05b4f8ec068de9aa07/users/07dff54aeddd4751b6d2d3d998d46f2a/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:19.837863 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa1aa4-d58f-4ddf-92b6-bdf33747af17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0eb9d123e9d4d05b4f8ec068de9aa07, user_id=07dff54aeddd4751b6d2d3d998d46f2a, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:19.840661 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa1aa4-d58f-4ddf-92b6-bdf33747af17 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:19.930333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1405/2811] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:14:19 2022] PUT /identity/v3/projects/b0eb9d123e9d4d05b4f8ec068de9aa07/users/07dff54aeddd4751b6d2d3d998d46f2a/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:19.935537 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2cb9a-ef94-47c4-a47f-28832d21ee63 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:19.935836 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2cb9a-ef94-47c4-a47f-28832d21ee63 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:19.936141 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2cb9a-ef94-47c4-a47f-28832d21ee63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:19.954801 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-94e2cb9a-ef94-47c4-a47f-28832d21ee63 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:19.956020 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-94e2cb9a-ef94-47c4-a47f-28832d21ee63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:20.016321 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1407/2812] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:20.025988 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa1aa4-d58f-4ddf-92b6-bdf33747af17 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:20.027804 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-72fa1aa4-d58f-4ddf-92b6-bdf33747af17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:20.085480 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa1aa4-d58f-4ddf-92b6-bdf33747af17 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:20.089313 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd7903-77cb-420f-aa41-82e24c89534b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:20.089971 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd7903-77cb-420f-aa41-82e24c89534b service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:20.090261 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd7903-77cb-420f-aa41-82e24c89534b service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:20.090549 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd7903-77cb-420f-aa41-82e24c89534b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:20.101420 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd7903-77cb-420f-aa41-82e24c89534b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:20.102870 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd7903-77cb-420f-aa41-82e24c89534b service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:20.112622 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1406/2813] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:14:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:14:21.412398 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9828e-48ee-4adb-9726-a8461ba218e9 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:21.412944 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9828e-48ee-4adb-9726-a8461ba218e9 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:21.413167 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9828e-48ee-4adb-9726-a8461ba218e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:21.441823 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-1df9828e-48ee-4adb-9726-a8461ba218e9 None None] MFA Rules not processed for user `07dff54aeddd4751b6d2d3d998d46f2a`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:21.443040 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-1df9828e-48ee-4adb-9726-a8461ba218e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:21.508057 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1408/2814] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:14:21 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:21.513087 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd7903-77cb-420f-aa41-82e24c89534b service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:21.522699 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd7903-77cb-420f-aa41-82e24c89534b service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:21.527281 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b5dcb-3608-4ac8-b664-5f22acc3c89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:21.527934 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b5dcb-3608-4ac8-b664-5f22acc3c89d admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:21.528266 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b5dcb-3608-4ac8-b664-5f22acc3c89d admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:21.528548 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b5dcb-3608-4ac8-b664-5f22acc3c89d admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:21.529273 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b5dcb-3608-4ac8-b664-5f22acc3c89d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:21.531173 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b5dcb-3608-4ac8-b664-5f22acc3c89d admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:21.623068 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1407/2815] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:14:21 2022] POST /identity/v3/projects => generated 404 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:14:21.628628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9828e-48ee-4adb-9726-a8461ba218e9 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:21.639491 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9828e-48ee-4adb-9726-a8461ba218e9 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:21.690740 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:21.697204 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb782a-557b-4825-b5f6-9aa096f09980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:21.697876 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb782a-557b-4825-b5f6-9aa096f09980 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:21.698162 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb782a-557b-4825-b5f6-9aa096f09980 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:21.698445 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb782a-557b-4825-b5f6-9aa096f09980 admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:21.699154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb782a-557b-4825-b5f6-9aa096f09980 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:21.701256 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb782a-557b-4825-b5f6-9aa096f09980 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:21.844750 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1409/2816] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:14:21 2022] POST /identity/v3/users => generated 309 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:14:21.850070 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b5dcb-3608-4ac8-b664-5f22acc3c89d admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:21.859338 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b5dcb-3608-4ac8-b664-5f22acc3c89d admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:21.864701 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6dde01-ac10-4d96-9fea-60b356d4540a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:21.865362 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dde01-ac10-4d96-9fea-60b356d4540a admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:21.865651 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dde01-ac10-4d96-9fea-60b356d4540a admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:21.865934 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dde01-ac10-4d96-9fea-60b356d4540a admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:21.866659 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6dde01-ac10-4d96-9fea-60b356d4540a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:21.868285 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6dde01-ac10-4d96-9fea-60b356d4540a admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:21.878880 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1408/2817] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:14:21 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:14:21.883047 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb782a-557b-4825-b5f6-9aa096f09980 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:21.893284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb782a-557b-4825-b5f6-9aa096f09980 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:21.900186 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb942db5-429c-4026-900e-607afc18a37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:21.902506 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb942db5-429c-4026-900e-607afc18a37a admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:21.902506 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb942db5-429c-4026-900e-607afc18a37a admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:21.902506 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb942db5-429c-4026-900e-607afc18a37a admin admin] PATH_INFO: `/v3/projects/8d7d3682542a4285bf548bbb816a37fa/users/d74f972a14b64e568377203214828ba9/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:21.917066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb942db5-429c-4026-900e-607afc18a37a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d7d3682542a4285bf548bbb816a37fa, user_id=d74f972a14b64e568377203214828ba9, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:21.919760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb942db5-429c-4026-900e-607afc18a37a admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:21.977184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1410/2818] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:14:21 2022] PUT /identity/v3/projects/8d7d3682542a4285bf548bbb816a37fa/users/d74f972a14b64e568377203214828ba9/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:21.981120 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6dde01-ac10-4d96-9fea-60b356d4540a admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:21.991636 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6dde01-ac10-4d96-9fea-60b356d4540a admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:22.046400 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a6520-c7b5-42eb-adff-bf95909f5a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:22.047075 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a6520-c7b5-42eb-adff-bf95909f5a29 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:22.047369 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a6520-c7b5-42eb-adff-bf95909f5a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:22.047664 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a6520-c7b5-42eb-adff-bf95909f5a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:22.049160 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a6520-c7b5-42eb-adff-bf95909f5a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:22.050752 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a6520-c7b5-42eb-adff-bf95909f5a29 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:22.060391 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1409/2819] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:14:21 2022] GET /identity/v3/roles => generated 1427 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:14:22.064809 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb942db5-429c-4026-900e-607afc18a37a admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:22.075005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb942db5-429c-4026-900e-607afc18a37a admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:22.080523 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078338b6-0de8-4023-8c15-80bddbab503f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:22.081408 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078338b6-0de8-4023-8c15-80bddbab503f admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:22.081720 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078338b6-0de8-4023-8c15-80bddbab503f admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:22.082005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078338b6-0de8-4023-8c15-80bddbab503f admin admin] PATH_INFO: `/v3/projects/8d7d3682542a4285bf548bbb816a37fa/users/d74f972a14b64e568377203214828ba9/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:22.083984 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078338b6-0de8-4023-8c15-80bddbab503f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d7d3682542a4285bf548bbb816a37fa, user_id=d74f972a14b64e568377203214828ba9, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:22.086633 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078338b6-0de8-4023-8c15-80bddbab503f admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:22.097736 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1411/2820] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:14:22 2022] PUT /identity/v3/projects/8d7d3682542a4285bf548bbb816a37fa/users/d74f972a14b64e568377203214828ba9/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:14:23.257155 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b6c42-f06e-4f21-a84d-eb23d74baae3 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:23.260390 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b6c42-f06e-4f21-a84d-eb23d74baae3 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:23.260390 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b6c42-f06e-4f21-a84d-eb23d74baae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:23.289433 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-d37b6c42-f06e-4f21-a84d-eb23d74baae3 None None] MFA Rules not processed for user `d74f972a14b64e568377203214828ba9`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:23.290687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-d37b6c42-f06e-4f21-a84d-eb23d74baae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:23.304687 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:23.366465 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1410/2821] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:14:23 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:24.651804 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078338b6-0de8-4023-8c15-80bddbab503f admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:24.717086 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078338b6-0de8-4023-8c15-80bddbab503f admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:24.721987 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc641d-fc46-4167-87f3-758873608c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:24.722851 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc641d-fc46-4167-87f3-758873608c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:24.723301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc641d-fc46-4167-87f3-758873608c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:24.723834 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc641d-fc46-4167-87f3-758873608c0e admin admin] PATH_INFO: `/v3/users/07dff54aeddd4751b6d2d3d998d46f2a` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:24.725045 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc641d-fc46-4167-87f3-758873608c0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=07dff54aeddd4751b6d2d3d998d46f2a)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:24.726955 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc641d-fc46-4167-87f3-758873608c0e admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:24.875175 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-9ebc641d-fc46-4167-87f3-758873608c0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07dff54aeddd4751b6d2d3d998d46f2a'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:24.888517 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-9ebc641d-fc46-4167-87f3-758873608c0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07dff54aeddd4751b6d2d3d998d46f2a'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:24.903373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-9ebc641d-fc46-4167-87f3-758873608c0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07dff54aeddd4751b6d2d3d998d46f2a'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:24.903373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-9ebc641d-fc46-4167-87f3-758873608c0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07dff54aeddd4751b6d2d3d998d46f2a'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:24.947234 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-9ebc641d-fc46-4167-87f3-758873608c0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07dff54aeddd4751b6d2d3d998d46f2a'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:24.953825 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1412/2822] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:14:24 2022] DELETE /identity/v3/users/07dff54aeddd4751b6d2d3d998d46f2a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:25.218010 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b6c42-f06e-4f21-a84d-eb23d74baae3 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:25.231224 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b6c42-f06e-4f21-a84d-eb23d74baae3 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:25.291444 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894e0a0-5fc6-4e8e-ac76-f970c18bdad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:25.292333 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894e0a0-5fc6-4e8e-ac76-f970c18bdad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:25.292620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894e0a0-5fc6-4e8e-ac76-f970c18bdad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:25.292898 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894e0a0-5fc6-4e8e-ac76-f970c18bdad3 admin admin] PATH_INFO: `/v3/projects/b0eb9d123e9d4d05b4f8ec068de9aa07` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:25.294076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2894e0a0-5fc6-4e8e-ac76-f970c18bdad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0eb9d123e9d4d05b4f8ec068de9aa07)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:25.295968 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2894e0a0-5fc6-4e8e-ac76-f970c18bdad3 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:25.398434 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-2894e0a0-5fc6-4e8e-ac76-f970c18bdad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0eb9d123e9d4d05b4f8ec068de9aa07', 'request_id': 'req-2894e0a0-5fc6-4e8e-ac76-f970c18bdad3'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:25.404725 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-2894e0a0-5fc6-4e8e-ac76-f970c18bdad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0eb9d123e9d4d05b4f8ec068de9aa07', 'request_id': 'req-2894e0a0-5fc6-4e8e-ac76-f970c18bdad3'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:25.410804 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-2894e0a0-5fc6-4e8e-ac76-f970c18bdad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0eb9d123e9d4d05b4f8ec068de9aa07', 'request_id': 'req-2894e0a0-5fc6-4e8e-ac76-f970c18bdad3'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:25.467054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-2894e0a0-5fc6-4e8e-ac76-f970c18bdad3 admin admin] The token cache is being invalidate because project b0eb9d123e9d4d05b4f8ec068de9aa07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:14:25.467280 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-2894e0a0-5fc6-4e8e-ac76-f970c18bdad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:25.467987 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-2894e0a0-5fc6-4e8e-ac76-f970c18bdad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:25.470237 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1411/2823] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:14:25 2022] DELETE /identity/v3/projects/b0eb9d123e9d4d05b4f8ec068de9aa07 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:25.474429 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc641d-fc46-4167-87f3-758873608c0e admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:25.475945 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-9ebc641d-fc46-4167-87f3-758873608c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:25.490054 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc641d-fc46-4167-87f3-758873608c0e admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:25.514884 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:25.550127 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74904eaa-60ce-410b-b8a5-4d17abfda85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:25.551005 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74904eaa-60ce-410b-b8a5-4d17abfda85b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:25.551297 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74904eaa-60ce-410b-b8a5-4d17abfda85b admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:25.551581 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74904eaa-60ce-410b-b8a5-4d17abfda85b admin admin] PATH_INFO: `/v3/users/d74f972a14b64e568377203214828ba9` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:25.552828 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74904eaa-60ce-410b-b8a5-4d17abfda85b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d74f972a14b64e568377203214828ba9)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:25.554764 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74904eaa-60ce-410b-b8a5-4d17abfda85b admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:25.697566 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-74904eaa-60ce-410b-b8a5-4d17abfda85b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd74f972a14b64e568377203214828ba9'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:25.710023 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-74904eaa-60ce-410b-b8a5-4d17abfda85b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd74f972a14b64e568377203214828ba9'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:25.716855 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-74904eaa-60ce-410b-b8a5-4d17abfda85b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd74f972a14b64e568377203214828ba9'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:25.717785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-74904eaa-60ce-410b-b8a5-4d17abfda85b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd74f972a14b64e568377203214828ba9'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:25.786978 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-74904eaa-60ce-410b-b8a5-4d17abfda85b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd74f972a14b64e568377203214828ba9'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:25.793197 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1413/2824] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:14:25 2022] DELETE /identity/v3/users/d74f972a14b64e568377203214828ba9 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:26.011506 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894e0a0-5fc6-4e8e-ac76-f970c18bdad3 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:26.013210 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-2894e0a0-5fc6-4e8e-ac76-f970c18bdad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:26.027320 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894e0a0-5fc6-4e8e-ac76-f970c18bdad3 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:26.069291 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:26.085593 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294fb8a-296a-4825-9b6a-af1f2c9811f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:26.086461 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294fb8a-296a-4825-9b6a-af1f2c9811f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:26.086743 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294fb8a-296a-4825-9b6a-af1f2c9811f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:26.087017 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294fb8a-296a-4825-9b6a-af1f2c9811f0 admin admin] PATH_INFO: `/v3/projects/8d7d3682542a4285bf548bbb816a37fa` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:26.088230 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294fb8a-296a-4825-9b6a-af1f2c9811f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d7d3682542a4285bf548bbb816a37fa)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:26.090128 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294fb8a-296a-4825-9b6a-af1f2c9811f0 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:26.176815 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7294fb8a-296a-4825-9b6a-af1f2c9811f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d7d3682542a4285bf548bbb816a37fa', 'request_id': 'req-7294fb8a-296a-4825-9b6a-af1f2c9811f0'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:26.182934 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7294fb8a-296a-4825-9b6a-af1f2c9811f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d7d3682542a4285bf548bbb816a37fa', 'request_id': 'req-7294fb8a-296a-4825-9b6a-af1f2c9811f0'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:26.189161 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7294fb8a-296a-4825-9b6a-af1f2c9811f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d7d3682542a4285bf548bbb816a37fa', 'request_id': 'req-7294fb8a-296a-4825-9b6a-af1f2c9811f0'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:26.251603 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7294fb8a-296a-4825-9b6a-af1f2c9811f0 admin admin] The token cache is being invalidate because project 8d7d3682542a4285bf548bbb816a37fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:14:26.252485 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7294fb8a-296a-4825-9b6a-af1f2c9811f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:26.252604 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7294fb8a-296a-4825-9b6a-af1f2c9811f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:26.254132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1412/2825] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:14:26 2022] DELETE /identity/v3/projects/8d7d3682542a4285bf548bbb816a37fa => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:26.259073 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f82b8-7448-4cce-9ce0-8846709955c4 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:26.259309 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f82b8-7448-4cce-9ce0-8846709955c4 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:26.259590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f82b8-7448-4cce-9ce0-8846709955c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:26.278433 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-796f82b8-7448-4cce-9ce0-8846709955c4 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:26.281333 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-796f82b8-7448-4cce-9ce0-8846709955c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:26.339948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1414/2826] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:26.350622 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23ac90-529c-4047-ba28-547070931d87 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:26.351929 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23ac90-529c-4047-ba28-547070931d87 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:26.352248 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23ac90-529c-4047-ba28-547070931d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:26.371522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-0f23ac90-529c-4047-ba28-547070931d87 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:26.372761 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-0f23ac90-529c-4047-ba28-547070931d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:26.381214 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1413/2827] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:26.385396 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f82b8-7448-4cce-9ce0-8846709955c4 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:26.395824 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f82b8-7448-4cce-9ce0-8846709955c4 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:26.400418 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24096932-04a5-4b81-9445-fd1bedcf81d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:26.401068 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24096932-04a5-4b81-9445-fd1bedcf81d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:26.401351 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24096932-04a5-4b81-9445-fd1bedcf81d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:26.401628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24096932-04a5-4b81-9445-fd1bedcf81d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:26.402381 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24096932-04a5-4b81-9445-fd1bedcf81d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86979) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:14:26.402694 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24096932-04a5-4b81-9445-fd1bedcf81d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:26.404296 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24096932-04a5-4b81-9445-fd1bedcf81d9 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:26.415976 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1415/2828] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 16:14:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:14:26.420185 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23ac90-529c-4047-ba28-547070931d87 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:26.429546 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23ac90-529c-4047-ba28-547070931d87 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:26.434116 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20aaaa-7a76-4f80-ae17-223f55a83cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:26.434833 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20aaaa-7a76-4f80-ae17-223f55a83cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:26.435141 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20aaaa-7a76-4f80-ae17-223f55a83cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:26.435408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20aaaa-7a76-4f80-ae17-223f55a83cf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:26.436126 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20aaaa-7a76-4f80-ae17-223f55a83cf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:26.439218 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20aaaa-7a76-4f80-ae17-223f55a83cf8 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:26.566186 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1414/2829] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:14:26 2022] POST /identity/v3/projects => generated 364 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:14:26.570435 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24096932-04a5-4b81-9445-fd1bedcf81d9 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:26.580783 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24096932-04a5-4b81-9445-fd1bedcf81d9 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:26.610144 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:26.637779 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a602bb-34c8-4f84-ad12-ad1ccadd16ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:26.638452 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a602bb-34c8-4f84-ad12-ad1ccadd16ac admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:26.638740 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a602bb-34c8-4f84-ad12-ad1ccadd16ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:26.639015 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a602bb-34c8-4f84-ad12-ad1ccadd16ac admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:26.639691 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a602bb-34c8-4f84-ad12-ad1ccadd16ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:26.642342 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a602bb-34c8-4f84-ad12-ad1ccadd16ac admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:26.736048 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1416/2830] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:14:26 2022] POST /identity/v3/users => generated 283 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:14:26.740487 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20aaaa-7a76-4f80-ae17-223f55a83cf8 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:26.751052 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20aaaa-7a76-4f80-ae17-223f55a83cf8 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:26.755715 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019a6a9-f648-4ded-b5b9-6d1aecefd0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:26.756410 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019a6a9-f648-4ded-b5b9-6d1aecefd0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:26.756740 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019a6a9-f648-4ded-b5b9-6d1aecefd0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:26.757019 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019a6a9-f648-4ded-b5b9-6d1aecefd0a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:26.757740 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019a6a9-f648-4ded-b5b9-6d1aecefd0a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:26.759326 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019a6a9-f648-4ded-b5b9-6d1aecefd0a5 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:26.770919 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1415/2831] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:14:26 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:14:26.775041 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a602bb-34c8-4f84-ad12-ad1ccadd16ac admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:26.786149 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a602bb-34c8-4f84-ad12-ad1ccadd16ac admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:26.790726 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325530e5-33d9-4d67-8aa7-4b0617842739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:26.791380 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325530e5-33d9-4d67-8aa7-4b0617842739 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:26.791666 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325530e5-33d9-4d67-8aa7-4b0617842739 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:26.791944 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325530e5-33d9-4d67-8aa7-4b0617842739 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:26.792755 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325530e5-33d9-4d67-8aa7-4b0617842739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:26.794374 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325530e5-33d9-4d67-8aa7-4b0617842739 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:26.804398 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1417/2832] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:14:26 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:14:26.808472 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019a6a9-f648-4ded-b5b9-6d1aecefd0a5 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:26.818940 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019a6a9-f648-4ded-b5b9-6d1aecefd0a5 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:26.823530 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8a1e2-3732-44e1-ac56-219b0c1c4137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:26.824512 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8a1e2-3732-44e1-ac56-219b0c1c4137 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:26.824804 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8a1e2-3732-44e1-ac56-219b0c1c4137 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:26.825088 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8a1e2-3732-44e1-ac56-219b0c1c4137 admin admin] PATH_INFO: `/v3/projects/b11fcd640b9341f1a066283ebd9c2ec3/users/4abb382053394d5ba5a378354fd8db9e/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:26.840380 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8a1e2-3732-44e1-ac56-219b0c1c4137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b11fcd640b9341f1a066283ebd9c2ec3, user_id=4abb382053394d5ba5a378354fd8db9e, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:26.843015 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8a1e2-3732-44e1-ac56-219b0c1c4137 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:26.902046 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1416/2833] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:14:26 2022] PUT /identity/v3/projects/b11fcd640b9341f1a066283ebd9c2ec3/users/4abb382053394d5ba5a378354fd8db9e/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:26.914023 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf70ce2-a08a-4f5c-8715-a3c1e026d615 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:26.914324 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf70ce2-a08a-4f5c-8715-a3c1e026d615 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:26.914639 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf70ce2-a08a-4f5c-8715-a3c1e026d615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:26.941267 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-5cf70ce2-a08a-4f5c-8715-a3c1e026d615 None None] MFA Rules not processed for user `4abb382053394d5ba5a378354fd8db9e`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:26.942488 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-5cf70ce2-a08a-4f5c-8715-a3c1e026d615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:27.006364 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1418/2834] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:14:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:27.010894 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8a1e2-3732-44e1-ac56-219b0c1c4137 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:27.072067 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8a1e2-3732-44e1-ac56-219b0c1c4137 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:27.076659 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485397cc-0d40-45b9-96d3-8d91f1f4ac33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:27.077407 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485397cc-0d40-45b9-96d3-8d91f1f4ac33 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:27.077700 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485397cc-0d40-45b9-96d3-8d91f1f4ac33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:27.077982 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485397cc-0d40-45b9-96d3-8d91f1f4ac33 admin admin] PATH_INFO: `/v3/projects` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:27.078678 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485397cc-0d40-45b9-96d3-8d91f1f4ac33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:27.081391 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485397cc-0d40-45b9-96d3-8d91f1f4ac33 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:27.094212 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:27.171048 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1417/2835] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:14:27 2022] POST /identity/v3/projects => generated 364 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:14:27.175235 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf70ce2-a08a-4f5c-8715-a3c1e026d615 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:27.185792 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf70ce2-a08a-4f5c-8715-a3c1e026d615 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:27.243445 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84104eea-3a2e-42c5-a31d-4fb00152586b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:27.244133 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84104eea-3a2e-42c5-a31d-4fb00152586b admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:27.244428 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84104eea-3a2e-42c5-a31d-4fb00152586b admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:27.244708 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84104eea-3a2e-42c5-a31d-4fb00152586b admin admin] PATH_INFO: `/v3/users` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:27.245388 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84104eea-3a2e-42c5-a31d-4fb00152586b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:27.247277 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84104eea-3a2e-42c5-a31d-4fb00152586b admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:27.336715 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1419/2836] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:14:27 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:14:27.340941 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485397cc-0d40-45b9-96d3-8d91f1f4ac33 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:27.351481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485397cc-0d40-45b9-96d3-8d91f1f4ac33 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:27.356083 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d847a-1c67-46f1-bd3d-d9b4ac52db75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:27.356778 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d847a-1c67-46f1-bd3d-d9b4ac52db75 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:27.357069 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d847a-1c67-46f1-bd3d-d9b4ac52db75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:27.357354 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d847a-1c67-46f1-bd3d-d9b4ac52db75 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:27.358079 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d847a-1c67-46f1-bd3d-d9b4ac52db75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:27.359671 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d847a-1c67-46f1-bd3d-d9b4ac52db75 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:27.370697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1418/2837] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:14:27 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:14:27.374800 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84104eea-3a2e-42c5-a31d-4fb00152586b admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:27.385672 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84104eea-3a2e-42c5-a31d-4fb00152586b admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:27.390312 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea31df-1838-4226-b936-8c92c49bcaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:27.391230 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea31df-1838-4226-b936-8c92c49bcaba admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:27.391565 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea31df-1838-4226-b936-8c92c49bcaba admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:27.391886 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea31df-1838-4226-b936-8c92c49bcaba admin admin] PATH_INFO: `/v3/projects/af376daf03554abdb8db2801ef3dbb87/users/436908d78a48429bb2eb0d2dffb9def5/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:27.406515 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea31df-1838-4226-b936-8c92c49bcaba admin admin] RBAC: Authorizing `identity:create_grant(project_id=af376daf03554abdb8db2801ef3dbb87, user_id=436908d78a48429bb2eb0d2dffb9def5, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:27.409736 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea31df-1838-4226-b936-8c92c49bcaba admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:27.474066 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1420/2838] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:14:27 2022] PUT /identity/v3/projects/af376daf03554abdb8db2801ef3dbb87/users/436908d78a48429bb2eb0d2dffb9def5/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:27.478001 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d847a-1c67-46f1-bd3d-d9b4ac52db75 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:27.490747 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d847a-1c67-46f1-bd3d-d9b4ac52db75 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:27.559236 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58ba6a-bc78-4c5d-b27e-a152874d8c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:27.559918 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58ba6a-bc78-4c5d-b27e-a152874d8c34 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:27.560309 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58ba6a-bc78-4c5d-b27e-a152874d8c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:27.560601 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58ba6a-bc78-4c5d-b27e-a152874d8c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:27.561330 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58ba6a-bc78-4c5d-b27e-a152874d8c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:27.562989 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58ba6a-bc78-4c5d-b27e-a152874d8c34 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:27.573651 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1419/2839] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:14:27 2022] GET /identity/v3/roles => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 16:14:27.577966 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea31df-1838-4226-b936-8c92c49bcaba admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:27.588701 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea31df-1838-4226-b936-8c92c49bcaba admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:27.593258 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372a15c-4e39-4ded-91b3-efeecdab5ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:27.594125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372a15c-4e39-4ded-91b3-efeecdab5ba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:27.594410 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372a15c-4e39-4ded-91b3-efeecdab5ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:27.594826 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372a15c-4e39-4ded-91b3-efeecdab5ba9 admin admin] PATH_INFO: `/v3/projects/af376daf03554abdb8db2801ef3dbb87/users/436908d78a48429bb2eb0d2dffb9def5/roles/07aaf007cde043318319928d151bdc75` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:27.596678 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372a15c-4e39-4ded-91b3-efeecdab5ba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af376daf03554abdb8db2801ef3dbb87, user_id=436908d78a48429bb2eb0d2dffb9def5, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:27.599628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372a15c-4e39-4ded-91b3-efeecdab5ba9 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:27.601920 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:27.610876 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1421/2840] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:14:27 2022] PUT /identity/v3/projects/af376daf03554abdb8db2801ef3dbb87/users/436908d78a48429bb2eb0d2dffb9def5/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:14:27.621124 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075444b0-08cb-4c97-ace5-0317ce9ef9ea None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:27.621419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075444b0-08cb-4c97-ace5-0317ce9ef9ea None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:27.621722 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075444b0-08cb-4c97-ace5-0317ce9ef9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:27.648489 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-075444b0-08cb-4c97-ace5-0317ce9ef9ea None None] MFA Rules not processed for user `436908d78a48429bb2eb0d2dffb9def5`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:27.649697 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-075444b0-08cb-4c97-ace5-0317ce9ef9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:27.716980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1420/2841] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:14:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:27.729236 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372a15c-4e39-4ded-91b3-efeecdab5ba9 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:27.730938 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-0372a15c-4e39-4ded-91b3-efeecdab5ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:27.788790 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372a15c-4e39-4ded-91b3-efeecdab5ba9 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:27.792512 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57d6f4-63bb-46bd-8fa6-4353c4585ef7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:27.793166 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57d6f4-63bb-46bd-8fa6-4353c4585ef7 service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:27.793456 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57d6f4-63bb-46bd-8fa6-4353c4585ef7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:27.793740 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57d6f4-63bb-46bd-8fa6-4353c4585ef7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:27.803724 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57d6f4-63bb-46bd-8fa6-4353c4585ef7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:27.805205 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57d6f4-63bb-46bd-8fa6-4353c4585ef7 service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:27.814802 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1422/2842] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:14:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:14:28.673139 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075444b0-08cb-4c97-ace5-0317ce9ef9ea None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:28.752089 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075444b0-08cb-4c97-ace5-0317ce9ef9ea None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:28.756775 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67245a9e-8b76-446c-9889-555717589723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:28.757663 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67245a9e-8b76-446c-9889-555717589723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:28.757951 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67245a9e-8b76-446c-9889-555717589723 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:28.758233 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67245a9e-8b76-446c-9889-555717589723 admin admin] PATH_INFO: `/v3/users/4abb382053394d5ba5a378354fd8db9e` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:28.760424 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67245a9e-8b76-446c-9889-555717589723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4abb382053394d5ba5a378354fd8db9e)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:28.762349 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67245a9e-8b76-446c-9889-555717589723 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:28.768027 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:29.121143 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-67245a9e-8b76-446c-9889-555717589723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4abb382053394d5ba5a378354fd8db9e'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:29.121814 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-67245a9e-8b76-446c-9889-555717589723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4abb382053394d5ba5a378354fd8db9e'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:29.135040 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-67245a9e-8b76-446c-9889-555717589723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4abb382053394d5ba5a378354fd8db9e'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:29.142244 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-67245a9e-8b76-446c-9889-555717589723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4abb382053394d5ba5a378354fd8db9e'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:29.142893 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-67245a9e-8b76-446c-9889-555717589723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4abb382053394d5ba5a378354fd8db9e'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:29.210265 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1421/2843] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:14:28 2022] DELETE /identity/v3/users/4abb382053394d5ba5a378354fd8db9e => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:29.214903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b1da7-a4f7-4c28-b72b-4c1ffb447f0d None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:29.215458 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b1da7-a4f7-4c28-b72b-4c1ffb447f0d None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:29.215669 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b1da7-a4f7-4c28-b72b-4c1ffb447f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:29.244913 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-224b1da7-a4f7-4c28-b72b-4c1ffb447f0d None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:29.246141 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-224b1da7-a4f7-4c28-b72b-4c1ffb447f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:29.335964 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1423/2844] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:29.346320 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67245a9e-8b76-446c-9889-555717589723 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:29.347802 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-67245a9e-8b76-446c-9889-555717589723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:29.408645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67245a9e-8b76-446c-9889-555717589723 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:29.412176 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc309555-cbd3-470f-b26c-921c92ee9c44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:29.412824 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc309555-cbd3-470f-b26c-921c92ee9c44 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:29.413112 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc309555-cbd3-470f-b26c-921c92ee9c44 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:29.413391 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc309555-cbd3-470f-b26c-921c92ee9c44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:29.422341 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc309555-cbd3-470f-b26c-921c92ee9c44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:29.424493 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc309555-cbd3-470f-b26c-921c92ee9c44 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:29.433808 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1422/2845] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:14:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:14:29.874588 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b1da7-a4f7-4c28-b72b-4c1ffb447f0d None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:29.876993 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-224b1da7-a4f7-4c28-b72b-4c1ffb447f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:29.919359 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b1da7-a4f7-4c28-b72b-4c1ffb447f0d None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:29.924720 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc5069-5e1f-4f6e-b765-b4077dd93c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:29.925590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc5069-5e1f-4f6e-b765-b4077dd93c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:29.925882 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc5069-5e1f-4f6e-b765-b4077dd93c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:29.926167 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc5069-5e1f-4f6e-b765-b4077dd93c16 admin admin] PATH_INFO: `/v3/projects/b11fcd640b9341f1a066283ebd9c2ec3` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:29.927361 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc5069-5e1f-4f6e-b765-b4077dd93c16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b11fcd640b9341f1a066283ebd9c2ec3)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:29.929326 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc5069-5e1f-4f6e-b765-b4077dd93c16 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:30.050247 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:INSERT=1,keystone:SELECT=97,keystone:DELETE=2 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:30.062994 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-96cc5069-5e1f-4f6e-b765-b4077dd93c16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b11fcd640b9341f1a066283ebd9c2ec3', 'request_id': 'req-96cc5069-5e1f-4f6e-b765-b4077dd93c16'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:30.069590 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-96cc5069-5e1f-4f6e-b765-b4077dd93c16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b11fcd640b9341f1a066283ebd9c2ec3', 'request_id': 'req-96cc5069-5e1f-4f6e-b765-b4077dd93c16'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:30.135785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-96cc5069-5e1f-4f6e-b765-b4077dd93c16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b11fcd640b9341f1a066283ebd9c2ec3', 'request_id': 'req-96cc5069-5e1f-4f6e-b765-b4077dd93c16'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:30.147301 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-96cc5069-5e1f-4f6e-b765-b4077dd93c16 admin admin] The token cache is being invalidate because project b11fcd640b9341f1a066283ebd9c2ec3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:14:30.147943 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-96cc5069-5e1f-4f6e-b765-b4077dd93c16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:30.149071 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-96cc5069-5e1f-4f6e-b765-b4077dd93c16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:30.151447 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1424/2846] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:14:29 2022] DELETE /identity/v3/projects/b11fcd640b9341f1a066283ebd9c2ec3 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:30.155583 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc309555-cbd3-470f-b26c-921c92ee9c44 service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:30.166738 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc309555-cbd3-470f-b26c-921c92ee9c44 service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:30.223859 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5806a1-e817-4e9a-b6a5-a61224052e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:30.224705 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5806a1-e817-4e9a-b6a5-a61224052e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:30.224995 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5806a1-e817-4e9a-b6a5-a61224052e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:30.225278 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5806a1-e817-4e9a-b6a5-a61224052e64 admin admin] PATH_INFO: `/v3/users/436908d78a48429bb2eb0d2dffb9def5` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:30.226461 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5806a1-e817-4e9a-b6a5-a61224052e64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=436908d78a48429bb2eb0d2dffb9def5)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:30.228421 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5806a1-e817-4e9a-b6a5-a61224052e64 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:30.254166 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:30.383194 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5f5806a1-e817-4e9a-b6a5-a61224052e64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '436908d78a48429bb2eb0d2dffb9def5'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:30.383908 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5f5806a1-e817-4e9a-b6a5-a61224052e64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '436908d78a48429bb2eb0d2dffb9def5'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:30.396788 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5f5806a1-e817-4e9a-b6a5-a61224052e64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '436908d78a48429bb2eb0d2dffb9def5'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:30.404003 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5f5806a1-e817-4e9a-b6a5-a61224052e64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '436908d78a48429bb2eb0d2dffb9def5'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:30.404735 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5f5806a1-e817-4e9a-b6a5-a61224052e64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '436908d78a48429bb2eb0d2dffb9def5'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:30.484380 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1423/2847] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:14:30 2022] DELETE /identity/v3/users/436908d78a48429bb2eb0d2dffb9def5 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:30.902962 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc5069-5e1f-4f6e-b765-b4077dd93c16 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:30.904508 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-96cc5069-5e1f-4f6e-b765-b4077dd93c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:30.918197 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc5069-5e1f-4f6e-b765-b4077dd93c16 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:30.982210 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f1859-9db8-4202-8bf0-90edff3c3901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:30.983076 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f1859-9db8-4202-8bf0-90edff3c3901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:30.983360 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f1859-9db8-4202-8bf0-90edff3c3901 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:30.983634 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f1859-9db8-4202-8bf0-90edff3c3901 admin admin] PATH_INFO: `/v3/projects/af376daf03554abdb8db2801ef3dbb87` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:30.984949 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f1859-9db8-4202-8bf0-90edff3c3901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af376daf03554abdb8db2801ef3dbb87)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:30.987165 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f1859-9db8-4202-8bf0-90edff3c3901 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:31.073773 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-f02f1859-9db8-4202-8bf0-90edff3c3901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af376daf03554abdb8db2801ef3dbb87', 'request_id': 'req-f02f1859-9db8-4202-8bf0-90edff3c3901'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:31.080563 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-f02f1859-9db8-4202-8bf0-90edff3c3901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af376daf03554abdb8db2801ef3dbb87', 'request_id': 'req-f02f1859-9db8-4202-8bf0-90edff3c3901'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:31.130382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-f02f1859-9db8-4202-8bf0-90edff3c3901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af376daf03554abdb8db2801ef3dbb87', 'request_id': 'req-f02f1859-9db8-4202-8bf0-90edff3c3901'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:31.141508 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-f02f1859-9db8-4202-8bf0-90edff3c3901 admin admin] The token cache is being invalidate because project af376daf03554abdb8db2801ef3dbb87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:14:31.143684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-f02f1859-9db8-4202-8bf0-90edff3c3901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:31.143684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-f02f1859-9db8-4202-8bf0-90edff3c3901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:31.144014 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1425/2848] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:14:30 2022] DELETE /identity/v3/projects/af376daf03554abdb8db2801ef3dbb87 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:31.148823 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e15277-3642-429b-b65e-3534545d1ea3 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:31.149121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e15277-3642-429b-b65e-3534545d1ea3 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:31.149400 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e15277-3642-429b-b65e-3534545d1ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:31.339885 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-59e15277-3642-429b-b65e-3534545d1ea3 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:31.342283 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-59e15277-3642-429b-b65e-3534545d1ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:31.403188 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1424/2849] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:31.410988 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a358375-9f98-44e2-a719-2928d3a5d994 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:31.411284 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a358375-9f98-44e2-a719-2928d3a5d994 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:31.411570 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a358375-9f98-44e2-a719-2928d3a5d994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:31.430229 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-3a358375-9f98-44e2-a719-2928d3a5d994 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:31.431471 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-3a358375-9f98-44e2-a719-2928d3a5d994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:31.440184 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1426/2850] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:31.444598 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e15277-3642-429b-b65e-3534545d1ea3 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:31.454641 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e15277-3642-429b-b65e-3534545d1ea3 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:31.459493 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243aa01-c848-491a-8138-35e65cba8e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:31.460182 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243aa01-c848-491a-8138-35e65cba8e27 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:31.460538 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243aa01-c848-491a-8138-35e65cba8e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:31.460819 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243aa01-c848-491a-8138-35e65cba8e27 admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:31.461683 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243aa01-c848-491a-8138-35e65cba8e27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:14:31.461998 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243aa01-c848-491a-8138-35e65cba8e27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:31.463920 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243aa01-c848-491a-8138-35e65cba8e27 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:31.477121 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1425/2851] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 16:14:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:14:31.481382 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a358375-9f98-44e2-a719-2928d3a5d994 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:31.491437 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a358375-9f98-44e2-a719-2928d3a5d994 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:31.496086 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54845a53-49db-4378-aab9-55ba5a52a0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:31.496861 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54845a53-49db-4378-aab9-55ba5a52a0f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:31.497148 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54845a53-49db-4378-aab9-55ba5a52a0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:31.497429 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54845a53-49db-4378-aab9-55ba5a52a0f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:31.498114 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54845a53-49db-4378-aab9-55ba5a52a0f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:31.499980 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54845a53-49db-4378-aab9-55ba5a52a0f3 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:31.583196 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1427/2852] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:14:31 2022] POST /identity/v3/projects => generated 370 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:14:31.587379 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243aa01-c848-491a-8138-35e65cba8e27 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:31.598060 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243aa01-c848-491a-8138-35e65cba8e27 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:31.648872 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:31.655140 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b962f4f-5f32-4619-8415-869e60a863b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:31.659972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b962f4f-5f32-4619-8415-869e60a863b2 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:31.659972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b962f4f-5f32-4619-8415-869e60a863b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:31.659972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b962f4f-5f32-4619-8415-869e60a863b2 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:31.659972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b962f4f-5f32-4619-8415-869e60a863b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:31.659972 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b962f4f-5f32-4619-8415-869e60a863b2 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:31.746155 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1426/2853] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:14:31 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:14:31.750484 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54845a53-49db-4378-aab9-55ba5a52a0f3 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:31.761484 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54845a53-49db-4378-aab9-55ba5a52a0f3 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:31.766145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734cc3d3-53dc-419e-9981-b44ce6cb8b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:31.767255 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cc3d3-53dc-419e-9981-b44ce6cb8b0c admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:31.767548 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cc3d3-53dc-419e-9981-b44ce6cb8b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:31.767833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cc3d3-53dc-419e-9981-b44ce6cb8b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:31.768626 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734cc3d3-53dc-419e-9981-b44ce6cb8b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:31.770228 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734cc3d3-53dc-419e-9981-b44ce6cb8b0c admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:31.780695 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1428/2854] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:14:31 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 16:14:31.788197 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b962f4f-5f32-4619-8415-869e60a863b2 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:31.799032 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b962f4f-5f32-4619-8415-869e60a863b2 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:31.803724 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aaea94-48af-49fb-a6e5-eb2940b6c058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:31.804703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aaea94-48af-49fb-a6e5-eb2940b6c058 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:31.805193 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aaea94-48af-49fb-a6e5-eb2940b6c058 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:31.805740 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aaea94-48af-49fb-a6e5-eb2940b6c058 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:31.806474 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aaea94-48af-49fb-a6e5-eb2940b6c058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:31.808180 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aaea94-48af-49fb-a6e5-eb2940b6c058 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:31.818148 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1427/2855] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:14:31 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:14:31.822152 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734cc3d3-53dc-419e-9981-b44ce6cb8b0c admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:31.832765 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734cc3d3-53dc-419e-9981-b44ce6cb8b0c admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:31.837360 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0771396-259e-4a2b-b445-e5c8ef0bfe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:31.838233 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0771396-259e-4a2b-b445-e5c8ef0bfe72 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:31.838519 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0771396-259e-4a2b-b445-e5c8ef0bfe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:31.838796 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0771396-259e-4a2b-b445-e5c8ef0bfe72 admin admin] PATH_INFO: `/v3/projects/3069251053684fc4a4cc4dc2552f8168/users/bcd6ccfcc5814f398ce321cdea33fc8f/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:31.841823 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:31.854289 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0771396-259e-4a2b-b445-e5c8ef0bfe72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3069251053684fc4a4cc4dc2552f8168, user_id=bcd6ccfcc5814f398ce321cdea33fc8f, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:31.856890 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0771396-259e-4a2b-b445-e5c8ef0bfe72 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:31.947677 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1429/2856] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:14:31 2022] PUT /identity/v3/projects/3069251053684fc4a4cc4dc2552f8168/users/bcd6ccfcc5814f398ce321cdea33fc8f/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:32.013002 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3f3e4-bf7b-4c6a-bf04-12cd9a9bea5d None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:32.013302 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3f3e4-bf7b-4c6a-bf04-12cd9a9bea5d None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:32.013590 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3f3e4-bf7b-4c6a-bf04-12cd9a9bea5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:32.040453 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-68f3f3e4-bf7b-4c6a-bf04-12cd9a9bea5d None None] MFA Rules not processed for user `bcd6ccfcc5814f398ce321cdea33fc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:32.041695 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-68f3f3e4-bf7b-4c6a-bf04-12cd9a9bea5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:32.106865 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1428/2857] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:14:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:32.111865 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0771396-259e-4a2b-b445-e5c8ef0bfe72 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:32.174231 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0771396-259e-4a2b-b445-e5c8ef0bfe72 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:32.178951 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa873c5b-8ea6-4780-b6f7-67db41c6daa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:32.179616 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa873c5b-8ea6-4780-b6f7-67db41c6daa2 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:32.179901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa873c5b-8ea6-4780-b6f7-67db41c6daa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:32.180217 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa873c5b-8ea6-4780-b6f7-67db41c6daa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:32.180903 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa873c5b-8ea6-4780-b6f7-67db41c6daa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:32.182823 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa873c5b-8ea6-4780-b6f7-67db41c6daa2 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:32.282686 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1430/2858] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:14:32 2022] POST /identity/v3/projects => generated 370 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:14:32.287074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3f3e4-bf7b-4c6a-bf04-12cd9a9bea5d None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:32.298573 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3f3e4-bf7b-4c6a-bf04-12cd9a9bea5d None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:32.354515 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7af35f-0058-48ac-a7d6-4be537f09df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:32.355192 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7af35f-0058-48ac-a7d6-4be537f09df0 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:32.355593 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7af35f-0058-48ac-a7d6-4be537f09df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:32.355881 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7af35f-0058-48ac-a7d6-4be537f09df0 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:32.356616 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7af35f-0058-48ac-a7d6-4be537f09df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:32.358620 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7af35f-0058-48ac-a7d6-4be537f09df0 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:32.474481 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1429/2859] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:14:32 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:14:32.478628 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa873c5b-8ea6-4780-b6f7-67db41c6daa2 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:32.489990 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa873c5b-8ea6-4780-b6f7-67db41c6daa2 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:32.494568 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f965e6b-9b6a-491d-9332-58e9c926f93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:32.495232 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f965e6b-9b6a-491d-9332-58e9c926f93d admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:32.495525 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f965e6b-9b6a-491d-9332-58e9c926f93d admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:32.495815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f965e6b-9b6a-491d-9332-58e9c926f93d admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:32.496598 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f965e6b-9b6a-491d-9332-58e9c926f93d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:32.498199 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f965e6b-9b6a-491d-9332-58e9c926f93d admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:32.509540 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1431/2860] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:14:32 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:14:32.514980 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7af35f-0058-48ac-a7d6-4be537f09df0 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:32.525457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7af35f-0058-48ac-a7d6-4be537f09df0 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:32.530131 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be7727-96fc-4388-a9e1-5c94ae55a018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:32.531076 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be7727-96fc-4388-a9e1-5c94ae55a018 admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:32.531360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be7727-96fc-4388-a9e1-5c94ae55a018 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:32.531636 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be7727-96fc-4388-a9e1-5c94ae55a018 admin admin] PATH_INFO: `/v3/projects/72a15b86db7f46c7a50de000e9699617/users/08377bb9ca9545008c61fecdfeb53e4c/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:32.547070 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be7727-96fc-4388-a9e1-5c94ae55a018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a15b86db7f46c7a50de000e9699617, user_id=08377bb9ca9545008c61fecdfeb53e4c, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:32.550446 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be7727-96fc-4388-a9e1-5c94ae55a018 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:32.621521 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1430/2861] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:14:32 2022] PUT /identity/v3/projects/72a15b86db7f46c7a50de000e9699617/users/08377bb9ca9545008c61fecdfeb53e4c/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:32.625693 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f965e6b-9b6a-491d-9332-58e9c926f93d admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:32.636288 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f965e6b-9b6a-491d-9332-58e9c926f93d admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:32.692168 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbd578-915d-4736-b3e2-0977c9cba122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:32.692839 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbd578-915d-4736-b3e2-0977c9cba122 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:32.693128 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbd578-915d-4736-b3e2-0977c9cba122 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:32.693410 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbd578-915d-4736-b3e2-0977c9cba122 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:32.694135 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbd578-915d-4736-b3e2-0977c9cba122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:32.695782 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbd578-915d-4736-b3e2-0977c9cba122 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:32.706242 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1432/2862] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:14:32 2022] GET /identity/v3/roles => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:14:32.710400 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be7727-96fc-4388-a9e1-5c94ae55a018 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:32.721922 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be7727-96fc-4388-a9e1-5c94ae55a018 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:32.726905 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07728f8a-2630-440d-9ad4-f0a228223b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:32.727793 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07728f8a-2630-440d-9ad4-f0a228223b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:32.728083 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07728f8a-2630-440d-9ad4-f0a228223b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:32.728397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07728f8a-2630-440d-9ad4-f0a228223b1a admin admin] PATH_INFO: `/v3/projects/72a15b86db7f46c7a50de000e9699617/users/08377bb9ca9545008c61fecdfeb53e4c/roles/07aaf007cde043318319928d151bdc75` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:32.730440 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07728f8a-2630-440d-9ad4-f0a228223b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a15b86db7f46c7a50de000e9699617, user_id=08377bb9ca9545008c61fecdfeb53e4c, role_id=07aaf007cde043318319928d151bdc75)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:32.733151 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07728f8a-2630-440d-9ad4-f0a228223b1a admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:32.743581 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1431/2863] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:14:32 2022] PUT /identity/v3/projects/72a15b86db7f46c7a50de000e9699617/users/08377bb9ca9545008c61fecdfeb53e4c/roles/07aaf007cde043318319928d151bdc75 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:32.754226 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba1b6d-a92c-43e4-bf15-b505b9d5d361 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:32.754665 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba1b6d-a92c-43e4-bf15-b505b9d5d361 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:32.755058 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba1b6d-a92c-43e4-bf15-b505b9d5d361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:32.782027 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-9bba1b6d-a92c-43e4-bf15-b505b9d5d361 None None] MFA Rules not processed for user `08377bb9ca9545008c61fecdfeb53e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:32.783833 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-9bba1b6d-a92c-43e4-bf15-b505b9d5d361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:32.827161 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:32.853189 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1433/2864] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:14:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:32.865394 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07728f8a-2630-440d-9ad4-f0a228223b1a admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:32.867209 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-07728f8a-2630-440d-9ad4-f0a228223b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:32.889044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:32.944258 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07728f8a-2630-440d-9ad4-f0a228223b1a admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:32.948191 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de9061-5e4f-465c-9a82-e899235c7054 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:32.948843 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de9061-5e4f-465c-9a82-e899235c7054 service cinder] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:32.949133 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de9061-5e4f-465c-9a82-e899235c7054 service cinder] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:32.949417 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de9061-5e4f-465c-9a82-e899235c7054 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:32.960215 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de9061-5e4f-465c-9a82-e899235c7054 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:32.961692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de9061-5e4f-465c-9a82-e899235c7054 service cinder] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:32.971226 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1432/2865] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:14:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:14:33.077877 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba1b6d-a92c-43e4-bf15-b505b9d5d361 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:33.080220 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-9bba1b6d-a92c-43e4-bf15-b505b9d5d361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:33.093368 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba1b6d-a92c-43e4-bf15-b505b9d5d361 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:33.097421 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b827e-501c-4476-9799-e9b152a0b480 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:33.098098 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b827e-501c-4476-9799-e9b152a0b480 service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:33.098479 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b827e-501c-4476-9799-e9b152a0b480 service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:33.099007 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b827e-501c-4476-9799-e9b152a0b480 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:33.154407 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b827e-501c-4476-9799-e9b152a0b480 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:33.155756 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b827e-501c-4476-9799-e9b152a0b480 service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:33.165755 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1434/2866] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:14:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:14:38.007881 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de9061-5e4f-465c-9a82-e899235c7054 service cinder] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:38.073610 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de9061-5e4f-465c-9a82-e899235c7054 service cinder] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:38.078101 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b825b1f-80b4-4e35-ae50-9380cd9a9044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:38.079046 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b825b1f-80b4-4e35-ae50-9380cd9a9044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:38.079466 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b825b1f-80b4-4e35-ae50-9380cd9a9044 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:38.079875 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b825b1f-80b4-4e35-ae50-9380cd9a9044 admin admin] PATH_INFO: `/v3/users/bcd6ccfcc5814f398ce321cdea33fc8f` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:38.081178 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b825b1f-80b4-4e35-ae50-9380cd9a9044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcd6ccfcc5814f398ce321cdea33fc8f)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:38.083065 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b825b1f-80b4-4e35-ae50-9380cd9a9044 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:38.281320 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-1b825b1f-80b4-4e35-ae50-9380cd9a9044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcd6ccfcc5814f398ce321cdea33fc8f'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:38.281981 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-1b825b1f-80b4-4e35-ae50-9380cd9a9044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcd6ccfcc5814f398ce321cdea33fc8f'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:38.294503 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-1b825b1f-80b4-4e35-ae50-9380cd9a9044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcd6ccfcc5814f398ce321cdea33fc8f'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:38.302666 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-1b825b1f-80b4-4e35-ae50-9380cd9a9044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcd6ccfcc5814f398ce321cdea33fc8f'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:38.303358 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-1b825b1f-80b4-4e35-ae50-9380cd9a9044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcd6ccfcc5814f398ce321cdea33fc8f'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:38.382192 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1433/2867] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:14:38 2022] DELETE /identity/v3/users/bcd6ccfcc5814f398ce321cdea33fc8f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:38.386792 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228ab0a-0ef9-44ba-8dae-ca40d2eb576e None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:38.387299 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228ab0a-0ef9-44ba-8dae-ca40d2eb576e None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:38.387413 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228ab0a-0ef9-44ba-8dae-ca40d2eb576e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:38.404356 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-9228ab0a-0ef9-44ba-8dae-ca40d2eb576e None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:38.405595 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-9228ab0a-0ef9-44ba-8dae-ca40d2eb576e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:38.466381 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1435/2868] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:38.476991 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b825b1f-80b4-4e35-ae50-9380cd9a9044 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:38.478392 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-1b825b1f-80b4-4e35-ae50-9380cd9a9044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:38.508330 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:38.560461 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b825b1f-80b4-4e35-ae50-9380cd9a9044 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:38.564935 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3aabc-b35c-4353-95ba-1235cdc01874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:38.565744 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3aabc-b35c-4353-95ba-1235cdc01874 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:38.565744 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3aabc-b35c-4353-95ba-1235cdc01874 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:38.565744 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3aabc-b35c-4353-95ba-1235cdc01874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:38.575050 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f3aabc-b35c-4353-95ba-1235cdc01874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:38.576547 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f3aabc-b35c-4353-95ba-1235cdc01874 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:38.587225 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1434/2869] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:14:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:14:39.017518 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228ab0a-0ef9-44ba-8dae-ca40d2eb576e None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:39.019379 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-9228ab0a-0ef9-44ba-8dae-ca40d2eb576e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:39.032054 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228ab0a-0ef9-44ba-8dae-ca40d2eb576e None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:39.037414 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49817fb3-33c4-4784-a4b8-f6013c5d43f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:39.038315 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49817fb3-33c4-4784-a4b8-f6013c5d43f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:39.038608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49817fb3-33c4-4784-a4b8-f6013c5d43f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:39.038890 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49817fb3-33c4-4784-a4b8-f6013c5d43f7 admin admin] PATH_INFO: `/v3/projects/3069251053684fc4a4cc4dc2552f8168` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:39.040230 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49817fb3-33c4-4784-a4b8-f6013c5d43f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3069251053684fc4a4cc4dc2552f8168)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:39.042191 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49817fb3-33c4-4784-a4b8-f6013c5d43f7 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:39.273256 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-49817fb3-33c4-4784-a4b8-f6013c5d43f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3069251053684fc4a4cc4dc2552f8168', 'request_id': 'req-49817fb3-33c4-4784-a4b8-f6013c5d43f7'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:39.279923 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-49817fb3-33c4-4784-a4b8-f6013c5d43f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3069251053684fc4a4cc4dc2552f8168', 'request_id': 'req-49817fb3-33c4-4784-a4b8-f6013c5d43f7'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:39.340515 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-49817fb3-33c4-4784-a4b8-f6013c5d43f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3069251053684fc4a4cc4dc2552f8168', 'request_id': 'req-49817fb3-33c4-4784-a4b8-f6013c5d43f7'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:39.352904 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-49817fb3-33c4-4784-a4b8-f6013c5d43f7 admin admin] The token cache is being invalidate because project 3069251053684fc4a4cc4dc2552f8168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:14:39.353212 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-49817fb3-33c4-4784-a4b8-f6013c5d43f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:39.353835 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-49817fb3-33c4-4784-a4b8-f6013c5d43f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:39.355373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1436/2870] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:14:39 2022] DELETE /identity/v3/projects/3069251053684fc4a4cc4dc2552f8168 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:39.359537 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3aabc-b35c-4353-95ba-1235cdc01874 service neutron] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:39.369886 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3aabc-b35c-4353-95ba-1235cdc01874 service neutron] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:39.432360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296eccc-03f9-465c-ad63-e343481af3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:39.433256 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296eccc-03f9-465c-ad63-e343481af3cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:39.433545 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296eccc-03f9-465c-ad63-e343481af3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:39.433829 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296eccc-03f9-465c-ad63-e343481af3cd admin admin] PATH_INFO: `/v3/users/08377bb9ca9545008c61fecdfeb53e4c` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:39.435104 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296eccc-03f9-465c-ad63-e343481af3cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=08377bb9ca9545008c61fecdfeb53e4c)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:39.437095 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296eccc-03f9-465c-ad63-e343481af3cd admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:39.629519 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5296eccc-03f9-465c-ad63-e343481af3cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08377bb9ca9545008c61fecdfeb53e4c'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:39.630184 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5296eccc-03f9-465c-ad63-e343481af3cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08377bb9ca9545008c61fecdfeb53e4c'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:39.642030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5296eccc-03f9-465c-ad63-e343481af3cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08377bb9ca9545008c61fecdfeb53e4c'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:39.648767 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5296eccc-03f9-465c-ad63-e343481af3cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08377bb9ca9545008c61fecdfeb53e4c'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:39.649411 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-5296eccc-03f9-465c-ad63-e343481af3cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08377bb9ca9545008c61fecdfeb53e4c'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:39.707293 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1435/2871] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:14:39 2022] DELETE /identity/v3/users/08377bb9ca9545008c61fecdfeb53e4c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:40.098153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49817fb3-33c4-4784-a4b8-f6013c5d43f7 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:40.100838 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-49817fb3-33c4-4784-a4b8-f6013c5d43f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:40.112642 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:40.117923 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49817fb3-33c4-4784-a4b8-f6013c5d43f7 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:40.175808 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc116d5-786c-45b5-a0c6-84357f5da128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:40.176830 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc116d5-786c-45b5-a0c6-84357f5da128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:40.177477 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc116d5-786c-45b5-a0c6-84357f5da128 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:40.177812 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc116d5-786c-45b5-a0c6-84357f5da128 admin admin] PATH_INFO: `/v3/projects/72a15b86db7f46c7a50de000e9699617` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:40.179021 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc116d5-786c-45b5-a0c6-84357f5da128 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72a15b86db7f46c7a50de000e9699617)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:40.180956 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc116d5-786c-45b5-a0c6-84357f5da128 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:40.370831 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-7dc116d5-786c-45b5-a0c6-84357f5da128 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72a15b86db7f46c7a50de000e9699617', 'request_id': 'req-7dc116d5-786c-45b5-a0c6-84357f5da128'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:40.377249 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-7dc116d5-786c-45b5-a0c6-84357f5da128 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72a15b86db7f46c7a50de000e9699617', 'request_id': 'req-7dc116d5-786c-45b5-a0c6-84357f5da128'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:40.450367 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-7dc116d5-786c-45b5-a0c6-84357f5da128 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72a15b86db7f46c7a50de000e9699617', 'request_id': 'req-7dc116d5-786c-45b5-a0c6-84357f5da128'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:40.462849 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-7dc116d5-786c-45b5-a0c6-84357f5da128 admin admin] The token cache is being invalidate because project 72a15b86db7f46c7a50de000e9699617 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:14:40.463145 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-7dc116d5-786c-45b5-a0c6-84357f5da128 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:40.463791 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-7dc116d5-786c-45b5-a0c6-84357f5da128 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:40.465351 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1437/2872] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:14:40 2022] DELETE /identity/v3/projects/72a15b86db7f46c7a50de000e9699617 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:40.475641 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbead275-ac10-4d52-9b3a-b6714217a3a3 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:40.476223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbead275-ac10-4d52-9b3a-b6714217a3a3 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:40.476223 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbead275-ac10-4d52-9b3a-b6714217a3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:40.496214 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-bbead275-ac10-4d52-9b3a-b6714217a3a3 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:40.497784 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-bbead275-ac10-4d52-9b3a-b6714217a3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:40.521305 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:40.562865 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1436/2873] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:40.571000 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56294fa-ab61-43ec-8a7d-c56fc8620e4a None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:40.571291 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56294fa-ab61-43ec-8a7d-c56fc8620e4a None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:40.571729 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56294fa-ab61-43ec-8a7d-c56fc8620e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:40.592999 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-b56294fa-ab61-43ec-8a7d-c56fc8620e4a None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:40.594200 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b56294fa-ab61-43ec-8a7d-c56fc8620e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:40.603298 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1438/2874] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:14:40.607584 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbead275-ac10-4d52-9b3a-b6714217a3a3 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:40.618164 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbead275-ac10-4d52-9b3a-b6714217a3a3 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:40.622692 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8ea77-652c-484b-a8ca-5476bf2ec3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:40.623346 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8ea77-652c-484b-a8ca-5476bf2ec3cf admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:40.623636 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8ea77-652c-484b-a8ca-5476bf2ec3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:40.623917 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8ea77-652c-484b-a8ca-5476bf2ec3cf admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:40.624690 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8ea77-652c-484b-a8ca-5476bf2ec3cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:14:40.624998 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8ea77-652c-484b-a8ca-5476bf2ec3cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:40.626749 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8ea77-652c-484b-a8ca-5476bf2ec3cf admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:40.638132 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1437/2875] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 16:14:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:14:40.642614 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56294fa-ab61-43ec-8a7d-c56fc8620e4a None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:40.651785 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56294fa-ab61-43ec-8a7d-c56fc8620e4a None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:40.656501 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b674a07-5a02-4564-9140-64fa1317b998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:40.657655 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b674a07-5a02-4564-9140-64fa1317b998 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:40.657948 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b674a07-5a02-4564-9140-64fa1317b998 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:40.658224 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b674a07-5a02-4564-9140-64fa1317b998 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:40.658908 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b674a07-5a02-4564-9140-64fa1317b998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:40.660816 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b674a07-5a02-4564-9140-64fa1317b998 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:40.777651 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1439/2876] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:14:40 2022] POST /identity/v3/projects => generated 386 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:14:40.784320 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8ea77-652c-484b-a8ca-5476bf2ec3cf admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:40.795234 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8ea77-652c-484b-a8ca-5476bf2ec3cf admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:40.852825 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe00ba-2c6f-4b74-8855-4920eef8a874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:40.853493 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe00ba-2c6f-4b74-8855-4920eef8a874 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:40.853777 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe00ba-2c6f-4b74-8855-4920eef8a874 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:40.854054 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe00ba-2c6f-4b74-8855-4920eef8a874 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:40.854748 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe00ba-2c6f-4b74-8855-4920eef8a874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:40.856668 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe00ba-2c6f-4b74-8855-4920eef8a874 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:40.965106 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1438/2877] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:14:40 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:14:40.969598 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b674a07-5a02-4564-9140-64fa1317b998 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:40.980759 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b674a07-5a02-4564-9140-64fa1317b998 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:40.985322 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d684f-60ff-4ddb-a1e4-e5387c94cb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:40.986081 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d684f-60ff-4ddb-a1e4-e5387c94cb08 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:40.986369 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d684f-60ff-4ddb-a1e4-e5387c94cb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:40.986649 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d684f-60ff-4ddb-a1e4-e5387c94cb08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:40.987404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d684f-60ff-4ddb-a1e4-e5387c94cb08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:40.989026 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d684f-60ff-4ddb-a1e4-e5387c94cb08 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:40.999128 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1440/2878] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:14:40 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:14:41.003419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe00ba-2c6f-4b74-8855-4920eef8a874 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:41.013515 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe00ba-2c6f-4b74-8855-4920eef8a874 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:41.018913 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea785b-d9cd-436a-95e2-3cbe63b89c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:41.019571 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea785b-d9cd-436a-95e2-3cbe63b89c82 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:41.019860 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea785b-d9cd-436a-95e2-3cbe63b89c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:41.020172 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea785b-d9cd-436a-95e2-3cbe63b89c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:41.020899 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea785b-d9cd-436a-95e2-3cbe63b89c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:41.022488 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea785b-d9cd-436a-95e2-3cbe63b89c82 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:41.033018 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1439/2879] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:14:41 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:14:41.037176 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d684f-60ff-4ddb-a1e4-e5387c94cb08 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:41.046878 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d684f-60ff-4ddb-a1e4-e5387c94cb08 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:41.051894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef075f7-0a81-460e-bcd5-31e8abf9e7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:41.052808 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef075f7-0a81-460e-bcd5-31e8abf9e7ba admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:41.053119 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef075f7-0a81-460e-bcd5-31e8abf9e7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:41.053395 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef075f7-0a81-460e-bcd5-31e8abf9e7ba admin admin] PATH_INFO: `/v3/projects/d83589b24e624ed1bb06d0a9b576e355/users/e6f88e6411d840f78d052cd16dc4996e/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:41.068985 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef075f7-0a81-460e-bcd5-31e8abf9e7ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d83589b24e624ed1bb06d0a9b576e355, user_id=e6f88e6411d840f78d052cd16dc4996e, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:41.071583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef075f7-0a81-460e-bcd5-31e8abf9e7ba admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:41.141586 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1441/2880] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:14:41 2022] PUT /identity/v3/projects/d83589b24e624ed1bb06d0a9b576e355/users/e6f88e6411d840f78d052cd16dc4996e/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:41.151960 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73bfb5-4bde-4441-9eab-0a0d24a63cb3 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:41.152297 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73bfb5-4bde-4441-9eab-0a0d24a63cb3 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:41.152580 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73bfb5-4bde-4441-9eab-0a0d24a63cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:41.179216 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-db73bfb5-4bde-4441-9eab-0a0d24a63cb3 None None] MFA Rules not processed for user `e6f88e6411d840f78d052cd16dc4996e`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:41.180471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-db73bfb5-4bde-4441-9eab-0a0d24a63cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:41.245545 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1440/2881] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:14:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:41.257285 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef075f7-0a81-460e-bcd5-31e8abf9e7ba admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:41.259007 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-4ef075f7-0a81-460e-bcd5-31e8abf9e7ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:41.290762 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:41.316313 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef075f7-0a81-460e-bcd5-31e8abf9e7ba admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:41.319934 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e5157-06d7-486e-a5a2-762a1b8a398d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd96e2cb043e64d04b3f7628a3419a064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:41.320610 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e5157-06d7-486e-a5a2-762a1b8a398d service cinder] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:41.320900 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e5157-06d7-486e-a5a2-762a1b8a398d service cinder] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:41.321181 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e5157-06d7-486e-a5a2-762a1b8a398d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:41.330026 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e5157-06d7-486e-a5a2-762a1b8a398d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:41.335283 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e5157-06d7-486e-a5a2-762a1b8a398d service cinder] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:41.340181 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1442/2882] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:14:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:14:41.361078 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73bfb5-4bde-4441-9eab-0a0d24a63cb3 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:41.387331 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:41.425112 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73bfb5-4bde-4441-9eab-0a0d24a63cb3 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:41.429948 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210113f-49f2-4cfe-9640-faf3efeb9e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:41.430876 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210113f-49f2-4cfe-9640-faf3efeb9e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:41.431168 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210113f-49f2-4cfe-9640-faf3efeb9e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:41.431452 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210113f-49f2-4cfe-9640-faf3efeb9e07 admin admin] PATH_INFO: `/v3/users/e6f88e6411d840f78d052cd16dc4996e` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:41.432743 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7210113f-49f2-4cfe-9640-faf3efeb9e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6f88e6411d840f78d052cd16dc4996e)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:41.434645 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7210113f-49f2-4cfe-9640-faf3efeb9e07 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:41.624145 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7210113f-49f2-4cfe-9640-faf3efeb9e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6f88e6411d840f78d052cd16dc4996e'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:41.624856 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7210113f-49f2-4cfe-9640-faf3efeb9e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6f88e6411d840f78d052cd16dc4996e'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:41.637318 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7210113f-49f2-4cfe-9640-faf3efeb9e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6f88e6411d840f78d052cd16dc4996e'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:41.644281 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7210113f-49f2-4cfe-9640-faf3efeb9e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6f88e6411d840f78d052cd16dc4996e'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:41.644942 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7210113f-49f2-4cfe-9640-faf3efeb9e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6f88e6411d840f78d052cd16dc4996e'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:41.741151 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1441/2883] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:14:41 2022] DELETE /identity/v3/users/e6f88e6411d840f78d052cd16dc4996e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:41.745929 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6755e-c06c-4bd9-a1b4-21e2c1239f6e None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:41.746249 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6755e-c06c-4bd9-a1b4-21e2c1239f6e None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:41.746532 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6755e-c06c-4bd9-a1b4-21e2c1239f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:41.764472 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-92f6755e-c06c-4bd9-a1b4-21e2c1239f6e None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:41.765749 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-92f6755e-c06c-4bd9-a1b4-21e2c1239f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:41.827630 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1443/2884] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:14:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:41.836965 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210113f-49f2-4cfe-9640-faf3efeb9e07 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:41.838471 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-7210113f-49f2-4cfe-9640-faf3efeb9e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:41.897774 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210113f-49f2-4cfe-9640-faf3efeb9e07 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:41.901563 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9ed5a-f670-4359-a5a5-a5d24f61ae93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:41.902221 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9ed5a-f670-4359-a5a5-a5d24f61ae93 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:41.902507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9ed5a-f670-4359-a5a5-a5d24f61ae93 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:41.902784 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9ed5a-f670-4359-a5a5-a5d24f61ae93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:41.912507 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9ed5a-f670-4359-a5a5-a5d24f61ae93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:41.914172 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9ed5a-f670-4359-a5a5-a5d24f61ae93 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:41.924536 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1442/2885] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:14:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:14:42.583660 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6755e-c06c-4bd9-a1b4-21e2c1239f6e None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:42.585256 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-92f6755e-c06c-4bd9-a1b4-21e2c1239f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:42.597758 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6755e-c06c-4bd9-a1b4-21e2c1239f6e None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:42.603055 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6653b95-4ec4-463b-9d81-d93ca8d82128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:42.603930 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6653b95-4ec4-463b-9d81-d93ca8d82128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:42.604249 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6653b95-4ec4-463b-9d81-d93ca8d82128 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:42.604533 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6653b95-4ec4-463b-9d81-d93ca8d82128 admin admin] PATH_INFO: `/v3/projects/d83589b24e624ed1bb06d0a9b576e355` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:42.605740 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6653b95-4ec4-463b-9d81-d93ca8d82128 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d83589b24e624ed1bb06d0a9b576e355)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:42.608970 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6653b95-4ec4-463b-9d81-d93ca8d82128 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:42.731067 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-d6653b95-4ec4-463b-9d81-d93ca8d82128 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd83589b24e624ed1bb06d0a9b576e355', 'request_id': 'req-d6653b95-4ec4-463b-9d81-d93ca8d82128'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:42.737746 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-d6653b95-4ec4-463b-9d81-d93ca8d82128 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd83589b24e624ed1bb06d0a9b576e355', 'request_id': 'req-d6653b95-4ec4-463b-9d81-d93ca8d82128'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:42.827265 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-d6653b95-4ec4-463b-9d81-d93ca8d82128 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd83589b24e624ed1bb06d0a9b576e355', 'request_id': 'req-d6653b95-4ec4-463b-9d81-d93ca8d82128'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:42.838125 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-d6653b95-4ec4-463b-9d81-d93ca8d82128 admin admin] The token cache is being invalidate because project d83589b24e624ed1bb06d0a9b576e355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:14:42.838415 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-d6653b95-4ec4-463b-9d81-d93ca8d82128 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:42.839043 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-d6653b95-4ec4-463b-9d81-d93ca8d82128 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:42.840620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1444/2886] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:14:42 2022] DELETE /identity/v3/projects/d83589b24e624ed1bb06d0a9b576e355 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:42.846042 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea7ef7-476b-4510-a0be-89e203db9cd1 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:42.846515 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea7ef7-476b-4510-a0be-89e203db9cd1 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:42.846637 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea7ef7-476b-4510-a0be-89e203db9cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:42.865401 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-4aea7ef7-476b-4510-a0be-89e203db9cd1 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:42.866644 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-4aea7ef7-476b-4510-a0be-89e203db9cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:42.908419 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:42.927740 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1443/2887] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:42.935752 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275e1ab-010d-4e53-b5f2-027006ec7c69 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:42.936052 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275e1ab-010d-4e53-b5f2-027006ec7c69 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:42.936387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275e1ab-010d-4e53-b5f2-027006ec7c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:42.955819 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-b275e1ab-010d-4e53-b5f2-027006ec7c69 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:42.957088 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b275e1ab-010d-4e53-b5f2-027006ec7c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:42.965129 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1445/2888] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:42.969398 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea7ef7-476b-4510-a0be-89e203db9cd1 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:42.980446 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea7ef7-476b-4510-a0be-89e203db9cd1 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:42.985232 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c5449-2a3e-45ac-95b4-d7117e55c428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:42.986067 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c5449-2a3e-45ac-95b4-d7117e55c428 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:42.986348 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c5449-2a3e-45ac-95b4-d7117e55c428 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:42.986627 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c5449-2a3e-45ac-95b4-d7117e55c428 admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:42.987360 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c5449-2a3e-45ac-95b4-d7117e55c428 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:14:42.987670 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c5449-2a3e-45ac-95b4-d7117e55c428 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:42.989306 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c5449-2a3e-45ac-95b4-d7117e55c428 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:43.000609 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1444/2889] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 16:14:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:14:43.005793 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275e1ab-010d-4e53-b5f2-027006ec7c69 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:43.015055 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275e1ab-010d-4e53-b5f2-027006ec7c69 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:43.020365 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94a14e-9c71-478a-ac31-2bee37c0fdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:43.021011 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94a14e-9c71-478a-ac31-2bee37c0fdcf admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:43.021297 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94a14e-9c71-478a-ac31-2bee37c0fdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:43.021573 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94a14e-9c71-478a-ac31-2bee37c0fdcf admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:43.022272 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94a14e-9c71-478a-ac31-2bee37c0fdcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:43.024177 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94a14e-9c71-478a-ac31-2bee37c0fdcf admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:43.116608 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1446/2890] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:14:43 2022] POST /identity/v3/projects => generated 368 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:14:43.121018 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c5449-2a3e-45ac-95b4-d7117e55c428 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:43.131900 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c5449-2a3e-45ac-95b4-d7117e55c428 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:43.192394 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5408f-d170-491c-9b54-edf92b481f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:43.193074 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5408f-d170-491c-9b54-edf92b481f20 admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:43.193365 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5408f-d170-491c-9b54-edf92b481f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:43.193646 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5408f-d170-491c-9b54-edf92b481f20 admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:43.194349 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5408f-d170-491c-9b54-edf92b481f20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:43.196279 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5408f-d170-491c-9b54-edf92b481f20 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:43.296256 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1445/2891] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:14:43 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:14:43.300615 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94a14e-9c71-478a-ac31-2bee37c0fdcf admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:43.310902 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94a14e-9c71-478a-ac31-2bee37c0fdcf admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:43.315700 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ed03c-9923-4b2a-838f-6145315440d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:43.316398 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ed03c-9923-4b2a-838f-6145315440d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:43.316684 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ed03c-9923-4b2a-838f-6145315440d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:43.316979 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ed03c-9923-4b2a-838f-6145315440d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:43.317777 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ed03c-9923-4b2a-838f-6145315440d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:43.319351 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ed03c-9923-4b2a-838f-6145315440d0 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:43.330959 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1447/2892] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:14:43 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:14:43.334998 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5408f-d170-491c-9b54-edf92b481f20 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:43.346013 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5408f-d170-491c-9b54-edf92b481f20 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:43.351384 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35889d3-e5ea-4fec-8796-c38e164cbc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:43.352073 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35889d3-e5ea-4fec-8796-c38e164cbc20 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:43.352385 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35889d3-e5ea-4fec-8796-c38e164cbc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:43.352667 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35889d3-e5ea-4fec-8796-c38e164cbc20 admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:43.353397 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35889d3-e5ea-4fec-8796-c38e164cbc20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:43.355006 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35889d3-e5ea-4fec-8796-c38e164cbc20 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:43.365287 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1446/2893] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:14:43 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:14:43.369627 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ed03c-9923-4b2a-838f-6145315440d0 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:43.380151 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ed03c-9923-4b2a-838f-6145315440d0 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:43.384764 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bb35e-5b0c-44e4-9255-0de14ab0b9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:43.385725 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bb35e-5b0c-44e4-9255-0de14ab0b9e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:43.386020 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bb35e-5b0c-44e4-9255-0de14ab0b9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:43.386294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bb35e-5b0c-44e4-9255-0de14ab0b9e6 admin admin] PATH_INFO: `/v3/projects/e4484a3f8f024262aab4a424431213f3/users/cce852c1c6a7463f8b88dddf93e08061/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:43.398775 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:43.402114 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0bb35e-5b0c-44e4-9255-0de14ab0b9e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4484a3f8f024262aab4a424431213f3, user_id=cce852c1c6a7463f8b88dddf93e08061, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:43.404764 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0bb35e-5b0c-44e4-9255-0de14ab0b9e6 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:43.496387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1448/2894] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:14:43 2022] PUT /identity/v3/projects/e4484a3f8f024262aab4a424431213f3/users/cce852c1c6a7463f8b88dddf93e08061/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:43.508363 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c8a4c-5646-45c4-852a-524b434daa85 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:43.508657 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c8a4c-5646-45c4-852a-524b434daa85 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:43.508936 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c8a4c-5646-45c4-852a-524b434daa85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:43.535927 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-3a8c8a4c-5646-45c4-852a-524b434daa85 None None] MFA Rules not processed for user `cce852c1c6a7463f8b88dddf93e08061`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:43.537148 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-3a8c8a4c-5646-45c4-852a-524b434daa85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:43.601194 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1447/2895] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:14:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:43.613437 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bb35e-5b0c-44e4-9255-0de14ab0b9e6 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:43.615141 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-ab0bb35e-5b0c-44e4-9255-0de14ab0b9e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:43.672110 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bb35e-5b0c-44e4-9255-0de14ab0b9e6 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:43.676183 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0934c63-d7c7-406b-abdf-be3655d6f2f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b236c66c184d3ca40c2069dc316664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:43.677605 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0934c63-d7c7-406b-abdf-be3655d6f2f8 service glance] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:43.677605 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0934c63-d7c7-406b-abdf-be3655d6f2f8 service glance] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:43.677605 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0934c63-d7c7-406b-abdf-be3655d6f2f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:43.685733 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0934c63-d7c7-406b-abdf-be3655d6f2f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:43.687153 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0934c63-d7c7-406b-abdf-be3655d6f2f8 service glance] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:43.696715 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1449/2896] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:14:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:14:53.597931 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=79,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:53.693364 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=29,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:15:29.208358 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c8a4c-5646-45c4-852a-524b434daa85 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:29.275415 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c8a4c-5646-45c4-852a-524b434daa85 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:29.280716 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2fa49-8bec-4a70-bba1-fa510078fd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:29.281593 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2fa49-8bec-4a70-bba1-fa510078fd01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:29.281883 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2fa49-8bec-4a70-bba1-fa510078fd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:29.282169 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2fa49-8bec-4a70-bba1-fa510078fd01 admin admin] PATH_INFO: `/v3/users/cce852c1c6a7463f8b88dddf93e08061` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:29.283379 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2fa49-8bec-4a70-bba1-fa510078fd01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cce852c1c6a7463f8b88dddf93e08061)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:29.285313 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2fa49-8bec-4a70-bba1-fa510078fd01 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:29.424943 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-c5e2fa49-8bec-4a70-bba1-fa510078fd01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cce852c1c6a7463f8b88dddf93e08061'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:29.425894 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-c5e2fa49-8bec-4a70-bba1-fa510078fd01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cce852c1c6a7463f8b88dddf93e08061'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:29.440158 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-c5e2fa49-8bec-4a70-bba1-fa510078fd01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cce852c1c6a7463f8b88dddf93e08061'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:29.448705 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-c5e2fa49-8bec-4a70-bba1-fa510078fd01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cce852c1c6a7463f8b88dddf93e08061'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:29.450550 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-c5e2fa49-8bec-4a70-bba1-fa510078fd01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cce852c1c6a7463f8b88dddf93e08061'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:29.508422 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1448/2897] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:15:29 2022] DELETE /identity/v3/users/cce852c1c6a7463f8b88dddf93e08061 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:15:29.513717 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecc5c7-9e06-4b07-87c4-5e05ae7ec728 None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:29.514133 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecc5c7-9e06-4b07-87c4-5e05ae7ec728 None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:29.514355 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecc5c7-9e06-4b07-87c4-5e05ae7ec728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:29.537128 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-7eecc5c7-9e06-4b07-87c4-5e05ae7ec728 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:15:29.538697 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-7eecc5c7-9e06-4b07-87c4-5e05ae7ec728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:29.611150 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1450/2898] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:15:29.627262 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2fa49-8bec-4a70-bba1-fa510078fd01 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:29.628730 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-c5e2fa49-8bec-4a70-bba1-fa510078fd01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:29.698957 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2fa49-8bec-4a70-bba1-fa510078fd01 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:29.703685 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a26c40-4fb7-491a-9dda-e8be60e9b114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:29.704408 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a26c40-4fb7-491a-9dda-e8be60e9b114 service neutron] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:29.704704 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a26c40-4fb7-491a-9dda-e8be60e9b114 service neutron] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:29.704991 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a26c40-4fb7-491a-9dda-e8be60e9b114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:29.723746 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a26c40-4fb7-491a-9dda-e8be60e9b114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:29.725483 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a26c40-4fb7-491a-9dda-e8be60e9b114 service neutron] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:29.736022 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1449/2899] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:15:30.161444 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecc5c7-9e06-4b07-87c4-5e05ae7ec728 None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:30.162894 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-7eecc5c7-9e06-4b07-87c4-5e05ae7ec728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:30.175342 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecc5c7-9e06-4b07-87c4-5e05ae7ec728 None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:30.180421 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662df27-2365-459a-b0f0-c96ebfa6bc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:30.183404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662df27-2365-459a-b0f0-c96ebfa6bc5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:30.183404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662df27-2365-459a-b0f0-c96ebfa6bc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:30.183404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662df27-2365-459a-b0f0-c96ebfa6bc5a admin admin] PATH_INFO: `/v3/projects/e4484a3f8f024262aab4a424431213f3` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:30.183404 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662df27-2365-459a-b0f0-c96ebfa6bc5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4484a3f8f024262aab4a424431213f3)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:30.184952 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662df27-2365-459a-b0f0-c96ebfa6bc5a admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:30.335071 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-b662df27-2365-459a-b0f0-c96ebfa6bc5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4484a3f8f024262aab4a424431213f3', 'request_id': 'req-b662df27-2365-459a-b0f0-c96ebfa6bc5a'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:30.341962 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-b662df27-2365-459a-b0f0-c96ebfa6bc5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4484a3f8f024262aab4a424431213f3', 'request_id': 'req-b662df27-2365-459a-b0f0-c96ebfa6bc5a'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:30.490760 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-b662df27-2365-459a-b0f0-c96ebfa6bc5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4484a3f8f024262aab4a424431213f3', 'request_id': 'req-b662df27-2365-459a-b0f0-c96ebfa6bc5a'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:30.502207 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-b662df27-2365-459a-b0f0-c96ebfa6bc5a admin admin] The token cache is being invalidate because project e4484a3f8f024262aab4a424431213f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86979) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:15:30.502511 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-b662df27-2365-459a-b0f0-c96ebfa6bc5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:30.503196 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-b662df27-2365-459a-b0f0-c96ebfa6bc5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:30.504781 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1451/2900] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:15:30 2022] DELETE /identity/v3/projects/e4484a3f8f024262aab4a424431213f3 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:15:30.509715 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6603bb-6859-491a-8c08-7869644381dd None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:30.510232 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6603bb-6859-491a-8c08-7869644381dd None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:30.510379 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6603bb-6859-491a-8c08-7869644381dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:30.533327 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-7c6603bb-6859-491a-8c08-7869644381dd None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:15:30.534530 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-7c6603bb-6859-491a-8c08-7869644381dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:30.552163 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:15:30.594102 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1450/2901] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:15:30.602665 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b7b58-5f08-4f60-a31a-f68f63db4a0e None None] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:30.603178 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b7b58-5f08-4f60-a31a-f68f63db4a0e None None] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:30.603299 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b7b58-5f08-4f60-a31a-f68f63db4a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:30.626024 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.auth.core [None req-b53b7b58-5f08-4f60-a31a-f68f63db4a0e None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86979) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:15:30.627313 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-b53b7b58-5f08-4f60-a31a-f68f63db4a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:30.635607 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1452/2902] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:15:30.640288 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6603bb-6859-491a-8c08-7869644381dd None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:30.650022 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6603bb-6859-491a-8c08-7869644381dd None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:30.654680 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f83225-700c-4850-814f-b8ffeb8c7b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:30.657696 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f83225-700c-4850-814f-b8ffeb8c7b24 admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:30.657696 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f83225-700c-4850-814f-b8ffeb8c7b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:30.657696 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f83225-700c-4850-814f-b8ffeb8c7b24 admin admin] PATH_INFO: `/v3/domains` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:30.657696 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f83225-700c-4850-814f-b8ffeb8c7b24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86978) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:15:30.657696 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f83225-700c-4850-814f-b8ffeb8c7b24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:30.659131 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f83225-700c-4850-814f-b8ffeb8c7b24 admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:30.670457 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1451/2903] 10.222.0.119 () {58 vars in 1157 bytes} [Thu Jul 14 16:15:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 16:15:30.675620 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b7b58-5f08-4f60-a31a-f68f63db4a0e None None] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:30.685019 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b7b58-5f08-4f60-a31a-f68f63db4a0e None None] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:30.690199 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a63290-8b8e-4659-9a27-f16181caf8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:30.690865 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a63290-8b8e-4659-9a27-f16181caf8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:30.691154 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a63290-8b8e-4659-9a27-f16181caf8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:30.691465 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a63290-8b8e-4659-9a27-f16181caf8d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:30.692221 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a63290-8b8e-4659-9a27-f16181caf8d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:30.694111 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a63290-8b8e-4659-9a27-f16181caf8d1 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:30.824514 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1453/2904] 10.222.0.119 () {60 vars in 1157 bytes} [Thu Jul 14 16:15:30 2022] POST /identity/v3/projects => generated 370 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:15:30.829048 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f83225-700c-4850-814f-b8ffeb8c7b24 admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:30.841063 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f83225-700c-4850-814f-b8ffeb8c7b24 admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:30.899228 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c214f-3276-4af7-be82-f02b743f815b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:30.899920 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c214f-3276-4af7-be82-f02b743f815b admin admin] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:30.900245 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c214f-3276-4af7-be82-f02b743f815b admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:30.900536 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c214f-3276-4af7-be82-f02b743f815b admin admin] PATH_INFO: `/v3/users` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:30.901239 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c214f-3276-4af7-be82-f02b743f815b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:30.903162 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c214f-3276-4af7-be82-f02b743f815b admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:30.972393 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1452/2905] 10.222.0.119 () {60 vars in 1148 bytes} [Thu Jul 14 16:15:30 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:15:30.976755 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a63290-8b8e-4659-9a27-f16181caf8d1 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:30.987387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a63290-8b8e-4659-9a27-f16181caf8d1 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:30.991954 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e78df1-b207-433d-a026-d3257a5741da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:30.992648 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e78df1-b207-433d-a026-d3257a5741da admin admin] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:30.992937 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e78df1-b207-433d-a026-d3257a5741da admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:30.993317 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e78df1-b207-433d-a026-d3257a5741da admin admin] PATH_INFO: `/v3/roles` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:30.994047 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e78df1-b207-433d-a026-d3257a5741da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:30.995639 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e78df1-b207-433d-a026-d3257a5741da admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:31.006768 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1454/2906] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:15:30 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:15:31.010882 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c214f-3276-4af7-be82-f02b743f815b admin admin] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:31.022058 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c214f-3276-4af7-be82-f02b743f815b admin admin] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:31.026607 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a12f5-d1f9-4a8d-803c-4f6f253d44ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:31.027288 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a12f5-d1f9-4a8d-803c-4f6f253d44ed admin admin] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:31.027573 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a12f5-d1f9-4a8d-803c-4f6f253d44ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:31.027850 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a12f5-d1f9-4a8d-803c-4f6f253d44ed admin admin] PATH_INFO: `/v3/roles` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:31.028611 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a12f5-d1f9-4a8d-803c-4f6f253d44ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:31.030314 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a12f5-d1f9-4a8d-803c-4f6f253d44ed admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:31.040428 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1453/2907] 10.222.0.119 () {58 vars in 1126 bytes} [Thu Jul 14 16:15:31 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:15:31.044748 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e78df1-b207-433d-a026-d3257a5741da admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:31.057294 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e78df1-b207-433d-a026-d3257a5741da admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:31.062680 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12e318-c92f-474c-8d05-fc5a44fd3029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:31.063571 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12e318-c92f-474c-8d05-fc5a44fd3029 admin admin] REQUEST_METHOD: `PUT` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:31.063858 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12e318-c92f-474c-8d05-fc5a44fd3029 admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:31.064170 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12e318-c92f-474c-8d05-fc5a44fd3029 admin admin] PATH_INFO: `/v3/projects/0750b15ceb9b4dbfad13665090961869/users/c61fb8c681964276ac92f911a291d8ba/roles/14c8b3b550ba4f75a147b8851fd17c7c` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:31.079901 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12e318-c92f-474c-8d05-fc5a44fd3029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0750b15ceb9b4dbfad13665090961869, user_id=c61fb8c681964276ac92f911a291d8ba, role_id=14c8b3b550ba4f75a147b8851fd17c7c)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:31.082552 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12e318-c92f-474c-8d05-fc5a44fd3029 admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:31.158842 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1455/2908] 10.222.0.119 () {60 vars in 1487 bytes} [Thu Jul 14 16:15:31 2022] PUT /identity/v3/projects/0750b15ceb9b4dbfad13665090961869/users/c61fb8c681964276ac92f911a291d8ba/roles/14c8b3b550ba4f75a147b8851fd17c7c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:15:31.169014 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d982a-8afa-4765-b43b-3271cbaa9013 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:31.172651 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d982a-8afa-4765-b43b-3271cbaa9013 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:31.172651 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d982a-8afa-4765-b43b-3271cbaa9013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:31.198297 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-860d982a-8afa-4765-b43b-3271cbaa9013 None None] MFA Rules not processed for user `c61fb8c681964276ac92f911a291d8ba`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:15:31.199522 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-860d982a-8afa-4765-b43b-3271cbaa9013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:31.268437 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1454/2909] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:15:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:15:31.280406 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12e318-c92f-474c-8d05-fc5a44fd3029 admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:31.283093 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-af12e318-c92f-474c-8d05-fc5a44fd3029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:31.313036 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:15:31.350793 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12e318-c92f-474c-8d05-fc5a44fd3029 admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:31.354695 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e268de2-b6ab-4be8-8daf-73f165eb38fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40b236c66c184d3ca40c2069dc316664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:31.355342 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e268de2-b6ab-4be8-8daf-73f165eb38fb service glance] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:31.355627 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e268de2-b6ab-4be8-8daf-73f165eb38fb service glance] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:31.355904 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e268de2-b6ab-4be8-8daf-73f165eb38fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:31.365843 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e268de2-b6ab-4be8-8daf-73f165eb38fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:31.367258 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e268de2-b6ab-4be8-8daf-73f165eb38fb service glance] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:31.377095 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1456/2910] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:15:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:15:38.218378 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d982a-8afa-4765-b43b-3271cbaa9013 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:38.219770 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-860d982a-8afa-4765-b43b-3271cbaa9013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:38.243044 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:15:38.317395 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d982a-8afa-4765-b43b-3271cbaa9013 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:38.322423 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3f624-385b-4e42-94a4-0a42b127b635 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716cbbfeede34885b0411e5b9b25df47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:38.323068 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3f624-385b-4e42-94a4-0a42b127b635 service placement] REQUEST_METHOD: `GET` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:38.323355 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3f624-385b-4e42-94a4-0a42b127b635 service placement] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:38.323634 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3f624-385b-4e42-94a4-0a42b127b635 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:38.325422 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-e3b3f624-385b-4e42-94a4-0a42b127b635 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:38.336936 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3f624-385b-4e42-94a4-0a42b127b635 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:38.338498 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3f624-385b-4e42-94a4-0a42b127b635 service placement] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:38.349855 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1455/2911] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:15:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:15:41.409896 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=17 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:15:48.345030 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=33 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:16:06.628881 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e268de2-b6ab-4be8-8daf-73f165eb38fb service glance] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:16:06.690557 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e268de2-b6ab-4be8-8daf-73f165eb38fb service glance] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:16:06.695373 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948631d2-40c5-422e-842e-347f40ddae0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:16:06.696279 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948631d2-40c5-422e-842e-347f40ddae0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:16:06.696567 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948631d2-40c5-422e-842e-347f40ddae0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:16:06.696845 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948631d2-40c5-422e-842e-347f40ddae0f admin admin] PATH_INFO: `/v3/users/c61fb8c681964276ac92f911a291d8ba` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:16:06.698041 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948631d2-40c5-422e-842e-347f40ddae0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c61fb8c681964276ac92f911a291d8ba)` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:16:06.699984 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948631d2-40c5-422e-842e-347f40ddae0f admin admin] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:16:06.916311 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-948631d2-40c5-422e-842e-347f40ddae0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c61fb8c681964276ac92f911a291d8ba'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:16:06.928691 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-948631d2-40c5-422e-842e-347f40ddae0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c61fb8c681964276ac92f911a291d8ba'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:16:06.938422 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-948631d2-40c5-422e-842e-347f40ddae0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c61fb8c681964276ac92f911a291d8ba'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:16:06.939385 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-948631d2-40c5-422e-842e-347f40ddae0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c61fb8c681964276ac92f911a291d8ba'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:16:07.004319 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.notifications [None req-948631d2-40c5-422e-842e-347f40ddae0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c61fb8c681964276ac92f911a291d8ba'} {{(pid=86979) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:16:07.010448 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1457/2912] 10.222.0.119 () {58 vars in 1228 bytes} [Thu Jul 14 16:16:06 2022] DELETE /identity/v3/users/c61fb8c681964276ac92f911a291d8ba => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:16:07.015077 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f51d4-cb86-4f7b-af3f-c949ae089af9 None None] REQUEST_METHOD: `POST` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:16:07.015589 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f51d4-cb86-4f7b-af3f-c949ae089af9 None None] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:16:07.015703 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f51d4-cb86-4f7b-af3f-c949ae089af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:16:07.034868 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.auth.core [None req-b92f51d4-cb86-4f7b-af3f-c949ae089af9 None None] MFA Rules not processed for user `558923a0ab794e4fab69165d8d72902b`. Rule list: `[]` (Enabled: `True`). {{(pid=86978) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:16:07.036057 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-b92f51d4-cb86-4f7b-af3f-c949ae089af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:16:07.092813 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1456/2913] 10.222.0.119 () {58 vars in 962 bytes} [Thu Jul 14 16:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:16:07.103137 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948631d2-40c5-422e-842e-347f40ddae0f admin admin] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:16:07.104583 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-948631d2-40c5-422e-842e-347f40ddae0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:16:07.162646 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948631d2-40c5-422e-842e-347f40ddae0f admin admin] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:16:07.166249 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3cc8e-da63-43b4-9363-a089f44f8d1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70559c2ce32043dd9a902837ab444622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:16:07.166949 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3cc8e-da63-43b4-9363-a089f44f8d1f service neutron] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:16:07.167187 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3cc8e-da63-43b4-9363-a089f44f8d1f service neutron] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:16:07.167468 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3cc8e-da63-43b4-9363-a089f44f8d1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:16:07.176625 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3cc8e-da63-43b4-9363-a089f44f8d1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:16:07.178082 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3cc8e-da63-43b4-9363-a089f44f8d1f service neutron] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:16:07.187471 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1458/2914] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:16:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:16:07.584806 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f51d4-cb86-4f7b-af3f-c949ae089af9 None None] Authenticating user token {{(pid=86978) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:16:07.586253 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.fernet_utils [None req-b92f51d4-cb86-4f7b-af3f-c949ae089af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86978) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:16:07.604482 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f51d4-cb86-4f7b-af3f-c949ae089af9 None None] Validating token access rules against request {{(pid=86978) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:16:07.618961 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad448e1-24e9-478a-9fc5-ce3740f23ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '558923a0ab794e4fab69165d8d72902b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a12def5ec62e451d99b7e6dd6faef1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86978) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:16:07.618961 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad448e1-24e9-478a-9fc5-ce3740f23ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:16:07.618961 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad448e1-24e9-478a-9fc5-ce3740f23ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:16:07.618961 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad448e1-24e9-478a-9fc5-ce3740f23ebb admin admin] PATH_INFO: `/v3/projects/0750b15ceb9b4dbfad13665090961869` {{(pid=86978) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:16:07.619817 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad448e1-24e9-478a-9fc5-ce3740f23ebb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0750b15ceb9b4dbfad13665090961869)` {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:16:07.619817 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad448e1-24e9-478a-9fc5-ce3740f23ebb admin admin] RBAC: Authorization granted {{(pid=86978) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:16:07.747803 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7ad448e1-24e9-478a-9fc5-ce3740f23ebb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0750b15ceb9b4dbfad13665090961869', 'request_id': 'req-7ad448e1-24e9-478a-9fc5-ce3740f23ebb'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:16:07.754835 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7ad448e1-24e9-478a-9fc5-ce3740f23ebb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0750b15ceb9b4dbfad13665090961869', 'request_id': 'req-7ad448e1-24e9-478a-9fc5-ce3740f23ebb'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:16:07.760372 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7ad448e1-24e9-478a-9fc5-ce3740f23ebb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0750b15ceb9b4dbfad13665090961869', 'request_id': 'req-7ad448e1-24e9-478a-9fc5-ce3740f23ebb'} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:16:07.834040 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7ad448e1-24e9-478a-9fc5-ce3740f23ebb admin admin] The token cache is being invalidate because project 0750b15ceb9b4dbfad13665090961869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86978) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:16:07.834336 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7ad448e1-24e9-478a-9fc5-ce3740f23ebb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:16:07.834976 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG keystone.notifications [None req-7ad448e1-24e9-478a-9fc5-ce3740f23ebb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86978) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:16:07.836583 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: [pid: 86978|app: 0|req: 1457/2915] 10.222.0.119 () {58 vars in 1237 bytes} [Thu Jul 14 16:16:07 2022] DELETE /identity/v3/projects/0750b15ceb9b4dbfad13665090961869 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:16:17.183257 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:16:17.830905 dv-cinder-849869-1-iscsi devstack@keystone.service[86978]: DEBUG dbcounter [-] [86978] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:20:46.172933 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3cc8e-da63-43b4-9363-a089f44f8d1f service neutron] Authenticating user token {{(pid=86979) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:46.174387 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-4fe3cc8e-da63-43b4-9363-a089f44f8d1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:46.243238 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3cc8e-da63-43b4-9363-a089f44f8d1f service neutron] Validating token access rules against request {{(pid=86979) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:46.301136 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbc813-1a71-491d-930e-678fcfbfc64b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '716cbbfeede34885b0411e5b9b25df47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07652ced88cf4f069d1765176be5130b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86979) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:46.301815 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbc813-1a71-491d-930e-678fcfbfc64b service placement] REQUEST_METHOD: `GET` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:46.302100 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbc813-1a71-491d-930e-678fcfbfc64b service placement] SCRIPT_NAME: `/identity` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:46.302981 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbc813-1a71-491d-930e-678fcfbfc64b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86979) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:46.304808 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.fernet_utils [None req-13cbc813-1a71-491d-930e-678fcfbfc64b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86979) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:46.316094 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbc813-1a71-491d-930e-678fcfbfc64b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:46.318560 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbc813-1a71-491d-930e-678fcfbfc64b service placement] RBAC: Authorization granted {{(pid=86979) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:46.328336 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: [pid: 86979|app: 0|req: 1459/2916] 10.222.0.119 () {60 vars in 1370 bytes} [Thu Jul 14 16:20:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:20:56.324209 dv-cinder-849869-1-iscsi devstack@keystone.service[86979]: DEBUG dbcounter [-] [86979] Writing DB stats keystone:SELECT=58 {{(pid=86979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}